-- Logs begin at Thu 2022-05-26 11:42:33 UTC, end at Thu 2022-05-26 12:51:07 UTC. -- May 26 12:19:30.319565 dv-cinder-815146-11-smb systemd[1]: Starting Devstack devstack@keystone.service... May 26 12:19:30.327092 dv-cinder-815146-11-smb devstack@keystone.service[80170]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 26 12:19:30.329708 dv-cinder-815146-11-smb devstack@keystone.service[80170]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 26 12:19:30 2022] *** May 26 12:19:30.329708 dv-cinder-815146-11-smb devstack@keystone.service[80170]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 26 12:19:30.329708 dv-cinder-815146-11-smb devstack@keystone.service[80170]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 26 12:19:30.329708 dv-cinder-815146-11-smb devstack@keystone.service[80170]: nodename: dv-cinder-815146-11-smb May 26 12:19:30.329708 dv-cinder-815146-11-smb devstack@keystone.service[80170]: machine: x86_64 May 26 12:19:30.329708 dv-cinder-815146-11-smb devstack@keystone.service[80170]: clock source: unix May 26 12:19:30.329708 dv-cinder-815146-11-smb devstack@keystone.service[80170]: pcre jit disabled May 26 12:19:30.329708 dv-cinder-815146-11-smb devstack@keystone.service[80170]: detected number of CPU cores: 4 May 26 12:19:30.329708 dv-cinder-815146-11-smb devstack@keystone.service[80170]: current working directory: / May 26 12:19:30.329708 dv-cinder-815146-11-smb devstack@keystone.service[80170]: detected binary path: /usr/bin/uwsgi-core May 26 12:19:30.329708 dv-cinder-815146-11-smb devstack@keystone.service[80170]: your processes number limit is 47680 May 26 12:19:30.329708 dv-cinder-815146-11-smb devstack@keystone.service[80170]: your memory page size is 4096 bytes May 26 12:19:30.329708 dv-cinder-815146-11-smb devstack@keystone.service[80170]: detected max file descriptor number: 2048 May 26 12:19:30.329708 dv-cinder-815146-11-smb devstack@keystone.service[80170]: lock engine: pthread robust mutexes May 26 12:19:30.330436 dv-cinder-815146-11-smb devstack@keystone.service[80170]: thunder lock: enabled May 26 12:19:30.330436 dv-cinder-815146-11-smb devstack@keystone.service[80170]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 26 12:19:30.330436 dv-cinder-815146-11-smb devstack@keystone.service[80170]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 26 12:19:30.374745 dv-cinder-815146-11-smb devstack@keystone.service[80170]: Python main interpreter initialized at 0x55dd470889c0 May 26 12:19:30.374745 dv-cinder-815146-11-smb devstack@keystone.service[80170]: python threads support enabled May 26 12:19:30.374745 dv-cinder-815146-11-smb devstack@keystone.service[80170]: your server socket listen backlog is limited to 100 connections May 26 12:19:30.374745 dv-cinder-815146-11-smb devstack@keystone.service[80170]: your mercy for graceful operations on workers is 90 seconds May 26 12:19:30.375073 dv-cinder-815146-11-smb devstack@keystone.service[80170]: mapped 403077 bytes (393 KB) for 2 cores May 26 12:19:30.375149 dv-cinder-815146-11-smb devstack@keystone.service[80170]: *** Operational MODE: preforking *** May 26 12:19:30.375416 dv-cinder-815146-11-smb devstack@keystone.service[80170]: *** uWSGI is running in multiple interpreter mode *** May 26 12:19:30.375416 dv-cinder-815146-11-smb devstack@keystone.service[80170]: spawned uWSGI master process (pid: 80170) May 26 12:19:30.375601 dv-cinder-815146-11-smb systemd[1]: Started Devstack devstack@keystone.service. May 26 12:19:30.379025 dv-cinder-815146-11-smb devstack@keystone.service[80170]: spawned uWSGI worker 1 (pid: 80180, cores: 1) May 26 12:19:30.379025 dv-cinder-815146-11-smb devstack@keystone.service[80170]: spawned uWSGI worker 2 (pid: 80181, cores: 1) May 26 12:19:30.379025 dv-cinder-815146-11-smb devstack@keystone.service[80170]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 26 12:19:36.043690 dv-cinder-815146-11-smb devstack@keystone.service[80181]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 12:19:36.043690 dv-cinder-815146-11-smb devstack@keystone.service[80181]: from cryptography.utils import int_from_bytes May 26 12:19:36.044432 dv-cinder-815146-11-smb devstack@keystone.service[80180]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 12:19:36.044432 dv-cinder-815146-11-smb devstack@keystone.service[80180]: from cryptography.utils import int_from_bytes May 26 12:19:36.044854 dv-cinder-815146-11-smb devstack@keystone.service[80181]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 12:19:36.044854 dv-cinder-815146-11-smb devstack@keystone.service[80181]: from cryptography.utils import int_from_bytes May 26 12:19:36.044970 dv-cinder-815146-11-smb devstack@keystone.service[80180]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 12:19:36.044970 dv-cinder-815146-11-smb devstack@keystone.service[80180]: from cryptography.utils import int_from_bytes May 26 12:19:36.093529 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 12:19:36.093670 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 12:19:36.093755 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 12:19:36.093835 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 12:19:36.093902 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] command line args: [] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 12:19:36.093975 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] command line args: [] {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 12:19:36.094157 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 12:19:36.094253 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 12:19:36.094332 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ================================================================================ {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 12:19:36.094403 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ================================================================================ {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 12:19:36.094580 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] admin_token = **** {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.094671 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] admin_token = **** {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.094829 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] config_dir = [] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.094909 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] config_dir = [] {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.095016 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.095101 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.095710 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] config_source = [] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.095804 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] config_source = [] {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.095882 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] debug = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.095959 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] debug = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.096079 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.096346 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.096434 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.096492 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.096602 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.096676 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.096868 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.096946 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.097122 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.097196 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.097470 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] list_limit = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.097660 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] log_config_append = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.097840 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.098018 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] log_dir = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.098192 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] log_file = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.098422 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.098676 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.098925 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.099174 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.099261 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] list_limit = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.099340 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.099453 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] log_config_append = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.099537 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.099653 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.099784 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.099867 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] log_dir = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.099983 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.100063 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] log_file = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.100226 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.100310 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.100462 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.100553 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.100698 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.100784 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.100954 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.101099 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.101189 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.101288 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.101439 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.101527 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.101714 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.101849 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.101970 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.102200 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.102336 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.102428 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] publish_errors = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.102506 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.102605 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.102684 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.102835 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.102918 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.102998 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.103138 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.103248 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.103390 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.103486 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.103665 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.103784 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] standard_threads = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.103942 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.104150 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.104230 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.104360 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] publish_errors = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.104444 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.104563 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] use_journal = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.104637 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.104713 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] use_json = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.104795 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.104976 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] use_stderr = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.105059 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.105136 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] use_syslog = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.105206 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.105275 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.105441 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.105526 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.105681 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] standard_threads = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.105766 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.105916 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.106001 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.106163 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.106242 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.106342 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.106421 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.106520 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] use_journal = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.106643 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.106728 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] use_json = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.106859 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] use_stderr = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.106936 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.107036 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] use_syslog = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.107121 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.107269 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:19:36.107349 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.107528 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.107605 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.107770 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.107853 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.108033 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.108114 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.108275 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.108355 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.108510 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.108637 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.108757 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.108852 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.109027 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.109105 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.109265 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.109343 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.109516 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.109603 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.109764 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.109842 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.110008 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.110091 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.110243 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.110321 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.110493 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.110575 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.110729 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.110829 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.111551 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.111639 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.111801 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.111883 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.112036 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.112120 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.112270 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.112355 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.112502 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.112581 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.112739 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.112818 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.113016 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.113103 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.113266 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.113345 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.113499 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.113578 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.113731 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.113815 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.113978 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.114063 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.114226 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.114305 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.114452 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.114525 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.114680 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.114765 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.114922 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.115009 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.115158 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.115235 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.115394 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.115473 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.115627 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.115713 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.115858 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.115941 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.116087 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.116164 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.116318 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.116404 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.116556 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.116634 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.116804 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.116900 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.117059 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.117153 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.117297 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.117374 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.117529 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.117606 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.117759 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.117851 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.117994 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.118073 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.118227 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.118311 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.118458 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.118543 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.118695 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.118802 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.118932 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.119035 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.119165 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.119277 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.119400 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.119541 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.119653 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.119771 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.119847 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.119971 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.120093 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.120169 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.120314 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.120439 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.120547 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.120635 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.120775 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.120904 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.121041 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.121121 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.121280 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.121371 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.121510 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.121589 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.121749 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.121830 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.121981 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.122062 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.122231 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.122315 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.122469 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.122589 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.122706 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.122785 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.122938 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.123022 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.123179 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.123259 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.123436 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.123565 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.123653 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.123739 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.123876 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.123970 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.124111 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.124190 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.124350 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.124437 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.124596 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.124673 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.124867 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.124949 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.125095 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.125187 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.125332 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.125408 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.125566 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.125649 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.125797 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.125871 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.126041 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.126119 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.126281 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.126357 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.126549 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.126627 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.126791 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.126869 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.127029 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.127105 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.127266 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.127343 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.127501 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.127577 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.127738 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.127814 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.127971 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.128057 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.128204 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.128282 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.128434 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.128513 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.128671 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.128763 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.128970 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.129052 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.129217 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.129295 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.129458 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.129536 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.129698 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.129777 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.129937 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.130015 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.130171 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.130250 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.130404 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.130483 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.130637 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.130715 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.130875 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.130963 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] auth.external = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.131108 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.131205 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.131348 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.131426 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.131586 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.131664 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.131841 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.131920 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] auth.password = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.132071 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] auth.token = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.132149 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.132315 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.132410 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.132553 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.132641 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.132801 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.132902 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.133059 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.133146 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] auth.external = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.133289 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.133372 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.133544 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.133623 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.133777 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.133855 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.134015 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] credential.caching = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.134104 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] auth.password = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.134246 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] auth.token = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.134331 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.134488 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.134566 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.134725 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.134814 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.134971 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.135049 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.135203 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.135281 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.135442 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.135528 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.135691 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.135768 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.135925 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.136008 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.136163 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] credential.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.136248 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.136411 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.136490 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.136662 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.136747 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.136944 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.137039 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.137188 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.137267 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.137438 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.137516 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.137677 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.137764 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.137916 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] federation.caching = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.137994 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.138156 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.138234 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.138404 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.138495 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.138653 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.138739 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.138884 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.138966 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.139133 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.139223 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.139370 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.139448 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.139625 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.139710 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.139865 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.140031 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.140113 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.140191 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] federation.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.140350 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.140428 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.140598 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.140690 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.140852 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] identity.caching = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.140952 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.141088 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.141166 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.141338 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.141423 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.141575 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.141652 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.141810 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.141889 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.142078 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.142164 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.142314 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.142393 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.142553 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.142631 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.142802 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.142887 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.143042 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.143120 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.143272 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.143349 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.143505 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.143591 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.143738 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.143816 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.143975 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.144052 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.144220 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.144298 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.144451 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.144527 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.144690 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.144771 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.144965 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.145052 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.145221 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.145299 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.145454 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.145531 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.145686 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.145767 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.145919 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.145995 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.146160 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.146238 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.146394 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.146474 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.146631 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.146709 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.146873 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.146952 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.147113 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.147194 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.147361 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.147440 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.147592 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.147670 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.147840 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.147927 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.148074 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.148155 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.148311 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.148389 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.148543 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.148622 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.148781 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.148911 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.149035 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.149112 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.149280 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.149359 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.149510 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.149586 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.149750 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.149827 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.149987 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.150067 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.150234 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.150311 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.150471 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.150548 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.150708 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.150786 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.150954 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.151031 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.151187 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.151265 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.151420 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.151498 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.151651 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.151729 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.151902 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.151988 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.152141 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.152220 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.152376 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.152451 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.152613 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.152691 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.152862 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.152944 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.153102 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.user = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.153180 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.153343 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.153421 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.153576 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.153655 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.153811 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.153889 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.154055 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.154132 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.154302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.154381 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.154540 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.154778 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.154854 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.155015 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.155202 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.155281 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.155476 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.155552 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.155735 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.155822 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.155968 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.156046 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.156206 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.156282 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.156439 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.156526 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.156689 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.156767 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.156958 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.157037 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.157192 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.157281 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.157431 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.157509 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.158179 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.158264 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.158427 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.158513 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.158658 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.158735 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.158906 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.158982 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.159145 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.159231 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.159383 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.159461 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.159619 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.159697 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.159864 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.159950 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.160096 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.160174 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.160335 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.160412 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.160573 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.160658 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.160813 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.160938 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.161074 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.161152 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.161311 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.161399 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.161548 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.161633 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.161785 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.161863 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.162023 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.162107 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.162266 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.162342 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.162498 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.162576 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.162740 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.162825 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.162979 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] resource.caching = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.163056 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.163215 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.163325 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.163453 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.163606 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.163703 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.163801 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.163946 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.164051 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.164182 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.164303 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.164421 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.164543 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.164662 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] resource.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.164793 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.165041 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.165132 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.165285 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.165362 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.165521 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.165598 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] role.caching = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.165769 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] role.driver = sql {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.165855 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.166003 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.166080 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.166248 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.166324 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.166496 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.166581 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.166734 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.166811 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.166976 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.167054 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.167215 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] role.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.167301 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.167461 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.167537 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] role.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.167691 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.167767 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.167942 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.168027 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.168175 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.168252 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.168423 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.168501 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.168672 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.168757 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.168942 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.169024 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.169191 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.169268 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.169442 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.169584 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.169693 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.169824 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.169929 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.170076 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.170163 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.170327 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.170405 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.170575 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.170653 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.170829 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.170915 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.171067 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.171267 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.171345 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.171509 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.171586 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.171761 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.171841 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.172012 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.172090 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.172257 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.172335 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.172491 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.172570 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.172733 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.172810 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.173018 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.173095 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.173274 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.174389 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.174879 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.174967 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.175042 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.175112 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.175193 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.175266 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.175337 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] token.caching = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.175407 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.175477 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.175548 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.175626 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.175699 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.175770 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.175851 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.175929 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.176013 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.176087 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.176158 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.176228 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.176298 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.176369 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.176447 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] token.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.176614 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.176694 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.176893 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.176975 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.177122 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.177213 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.177363 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.177442 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.177600 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.177678 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.177837 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.177923 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.178086 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.178164 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.178316 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.178393 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.178560 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.178647 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.178798 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.178876 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.179038 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.179116 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] database.connection = **** {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.179276 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.179364 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.179535 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.179622 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.179786 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.179865 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.180017 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.180095 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.180253 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.180339 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.180495 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.180575 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.180741 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.180819 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] database.connection = **** {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.181002 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.181094 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.181262 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.181342 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.181505 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.181584 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.181754 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.181832 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.181990 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.182069 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.182237 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.182316 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.182476 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.182552 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.182713 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.182791 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.182945 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.183022 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.183188 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.183266 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.183409 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.183484 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.183582 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 12:19:36.183662 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.183899 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.184140 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.184387 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.184621 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.184878 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.185121 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:19:36.185291 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 12:19:36.215076 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:19:36.215305 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:19:36.215535 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:19:36.216046 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:19:36.216282 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:19:36.216511 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:19:36.224745 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:19:36.225814 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:19:36.252968 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:19:36.253199 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:19:36.253817 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:19:36.254050 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:19:36.305930 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:19:36.306132 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:19:36.357601 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:19:36.357832 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:19:36.357936 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:19:36.358101 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:19:36.423788 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:19:36.424009 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:19:36.424112 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:19:36.424234 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:19:36.424333 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:19:36.424458 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:19:36.424541 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:19:36.424677 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:19:36.424758 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:19:36.424913 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:19:36.424998 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:19:36.425129 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:19:36.447919 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:19:36.448024 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:19:36.448151 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:19:36.448236 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:19:36.448432 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:19:36.448524 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:19:36.448662 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:19:36.448754 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:19:36.448909 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:19:36.448995 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:19:36.449130 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:19:36.449213 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:19:36.449346 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:19:36.449442 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:19:36.461264 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:19:36.461391 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:19:36.474380 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:19:36.474556 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:19:36.474661 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:19:36.474789 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:19:36.474872 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:19:36.475014 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:19:36.475097 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:19:36.475234 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:19:36.475317 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:19:36.475447 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:19:36.475528 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:19:36.475658 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:19:36.475739 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:19:36.475874 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:19:36.494807 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.495022 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 12:19:36.495332 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.495415 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.495544 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 12:19:36.495628 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 12:19:36.495813 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.495895 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.496068 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 12:19:36.496150 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.496330 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.496422 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.496588 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.496669 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.496866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.497124 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.507669 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.507948 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.508159 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.508242 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.508439 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.508535 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.508707 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.509020 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.516620 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:19:36.517630 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:19:36.520436 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:19:36.520718 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.520914 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:19:36.521039 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.521200 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.521327 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.521488 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.521611 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.521775 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.521877 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.522058 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.522257 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.522339 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.522537 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.522687 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.522811 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.522966 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.523086 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.523240 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.523356 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.523517 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.523797 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.550040 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.550516 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.551849 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:19:36.552134 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.552315 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:19:36.552598 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.557486 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:19:36.557723 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.557914 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:19:36.557997 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.558197 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.558490 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.565874 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:19:36.566158 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.566375 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:19:36.566657 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.570687 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:19:36.571086 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.571167 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:19:36.571374 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.571558 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.571668 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.571849 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.571931 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.572143 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.572225 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.572420 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.572503 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.572725 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.572806 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.573022 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.573300 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.592080 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.592358 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.592581 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.592879 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.597055 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:19:36.597566 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:19:36.600674 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.600994 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.601246 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.601541 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.606003 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:19:36.606587 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:19:36.609595 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:19:36.610264 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:19:36.613405 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.613707 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.613998 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.614079 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.614283 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.614391 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.614550 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.614678 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.614838 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.614964 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.615252 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.615534 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.634103 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:19:36.634387 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.634653 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.634838 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:19:36.634934 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.635125 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.635394 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.635657 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.643417 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.644213 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.645147 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.645431 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.645946 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.646232 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.648478 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:19:36.648761 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.649069 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.649289 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:19:36.649372 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.649572 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.649668 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.649854 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.650135 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.650411 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.662880 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:19:36.663163 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.663443 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.663732 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.663815 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:19:36.664023 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.664115 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.664301 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.664383 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.664587 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.664668 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.664905 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.665186 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.665473 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.682557 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:19:36.683349 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:19:36.685834 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:19:36.686639 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:19:36.689655 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.690466 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.691267 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.692082 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.692912 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:19:36.693204 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.693485 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.693751 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:19:36.694041 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.694330 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.700794 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.701683 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.702409 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:19:36.703274 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:19:36.706248 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.706540 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.706824 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.707082 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.707165 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.707374 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.707659 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.708017 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.716361 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:19:36.716649 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.717056 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.717351 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:19:36.717638 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.718025 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.724950 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:19:36.725237 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.725522 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.725800 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.725959 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:19:36.726073 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.726241 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.726348 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.726523 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.726637 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.726802 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.726905 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.727077 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.727192 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.727352 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.727469 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.727642 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.727779 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.727913 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.727996 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.728198 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.728280 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.728467 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.728551 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.728738 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.729025 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.729299 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.729558 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:19:36.768095 dv-cinder-815146-11-smb devstack@keystone.service[80181]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55dd470889c0 pid: 80181 (default app) May 26 12:19:36.769129 dv-cinder-815146-11-smb devstack@keystone.service[80180]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55dd470889c0 pid: 80180 (default app) May 26 12:19:36.771388 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4299dcb-ff00-434b-8d36-516cbc354486 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:36.771689 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4299dcb-ff00-434b-8d36-516cbc354486 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:36.771969 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4299dcb-ff00-434b-8d36-516cbc354486 None None] PATH_INFO: `/v3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:36.776346 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 791 bytes} [Thu May 26 12:19:36 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:44.679124 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbf55e-0df3-4b7d-814f-f665e4a48089 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:44.679688 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbf55e-0df3-4b7d-814f-f665e4a48089 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:44.679688 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbf55e-0df3-4b7d-814f-f665e4a48089 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:44.684115 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1/2] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:19:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:19:44.689409 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4211394-bab4-42cb-a4fa-cb28c46a84d2 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:44.689798 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4211394-bab4-42cb-a4fa-cb28c46a84d2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:44.689958 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4211394-bab4-42cb-a4fa-cb28c46a84d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:44.757796 dv-cinder-815146-11-smb devstack@keystone.service[80181]: INFO dbcounter [None req-a4211394-bab4-42cb-a4fa-cb28c46a84d2 None None] Registered counter for database keystone May 26 12:19:44.779425 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG oslo_db.sqlalchemy.engines [None req-a4211394-bab4-42cb-a4fa-cb28c46a84d2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80181) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:19:44.786205 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writer thread running {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:19:44.961513 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG passlib.handlers.bcrypt [None req-a4211394-bab4-42cb-a4fa-cb28c46a84d2 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80181) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 26 12:19:44.961868 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG passlib.handlers.bcrypt [None req-a4211394-bab4-42cb-a4fa-cb28c46a84d2 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80181) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 26 12:19:45.016759 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a4211394-bab4-42cb-a4fa-cb28c46a84d2 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:45.018942 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a4211394-bab4-42cb-a4fa-cb28c46a84d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:45.141713 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 2/3] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:19:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 453 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 26 12:19:45.358215 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bbf55e-0df3-4b7d-814f-f665e4a48089 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:45.427113 dv-cinder-815146-11-smb devstack@keystone.service[80180]: INFO dbcounter [None req-02bbf55e-0df3-4b7d-814f-f665e4a48089 None None] Registered counter for database keystone May 26 12:19:45.446437 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG oslo_db.sqlalchemy.engines [None req-02bbf55e-0df3-4b7d-814f-f665e4a48089 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80180) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:19:45.452603 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writer thread running {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:19:45.588162 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bbf55e-0df3-4b7d-814f-f665e4a48089 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:45.592728 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f4dd5c-29be-46a4-8cd5-308fed202922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:45.593427 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4dd5c-29be-46a4-8cd5-308fed202922 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:45.593716 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4dd5c-29be-46a4-8cd5-308fed202922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:45.593998 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4dd5c-29be-46a4-8cd5-308fed202922 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:45.602609 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f4dd5c-29be-46a4-8cd5-308fed202922 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:45.652969 dv-cinder-815146-11-smb devstack@keystone.service[80180]: WARNING keystone.common.rbac_enforcer.enforcer [None req-98f4dd5c-29be-46a4-8cd5-308fed202922 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 26 12:19:45.653269 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f4dd5c-29be-46a4-8cd5-308fed202922 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:45.663366 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 2/4] 10.222.0.16 () {58 vars in 1324 bytes} [Thu May 26 12:19:45 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:19:45.669404 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4211394-bab4-42cb-a4fa-cb28c46a84d2 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:45.684515 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4211394-bab4-42cb-a4fa-cb28c46a84d2 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:45.689005 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5f64c3-ee02-4b8f-bdc4-d574edd450c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:45.690112 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f64c3-ee02-4b8f-bdc4-d574edd450c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:45.690636 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f64c3-ee02-4b8f-bdc4-d574edd450c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:45.690730 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f64c3-ee02-4b8f-bdc4-d574edd450c1 admin admin] PATH_INFO: `/v3/projects/3c6d7f5ce344426b88b98fb2483df1ff` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:45.692196 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5f64c3-ee02-4b8f-bdc4-d574edd450c1 admin admin] RBAC: Authorizing `identity:get_project(project_id=3c6d7f5ce344426b88b98fb2483df1ff)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:45.850431 dv-cinder-815146-11-smb devstack@keystone.service[80181]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ee5f64c3-ee02-4b8f-bdc4-d574edd450c1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 26 12:19:45.850781 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5f64c3-ee02-4b8f-bdc4-d574edd450c1 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:45.855550 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 3/5] 10.222.0.16 () {56 vars in 1207 bytes} [Thu May 26 12:19:45 2022] GET /identity/v3/projects/3c6d7f5ce344426b88b98fb2483df1ff => generated 344 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:48.024164 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e44b6-608d-4e94-ba0c-deb462e6e797 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:48.024640 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e44b6-608d-4e94-ba0c-deb462e6e797 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:48.024640 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e44b6-608d-4e94-ba0c-deb462e6e797 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:48.028766 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 3/6] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:19:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:19:48.034732 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717d145-fd8a-42d5-928f-3b94efc61d2c None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:48.035127 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717d145-fd8a-42d5-928f-3b94efc61d2c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:48.035300 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717d145-fd8a-42d5-928f-3b94efc61d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:48.054721 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-e717d145-fd8a-42d5-928f-3b94efc61d2c None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:48.056243 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e717d145-fd8a-42d5-928f-3b94efc61d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:48.064094 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 4/7] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:19:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 26 12:19:48.085946 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e44b6-608d-4e94-ba0c-deb462e6e797 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:48.098617 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e44b6-608d-4e94-ba0c-deb462e6e797 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:48.102757 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b8667-546d-45e9-a079-0d3705774da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:48.103446 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b8667-546d-45e9-a079-0d3705774da7 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:48.103781 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b8667-546d-45e9-a079-0d3705774da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:48.104062 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b8667-546d-45e9-a079-0d3705774da7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:48.112794 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99b8667-546d-45e9-a079-0d3705774da7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:48.114581 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99b8667-546d-45e9-a079-0d3705774da7 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:48.123188 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 4/8] 10.222.0.16 () {58 vars in 1324 bytes} [Thu May 26 12:19:48 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:19:48.128520 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e717d145-fd8a-42d5-928f-3b94efc61d2c None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:48.137449 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e717d145-fd8a-42d5-928f-3b94efc61d2c None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:48.141831 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0d264-e2ef-452a-a167-b3d37e05c391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:48.142686 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0d264-e2ef-452a-a167-b3d37e05c391 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:48.142970 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0d264-e2ef-452a-a167-b3d37e05c391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:48.143247 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0d264-e2ef-452a-a167-b3d37e05c391 admin admin] PATH_INFO: `/v3/users/25194ab74edc4c009c8aaa9efa80932f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:48.144633 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d0d264-e2ef-452a-a167-b3d37e05c391 admin admin] RBAC: Authorizing `identity:get_user(user_id=25194ab74edc4c009c8aaa9efa80932f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:48.146502 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d0d264-e2ef-452a-a167-b3d37e05c391 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:48.148052 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 5/9] 10.222.0.16 () {56 vars in 1198 bytes} [Thu May 26 12:19:48 2022] GET /identity/v3/users/25194ab74edc4c009c8aaa9efa80932f => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:50.391537 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c4cd9-9024-4d8c-b7f7-0f2cbef56347 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:50.392632 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c4cd9-9024-4d8c-b7f7-0f2cbef56347 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:50.392632 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c4cd9-9024-4d8c-b7f7-0f2cbef56347 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:50.394021 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 5/10] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:19:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:19:50.399273 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c664fd8-d7d5-42c2-b3bb-2797b4645698 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:50.399694 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c664fd8-d7d5-42c2-b3bb-2797b4645698 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:50.399841 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c664fd8-d7d5-42c2-b3bb-2797b4645698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:50.405822 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aea069-272c-4f69-bdce-a8a095e5eedc None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:50.406104 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aea069-272c-4f69-bdce-a8a095e5eedc None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:50.406379 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aea069-272c-4f69-bdce-a8a095e5eedc None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:50.407790 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 6/11] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:19:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:19:50.412767 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38179f-3791-4a0f-b286-e302b330d9e5 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:50.413087 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38179f-3791-4a0f-b286-e302b330d9e5 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:50.413362 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38179f-3791-4a0f-b286-e302b330d9e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:50.416265 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-0c664fd8-d7d5-42c2-b3bb-2797b4645698 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:50.417478 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0c664fd8-d7d5-42c2-b3bb-2797b4645698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:50.452696 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG passlib.handlers.bcrypt [None req-3b38179f-3791-4a0f-b286-e302b330d9e5 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80180) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 26 12:19:50.453148 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG passlib.handlers.bcrypt [None req-3b38179f-3791-4a0f-b286-e302b330d9e5 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80180) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 26 12:19:50.496571 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 6/12] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:19:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:19:50.499773 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-3b38179f-3791-4a0f-b286-e302b330d9e5 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:50.501954 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-3b38179f-3791-4a0f-b286-e302b330d9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:50.519846 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c664fd8-d7d5-42c2-b3bb-2797b4645698 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:50.543374 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:50.601877 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 7/13] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:19:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:19:50.623413 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c664fd8-d7d5-42c2-b3bb-2797b4645698 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:50.623950 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b38179f-3791-4a0f-b286-e302b330d9e5 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:50.658081 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4888c5f-3b00-465f-ab21-42be4d89dcc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:50.658823 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4888c5f-3b00-465f-ab21-42be4d89dcc7 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:50.659116 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4888c5f-3b00-465f-ab21-42be4d89dcc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:50.659398 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4888c5f-3b00-465f-ab21-42be4d89dcc7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:50.672636 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4888c5f-3b00-465f-ab21-42be4d89dcc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:19:50.684797 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-c4888c5f-3b00-465f-ab21-42be4d89dcc7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:19:50.684797 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:50.684797 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:50.684797 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:50.684797 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:50.684797 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:50.684797 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:50.684797 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:50.684797 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:50.684797 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:50.684797 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:50.684797 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:50.684797 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:19:50.684797 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:19:50.684797 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:19:50.684797 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:19:50.686019 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:19:50.686019 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:19:50.686019 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:19:50.686019 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:19:50.686019 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:50.686019 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:50.686019 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:50.686019 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:50.686019 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:50.686019 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:50.686019 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:50.686019 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:19:50.686019 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:50.686019 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:50.686019 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:50.686019 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:50.692352 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:50.692352 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:50.692352 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:50.692352 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:50.692352 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:19:50.692352 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:19:50.692352 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:19:50.692352 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:19:50.692352 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:19:50.692352 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:19:50.692352 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:19:50.692352 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:19:50.692352 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 7/14] 10.222.0.16 () {56 vars in 1096 bytes} [Thu May 26 12:19:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:19:50.693053 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4888c5f-3b00-465f-ab21-42be4d89dcc7 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:50.778987 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:50.797507 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4888c5f-3b00-465f-ab21-42be4d89dcc7 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:50.832115 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf5fb9-da3f-4459-96df-8860fade9024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:50.832779 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf5fb9-da3f-4459-96df-8860fade9024 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:50.833106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf5fb9-da3f-4459-96df-8860fade9024 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:50.833388 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf5fb9-da3f-4459-96df-8860fade9024 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:50.834138 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf5fb9-da3f-4459-96df-8860fade9024 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:50.834447 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf5fb9-da3f-4459-96df-8860fade9024 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:50.835845 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf5fb9-da3f-4459-96df-8860fade9024 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:50.839198 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b38179f-3791-4a0f-b286-e302b330d9e5 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:50.841735 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:50.848296 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 8/15] 10.222.0.16 () {56 vars in 1099 bytes} [Thu May 26 12:19:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:19:50.853682 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf5fb9-da3f-4459-96df-8860fade9024 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:50.877258 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d35694-45b5-4218-96d9-8d855991677d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:50.878157 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d35694-45b5-4218-96d9-8d855991677d None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:50.878441 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d35694-45b5-4218-96d9-8d855991677d None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:50.878724 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d35694-45b5-4218-96d9-8d855991677d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:50.946572 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d35694-45b5-4218-96d9-8d855991677d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:50.948023 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d35694-45b5-4218-96d9-8d855991677d None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:50.951975 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf5fb9-da3f-4459-96df-8860fade9024 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:50.987607 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ebe14-f0f4-461f-96ca-f889527d6806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:50.988465 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ebe14-f0f4-461f-96ca-f889527d6806 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:50.988743 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ebe14-f0f4-461f-96ca-f889527d6806 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:50.989045 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ebe14-f0f4-461f-96ca-f889527d6806 None admin] PATH_INFO: `/v3/users/25194ab74edc4c009c8aaa9efa80932f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:50.990241 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5ebe14-f0f4-461f-96ca-f889527d6806 None admin] RBAC: Authorizing `identity:get_user(user_id=25194ab74edc4c009c8aaa9efa80932f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:50.991688 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5ebe14-f0f4-461f-96ca-f889527d6806 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:50.993326 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 9/16] 10.222.0.16 () {56 vars in 1177 bytes} [Thu May 26 12:19:50 2022] GET /identity/v3/users/25194ab74edc4c009c8aaa9efa80932f => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:19:50.998481 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ebe14-f0f4-461f-96ca-f889527d6806 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:51.012304 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:51.045809 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 8/17] 10.222.0.16 () {58 vars in 1282 bytes} [Thu May 26 12:19:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 12:19:51.051974 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d35694-45b5-4218-96d9-8d855991677d None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:51.055066 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:51.100994 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ebe14-f0f4-461f-96ca-f889527d6806 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:51.134550 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a88be76-3b8a-4717-8db2-8c7459319727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:51.135340 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88be76-3b8a-4717-8db2-8c7459319727 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:51.135626 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88be76-3b8a-4717-8db2-8c7459319727 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:51.135896 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88be76-3b8a-4717-8db2-8c7459319727 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:51.137108 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a88be76-3b8a-4717-8db2-8c7459319727 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:51.138644 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a88be76-3b8a-4717-8db2-8c7459319727 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:51.140244 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 10/18] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:19:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:19:51.145902 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a88be76-3b8a-4717-8db2-8c7459319727 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:51.151569 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d35694-45b5-4218-96d9-8d855991677d None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:51.184996 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed7a77c-e86d-4226-92a9-4d7011ab6af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:51.185774 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed7a77c-e86d-4226-92a9-4d7011ab6af2 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:51.186055 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed7a77c-e86d-4226-92a9-4d7011ab6af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:51.186330 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed7a77c-e86d-4226-92a9-4d7011ab6af2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:51.205075 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed7a77c-e86d-4226-92a9-4d7011ab6af2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:51.206532 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed7a77c-e86d-4226-92a9-4d7011ab6af2 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:51.225489 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:51.227408 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-bed7a77c-e86d-4226-92a9-4d7011ab6af2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:51.227408 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:51.227408 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:51.227408 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:51.227408 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:51.227408 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:51.227408 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:51.227408 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:51.227408 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:51.227408 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:51.227408 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:51.227408 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:51.227408 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:19:51.227408 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:19:51.227408 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:19:51.228230 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:19:51.228230 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:51.228230 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:51.228230 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:51.228230 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:51.228230 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:51.228230 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:51.228230 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:51.228230 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:19:51.228230 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:51.228230 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:51.228230 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:51.228230 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:51.228230 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:51.228230 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:51.228230 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:51.228230 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:51.229076 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:19:51.229076 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:19:51.229076 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:51.229076 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:19:51.229076 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 9/19] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:19:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:19:51.234333 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed7a77c-e86d-4226-92a9-4d7011ab6af2 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:51.246180 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a88be76-3b8a-4717-8db2-8c7459319727 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:51.280242 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b29fe46-25c0-4a96-8eb1-2ef87043ea53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:51.280908 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b29fe46-25c0-4a96-8eb1-2ef87043ea53 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:51.281198 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b29fe46-25c0-4a96-8eb1-2ef87043ea53 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:51.281474 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b29fe46-25c0-4a96-8eb1-2ef87043ea53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:51.282302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b29fe46-25c0-4a96-8eb1-2ef87043ea53 None admin] RBAC: Adding query filter params (role.id=1a8e523ecbc84d818c2a9af0fb54da74, scope.domain.id=default, user.id=25194ab74edc4c009c8aaa9efa80932f) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:51.283226 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b29fe46-25c0-4a96-8eb1-2ef87043ea53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:51.284679 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b29fe46-25c0-4a96-8eb1-2ef87043ea53 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:51.291517 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 11/20] 10.222.0.16 () {56 vars in 1322 bytes} [Thu May 26 12:19:51 2022] GET /identity/v3/role_assignments?user.id=25194ab74edc4c009c8aaa9efa80932f&scope.domain.id=default&role.id=1a8e523ecbc84d818c2a9af0fb54da74 => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:19:51.292002 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:51.339263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed7a77c-e86d-4226-92a9-4d7011ab6af2 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:51.375943 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2913dd4-5880-4767-b48b-447414bf66b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:51.376653 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2913dd4-5880-4767-b48b-447414bf66b4 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:51.376965 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2913dd4-5880-4767-b48b-447414bf66b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:51.377243 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2913dd4-5880-4767-b48b-447414bf66b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:51.377982 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2913dd4-5880-4767-b48b-447414bf66b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:51.378292 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2913dd4-5880-4767-b48b-447414bf66b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:51.379710 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2913dd4-5880-4767-b48b-447414bf66b4 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:51.398901 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 10/21] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:19:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:19:53.857382 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc82949-aed5-4779-8ed6-72cb4bd5b205 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:53.858423 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc82949-aed5-4779-8ed6-72cb4bd5b205 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:53.858943 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc82949-aed5-4779-8ed6-72cb4bd5b205 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:53.860568 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 12/22] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:19:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:19:53.866644 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec039a92-b786-4056-9e71-3610ff70f219 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:53.867489 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec039a92-b786-4056-9e71-3610ff70f219 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:53.867983 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec039a92-b786-4056-9e71-3610ff70f219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:53.889904 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-ec039a92-b786-4056-9e71-3610ff70f219 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:53.891434 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-ec039a92-b786-4056-9e71-3610ff70f219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:53.967461 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 11/23] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:19:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:19:54.010501 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc82949-aed5-4779-8ed6-72cb4bd5b205 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:54.138194 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc82949-aed5-4779-8ed6-72cb4bd5b205 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:54.179431 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe02f8d-1974-430c-99a2-fcdac2f44485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:54.180658 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe02f8d-1974-430c-99a2-fcdac2f44485 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:54.181171 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe02f8d-1974-430c-99a2-fcdac2f44485 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:54.181709 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe02f8d-1974-430c-99a2-fcdac2f44485 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:54.192359 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe02f8d-1974-430c-99a2-fcdac2f44485 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:19:54.200380 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-abe02f8d-1974-430c-99a2-fcdac2f44485 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:19:54.200380 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:54.200380 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:54.200380 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:54.200380 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:54.200380 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:54.200380 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:54.200380 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:54.200380 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:54.200380 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:54.200380 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:54.200380 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:54.200380 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:19:54.200380 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:19:54.200380 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:19:54.200380 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:19:54.201222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:19:54.201222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:19:54.201222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:19:54.201222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:19:54.201222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:54.201222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:54.201222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:54.201222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:54.201222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:54.201222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:54.201222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:54.201222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:19:54.201222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:54.201222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:54.201222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:54.201222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:54.202007 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:54.202007 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:54.202007 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:54.202007 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:54.202007 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:19:54.202007 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:19:54.202007 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:19:54.202007 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:19:54.202007 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:19:54.202007 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:19:54.202007 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:19:54.202007 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:19:54.205917 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 13/24] 10.222.0.16 () {56 vars in 1096 bytes} [Thu May 26 12:19:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:54.212722 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972481c-396b-48ef-9394-d40d623ae0c4 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:54.213319 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972481c-396b-48ef-9394-d40d623ae0c4 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:54.213752 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe02f8d-1974-430c-99a2-fcdac2f44485 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:54.214015 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972481c-396b-48ef-9394-d40d623ae0c4 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:54.216165 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 12/25] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:19:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:19:54.221975 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d7a20-3377-4ce6-8688-793644e88194 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:54.222529 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d7a20-3377-4ce6-8688-793644e88194 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:54.223015 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d7a20-3377-4ce6-8688-793644e88194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:54.228364 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:54.254750 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-d44d7a20-3377-4ce6-8688-793644e88194 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:54.256454 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-d44d7a20-3377-4ce6-8688-793644e88194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:54.347666 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:54.383227 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe02f8d-1974-430c-99a2-fcdac2f44485 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:54.390823 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 13/26] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:19:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:19:54.397023 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd95c1b-228a-4b3d-8bc0-6b55c5290713 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:54.397550 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd95c1b-228a-4b3d-8bc0-6b55c5290713 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:54.398023 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd95c1b-228a-4b3d-8bc0-6b55c5290713 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:54.399953 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 14/27] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:19:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:19:54.405035 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17dab0-9436-47a3-9884-78eae301dadc None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:54.405542 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17dab0-9436-47a3-9884-78eae301dadc None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:54.406015 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17dab0-9436-47a3-9884-78eae301dadc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:54.433414 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-9a17dab0-9436-47a3-9884-78eae301dadc None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:54.436336 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-9a17dab0-9436-47a3-9884-78eae301dadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:54.452455 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22f6d10-b5c9-442a-b9f2-a25bdbe908b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:54.453542 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f6d10-b5c9-442a-b9f2-a25bdbe908b6 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:54.454059 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f6d10-b5c9-442a-b9f2-a25bdbe908b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:54.455056 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f6d10-b5c9-442a-b9f2-a25bdbe908b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:54.456023 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22f6d10-b5c9-442a-b9f2-a25bdbe908b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:54.456611 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22f6d10-b5c9-442a-b9f2-a25bdbe908b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:54.460330 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22f6d10-b5c9-442a-b9f2-a25bdbe908b6 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:54.477290 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 14/28] 10.222.0.16 () {56 vars in 1099 bytes} [Thu May 26 12:19:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:54.479049 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22f6d10-b5c9-442a-b9f2-a25bdbe908b6 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:54.553935 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 15/29] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:19:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:19:54.555302 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a17dab0-9436-47a3-9884-78eae301dadc None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:54.581557 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:54.620299 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22f6d10-b5c9-442a-b9f2-a25bdbe908b6 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:54.660386 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feb6ddd-4acf-405b-85ec-0069d0a2c89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:54.661129 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb6ddd-4acf-405b-85ec-0069d0a2c89f None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:54.661419 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb6ddd-4acf-405b-85ec-0069d0a2c89f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:54.661698 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb6ddd-4acf-405b-85ec-0069d0a2c89f None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:54.662477 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feb6ddd-4acf-405b-85ec-0069d0a2c89f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:54.663886 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feb6ddd-4acf-405b-85ec-0069d0a2c89f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:54.682762 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a17dab0-9436-47a3-9884-78eae301dadc None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:54.691677 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:54.727793 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887a0f08-8bd0-42ac-8f82-640a4664e001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:54.729057 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a0f08-8bd0-42ac-8f82-640a4664e001 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:54.729508 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a0f08-8bd0-42ac-8f82-640a4664e001 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:54.730015 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a0f08-8bd0-42ac-8f82-640a4664e001 None admin] PATH_INFO: `/v3/users/25194ab74edc4c009c8aaa9efa80932f` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:54.731727 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887a0f08-8bd0-42ac-8f82-640a4664e001 None admin] RBAC: Authorizing `identity:get_user(user_id=25194ab74edc4c009c8aaa9efa80932f)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:54.733526 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887a0f08-8bd0-42ac-8f82-640a4664e001 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:54.735541 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 16/30] 10.222.0.16 () {56 vars in 1177 bytes} [Thu May 26 12:19:54 2022] GET /identity/v3/users/25194ab74edc4c009c8aaa9efa80932f => generated 247 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:54.737050 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c214e-9305-41a8-8524-5527e1a026db None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:54.737546 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c214e-9305-41a8-8524-5527e1a026db None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:54.738006 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c214e-9305-41a8-8524-5527e1a026db None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:54.739437 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 17/31] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:19:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:19:54.740280 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c214e-9305-41a8-8524-5527e1a026db None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:54.809356 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 15/32] 10.222.0.16 () {60 vars in 1131 bytes} [Thu May 26 12:19:54 2022] POST /identity/v3/roles => generated 219 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:19:54.811585 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2778f0ca-8dab-443c-946d-3a2d20c2a97f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:54.812119 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2778f0ca-8dab-443c-946d-3a2d20c2a97f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:54.812593 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2778f0ca-8dab-443c-946d-3a2d20c2a97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:54.836752 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-2778f0ca-8dab-443c-946d-3a2d20c2a97f None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:54.838802 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2778f0ca-8dab-443c-946d-3a2d20c2a97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:54.866676 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c214e-9305-41a8-8524-5527e1a026db None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:54.950338 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729baaa9-fda9-40bc-99eb-a40d9c7cf092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:54.951378 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729baaa9-fda9-40bc-99eb-a40d9c7cf092 None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:54.951912 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729baaa9-fda9-40bc-99eb-a40d9c7cf092 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:54.952441 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729baaa9-fda9-40bc-99eb-a40d9c7cf092 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:54.953519 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729baaa9-fda9-40bc-99eb-a40d9c7cf092 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:54.955293 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729baaa9-fda9-40bc-99eb-a40d9c7cf092 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:54.959663 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 16/33] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:19:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:19:54.960744 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2778f0ca-8dab-443c-946d-3a2d20c2a97f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:55.057072 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:55.091337 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 18/34] 10.222.0.16 () {60 vars in 1131 bytes} [Thu May 26 12:19:54 2022] POST /identity/v3/roles => generated 225 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:19:55.092661 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729baaa9-fda9-40bc-99eb-a40d9c7cf092 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:55.148704 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2778f0ca-8dab-443c-946d-3a2d20c2a97f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:55.165783 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:55.209609 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c1a22e-a3b3-4300-977a-59bc0d9b1c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:55.210417 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1a22e-a3b3-4300-977a-59bc0d9b1c1c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:55.210665 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1a22e-a3b3-4300-977a-59bc0d9b1c1c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:55.210936 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1a22e-a3b3-4300-977a-59bc0d9b1c1c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:55.217791 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c1a22e-a3b3-4300-977a-59bc0d9b1c1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:55.219465 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c1a22e-a3b3-4300-977a-59bc0d9b1c1c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:55.221336 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 17/35] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:19:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:55.227351 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c1a22e-a3b3-4300-977a-59bc0d9b1c1c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:55.249697 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729baaa9-fda9-40bc-99eb-a40d9c7cf092 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:55.294909 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bcbfb3-49d5-461f-8127-2d4d4c56675b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:55.299914 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bcbfb3-49d5-461f-8127-2d4d4c56675b None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:55.301405 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bcbfb3-49d5-461f-8127-2d4d4c56675b None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:55.301889 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bcbfb3-49d5-461f-8127-2d4d4c56675b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:55.325846 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bcbfb3-49d5-461f-8127-2d4d4c56675b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:55.327847 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bcbfb3-49d5-461f-8127-2d4d4c56675b None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:55.368144 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-a1bcbfb3-49d5-461f-8127-2d4d4c56675b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:55.368144 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:55.368144 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:55.368144 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:55.368144 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:55.368144 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:55.368144 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:55.368144 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:55.368144 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:55.368144 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:55.368144 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:55.368144 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:55.368144 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:19:55.368144 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:19:55.368144 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:19:55.369056 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:19:55.369056 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:55.369056 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:55.369056 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:55.369056 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:55.369056 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:55.369056 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:55.369056 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:55.369056 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:19:55.369056 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:55.369056 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:55.369056 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:55.369056 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:55.369056 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:55.369056 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:55.369056 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:55.369056 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:55.369848 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:19:55.369848 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:19:55.369848 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:55.369848 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:19:55.377542 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 19/36] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:19:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:55.383078 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bcbfb3-49d5-461f-8127-2d4d4c56675b None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:55.410881 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c1a22e-a3b3-4300-977a-59bc0d9b1c1c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:55.457009 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:55.475099 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bec680c-5bff-45b6-9434-1a80c258c40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:55.476541 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec680c-5bff-45b6-9434-1a80c258c40c None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:55.480157 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec680c-5bff-45b6-9434-1a80c258c40c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:55.480157 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec680c-5bff-45b6-9434-1a80c258c40c None admin] PATH_INFO: `/v3/domains/default/users/25194ab74edc4c009c8aaa9efa80932f/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:55.481202 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bec680c-5bff-45b6-9434-1a80c258c40c None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=25194ab74edc4c009c8aaa9efa80932f, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:55.482986 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bec680c-5bff-45b6-9434-1a80c258c40c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:55.499801 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 18/37] 10.222.0.16 () {58 vars in 1361 bytes} [Thu May 26 12:19:55 2022] PUT /identity/v3/domains/default/users/25194ab74edc4c009c8aaa9efa80932f/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:19:55.503614 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe5557-5c47-4479-b713-0e0e18ff90a8 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:55.503912 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe5557-5c47-4479-b713-0e0e18ff90a8 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:55.504202 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe5557-5c47-4479-b713-0e0e18ff90a8 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:55.506548 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 19/38] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:19:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:19:55.512455 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154c2f8-340f-412e-a538-9bf984a37f36 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:55.512747 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154c2f8-340f-412e-a538-9bf984a37f36 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:55.513073 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154c2f8-340f-412e-a538-9bf984a37f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:55.525219 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:55.531539 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b154c2f8-340f-412e-a538-9bf984a37f36 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:55.533453 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b154c2f8-340f-412e-a538-9bf984a37f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:55.542825 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bcbfb3-49d5-461f-8127-2d4d4c56675b None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:55.602361 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0496e6e6-3c9d-43a2-80bc-40a604f6dd1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:55.603052 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496e6e6-3c9d-43a2-80bc-40a604f6dd1d None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:55.603342 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496e6e6-3c9d-43a2-80bc-40a604f6dd1d None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:55.603671 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496e6e6-3c9d-43a2-80bc-40a604f6dd1d None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:55.604533 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0496e6e6-3c9d-43a2-80bc-40a604f6dd1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:55.604741 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0496e6e6-3c9d-43a2-80bc-40a604f6dd1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:55.606319 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0496e6e6-3c9d-43a2-80bc-40a604f6dd1d None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:55.621319 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 20/39] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:19:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:55.628031 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0496e6e6-3c9d-43a2-80bc-40a604f6dd1d None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:55.629186 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 20/40] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:19:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:19:55.656247 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b154c2f8-340f-412e-a538-9bf984a37f36 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:55.759632 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0496e6e6-3c9d-43a2-80bc-40a604f6dd1d None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:55.786206 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b154c2f8-340f-412e-a538-9bf984a37f36 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:55.797446 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299d27b-8547-4c56-991d-545e3e27551f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:55.798713 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299d27b-8547-4c56-991d-545e3e27551f None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:55.799002 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299d27b-8547-4c56-991d-545e3e27551f None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:55.799281 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299d27b-8547-4c56-991d-545e3e27551f None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:55.799992 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f299d27b-8547-4c56-991d-545e3e27551f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:55.801466 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f299d27b-8547-4c56-991d-545e3e27551f None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:55.801662 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:55.823489 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:55.823874 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef84fc5-6e0b-4829-a9ac-589aca295a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:55.824558 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef84fc5-6e0b-4829-a9ac-589aca295a59 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:55.824867 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef84fc5-6e0b-4829-a9ac-589aca295a59 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:55.825189 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef84fc5-6e0b-4829-a9ac-589aca295a59 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:55.826079 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef84fc5-6e0b-4829-a9ac-589aca295a59 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:55.827642 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef84fc5-6e0b-4829-a9ac-589aca295a59 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:55.831842 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 21/41] 10.222.0.16 () {60 vars in 1141 bytes} [Thu May 26 12:19:55 2022] POST /identity/v3/projects => generated 301 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:19:55.833305 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117ca7d-87fe-4ad9-acb6-aa467fe0473a None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:55.833549 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117ca7d-87fe-4ad9-acb6-aa467fe0473a None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:55.833820 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117ca7d-87fe-4ad9-acb6-aa467fe0473a None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:55.836990 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 22/42] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:19:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:19:55.841515 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d93901-04fd-4556-aeed-0794c0b6ed0f None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:55.841804 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d93901-04fd-4556-aeed-0794c0b6ed0f None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:55.842087 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d93901-04fd-4556-aeed-0794c0b6ed0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:55.865010 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 21/43] 10.222.0.16 () {60 vars in 1131 bytes} [Thu May 26 12:19:55 2022] POST /identity/v3/roles => generated 223 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:19:55.866435 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-20d93901-04fd-4556-aeed-0794c0b6ed0f None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:55.868268 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-20d93901-04fd-4556-aeed-0794c0b6ed0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:55.951736 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 23/44] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:19:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:19:55.977448 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef84fc5-6e0b-4829-a9ac-589aca295a59 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:56.095006 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef84fc5-6e0b-4829-a9ac-589aca295a59 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:56.137034 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09723ca-411b-4b49-ab04-6d719d5600b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:56.138155 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09723ca-411b-4b49-ab04-6d719d5600b1 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:56.138632 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09723ca-411b-4b49-ab04-6d719d5600b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:56.138912 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09723ca-411b-4b49-ab04-6d719d5600b1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:56.140127 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09723ca-411b-4b49-ab04-6d719d5600b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:56.141764 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09723ca-411b-4b49-ab04-6d719d5600b1 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:56.143403 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 22/45] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:19:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:56.149162 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d93901-04fd-4556-aeed-0794c0b6ed0f None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:56.249594 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d93901-04fd-4556-aeed-0794c0b6ed0f None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:56.275221 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:56.283818 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25279bc-a13b-4d07-bb79-a256e165da28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:56.284480 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25279bc-a13b-4d07-bb79-a256e165da28 None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:56.284768 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25279bc-a13b-4d07-bb79-a256e165da28 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:56.285081 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25279bc-a13b-4d07-bb79-a256e165da28 None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:56.285804 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25279bc-a13b-4d07-bb79-a256e165da28 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:56.287254 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25279bc-a13b-4d07-bb79-a256e165da28 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:56.311995 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 24/46] 10.222.0.16 () {60 vars in 1141 bytes} [Thu May 26 12:19:56 2022] POST /identity/v3/projects => generated 312 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:19:57.764309 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a35591-1c04-4c4d-bf11-506e5abf4496 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:57.764758 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a35591-1c04-4c4d-bf11-506e5abf4496 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:57.764918 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a35591-1c04-4c4d-bf11-506e5abf4496 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:57.766305 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 23/47] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:19:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:19:57.772254 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005c5de-72c8-4d40-ade7-e3fae623b011 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:57.772649 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005c5de-72c8-4d40-ade7-e3fae623b011 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:57.772814 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005c5de-72c8-4d40-ade7-e3fae623b011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:57.789283 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-5005c5de-72c8-4d40-ade7-e3fae623b011 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:57.790457 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-5005c5de-72c8-4d40-ade7-e3fae623b011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:57.856417 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 25/48] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:19:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:19:57.879273 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a35591-1c04-4c4d-bf11-506e5abf4496 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:57.922540 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:57.981483 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a35591-1c04-4c4d-bf11-506e5abf4496 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:58.014562 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5170a9-a26d-472d-a7c7-7a694d364e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:58.015287 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5170a9-a26d-472d-a7c7-7a694d364e9d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:58.015575 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5170a9-a26d-472d-a7c7-7a694d364e9d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:58.015856 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5170a9-a26d-472d-a7c7-7a694d364e9d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:58.025787 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5170a9-a26d-472d-a7c7-7a694d364e9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:19:58.033453 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-ec5170a9-a26d-472d-a7c7-7a694d364e9d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:19:58.033453 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:58.033453 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:58.033453 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:58.033453 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:58.033453 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:58.033453 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:58.033453 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:58.033453 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:58.033453 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:58.033453 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:58.033453 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:58.033453 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:19:58.033453 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:19:58.033453 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:19:58.033453 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:19:58.034251 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:19:58.034251 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:19:58.034251 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:19:58.034251 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:19:58.034251 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:58.034251 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:58.034251 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:58.034251 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:58.034251 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:58.034251 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:58.034251 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:58.034251 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:19:58.034251 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:58.034251 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:58.034251 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:58.034251 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:58.035035 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:58.035035 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:58.035035 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:58.035035 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:58.035035 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:19:58.035035 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:19:58.035035 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:19:58.035035 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:19:58.035035 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:19:58.035035 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:19:58.035035 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:19:58.035035 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:19:58.035035 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 24/49] 10.222.0.16 () {56 vars in 1096 bytes} [Thu May 26 12:19:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:58.041493 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5005c5de-72c8-4d40-ade7-e3fae623b011 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:58.138306 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5005c5de-72c8-4d40-ade7-e3fae623b011 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:58.148670 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:58.172097 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bff99b-842e-4ef5-aaec-4ff754bc3ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:58.172768 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bff99b-842e-4ef5-aaec-4ff754bc3ba1 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:58.173593 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bff99b-842e-4ef5-aaec-4ff754bc3ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:58.173870 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bff99b-842e-4ef5-aaec-4ff754bc3ba1 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:58.174621 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bff99b-842e-4ef5-aaec-4ff754bc3ba1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:58.174929 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bff99b-842e-4ef5-aaec-4ff754bc3ba1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:58.176305 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bff99b-842e-4ef5-aaec-4ff754bc3ba1 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:58.187464 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 26/50] 10.222.0.16 () {56 vars in 1099 bytes} [Thu May 26 12:19:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:58.193633 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5170a9-a26d-472d-a7c7-7a694d364e9d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:58.289696 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5170a9-a26d-472d-a7c7-7a694d364e9d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:58.291092 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:58.325978 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a278d698-bd1f-4e59-8c64-945ae1fbe1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:58.326882 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278d698-bd1f-4e59-8c64-945ae1fbe1df None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:58.327168 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278d698-bd1f-4e59-8c64-945ae1fbe1df None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:58.327449 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278d698-bd1f-4e59-8c64-945ae1fbe1df None admin] PATH_INFO: `/v3/users/25194ab74edc4c009c8aaa9efa80932f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:58.328740 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a278d698-bd1f-4e59-8c64-945ae1fbe1df None admin] RBAC: Authorizing `identity:get_user(user_id=25194ab74edc4c009c8aaa9efa80932f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:58.330361 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a278d698-bd1f-4e59-8c64-945ae1fbe1df None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:58.332289 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 25/51] 10.222.0.16 () {56 vars in 1177 bytes} [Thu May 26 12:19:58 2022] GET /identity/v3/users/25194ab74edc4c009c8aaa9efa80932f => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:58.337944 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bff99b-842e-4ef5-aaec-4ff754bc3ba1 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:58.437385 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bff99b-842e-4ef5-aaec-4ff754bc3ba1 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:58.474156 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eded52-7e42-44da-86f4-9d3c8f98a478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:58.474952 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eded52-7e42-44da-86f4-9d3c8f98a478 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:58.475239 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eded52-7e42-44da-86f4-9d3c8f98a478 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:58.475519 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eded52-7e42-44da-86f4-9d3c8f98a478 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:58.476696 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eded52-7e42-44da-86f4-9d3c8f98a478 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:58.478193 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eded52-7e42-44da-86f4-9d3c8f98a478 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:58.479823 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 27/52] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:19:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:58.486145 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a278d698-bd1f-4e59-8c64-945ae1fbe1df None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:58.509212 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d58f108-7520-4ba6-9e7b-8c63523326e6 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:58.509500 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d58f108-7520-4ba6-9e7b-8c63523326e6 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:58.509783 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d58f108-7520-4ba6-9e7b-8c63523326e6 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:58.511128 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 28/53] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:19:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:19:58.516012 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de850c28-d6e9-4a3f-aab0-b729c3ff37cf None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:58.516301 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de850c28-d6e9-4a3f-aab0-b729c3ff37cf None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:58.516579 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de850c28-d6e9-4a3f-aab0-b729c3ff37cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:58.533640 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-de850c28-d6e9-4a3f-aab0-b729c3ff37cf None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:58.534838 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-de850c28-d6e9-4a3f-aab0-b729c3ff37cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:58.568724 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:58.586149 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a278d698-bd1f-4e59-8c64-945ae1fbe1df None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:58.602652 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 29/54] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:19:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:19:58.619026 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e475dd0a-95e4-44c1-9d8f-833b8d140dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:58.619676 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475dd0a-95e4-44c1-9d8f-833b8d140dad None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:58.619964 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475dd0a-95e4-44c1-9d8f-833b8d140dad None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:58.620242 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475dd0a-95e4-44c1-9d8f-833b8d140dad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:58.621111 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e475dd0a-95e4-44c1-9d8f-833b8d140dad None admin] RBAC: Adding query filter params (role.id=1a8e523ecbc84d818c2a9af0fb54da74, scope.domain.id=default, user.id=25194ab74edc4c009c8aaa9efa80932f) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:58.621429 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e475dd0a-95e4-44c1-9d8f-833b8d140dad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:58.622865 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e475dd0a-95e4-44c1-9d8f-833b8d140dad None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:58.625202 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de850c28-d6e9-4a3f-aab0-b729c3ff37cf None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:58.629300 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 26/55] 10.222.0.16 () {56 vars in 1322 bytes} [Thu May 26 12:19:58 2022] GET /identity/v3/role_assignments?user.id=25194ab74edc4c009c8aaa9efa80932f&scope.domain.id=default&role.id=1a8e523ecbc84d818c2a9af0fb54da74 => generated 530 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:58.730149 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de850c28-d6e9-4a3f-aab0-b729c3ff37cf None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:58.767921 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f91189e-4697-449c-9d0c-5505f5481ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:58.768757 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91189e-4697-449c-9d0c-5505f5481ef5 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:58.769076 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91189e-4697-449c-9d0c-5505f5481ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:58.769380 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91189e-4697-449c-9d0c-5505f5481ef5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:58.770566 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f91189e-4697-449c-9d0c-5505f5481ef5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:58.772024 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f91189e-4697-449c-9d0c-5505f5481ef5 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:58.773731 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 30/56] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:19:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:19:58.779633 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e475dd0a-95e4-44c1-9d8f-833b8d140dad None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:58.816722 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:58.883118 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e475dd0a-95e4-44c1-9d8f-833b8d140dad None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:58.916028 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40caa7c-a961-4cc6-87b5-d3b2e16b2329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:58.916679 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40caa7c-a961-4cc6-87b5-d3b2e16b2329 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:58.917005 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40caa7c-a961-4cc6-87b5-d3b2e16b2329 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:58.917288 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40caa7c-a961-4cc6-87b5-d3b2e16b2329 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:58.918004 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40caa7c-a961-4cc6-87b5-d3b2e16b2329 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:58.919458 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40caa7c-a961-4cc6-87b5-d3b2e16b2329 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:58.944818 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 27/57] 10.222.0.16 () {60 vars in 1140 bytes} [Thu May 26 12:19:58 2022] POST /identity/v3/projects => generated 298 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:20:01.134840 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b7a92-268d-4508-a06d-dea80fe6dbdb None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:01.135331 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b7a92-268d-4508-a06d-dea80fe6dbdb None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:01.135331 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b7a92-268d-4508-a06d-dea80fe6dbdb None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:01.136677 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 31/58] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:20:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:01.142405 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59574159-6250-4a9c-9021-a0af229946ef None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:01.142795 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59574159-6250-4a9c-9021-a0af229946ef None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:01.142976 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59574159-6250-4a9c-9021-a0af229946ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:01.159876 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-59574159-6250-4a9c-9021-a0af229946ef None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:01.161091 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-59574159-6250-4a9c-9021-a0af229946ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:01.225218 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 28/59] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:20:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:20:01.248597 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b7a92-268d-4508-a06d-dea80fe6dbdb None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:01.288683 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:01.347318 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b7a92-268d-4508-a06d-dea80fe6dbdb None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:01.379743 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954eb51-edee-4a67-857c-26d196c9ef8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:01.380525 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954eb51-edee-4a67-857c-26d196c9ef8d None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:01.380807 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954eb51-edee-4a67-857c-26d196c9ef8d None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:01.381104 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954eb51-edee-4a67-857c-26d196c9ef8d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:01.382251 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8954eb51-edee-4a67-857c-26d196c9ef8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:01.383674 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8954eb51-edee-4a67-857c-26d196c9ef8d None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:01.385426 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 32/60] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:20:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:01.390684 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59574159-6250-4a9c-9021-a0af229946ef None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:01.407966 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:01.487121 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59574159-6250-4a9c-9021-a0af229946ef None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:01.519700 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3a4a5-fb86-4409-a039-585b5ded251e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:01.520354 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3a4a5-fb86-4409-a039-585b5ded251e None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:01.520638 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3a4a5-fb86-4409-a039-585b5ded251e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:01.520940 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3a4a5-fb86-4409-a039-585b5ded251e None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:01.521637 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f3a4a5-fb86-4409-a039-585b5ded251e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:01.523087 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f3a4a5-fb86-4409-a039-585b5ded251e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:01.547423 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 29/61] 10.222.0.16 () {60 vars in 1132 bytes} [Thu May 26 12:20:01 2022] POST /identity/v3/users => generated 275 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:20:04.963050 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8e5e5-273f-42bf-a548-5eedba2ceffa None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:04.964135 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8e5e5-273f-42bf-a548-5eedba2ceffa None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:04.964670 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8e5e5-273f-42bf-a548-5eedba2ceffa None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:04.966604 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 33/62] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:20:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:04.972645 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed05d9-823e-4e90-bb2f-9039bfe09ca6 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:04.973626 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed05d9-823e-4e90-bb2f-9039bfe09ca6 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:04.974176 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed05d9-823e-4e90-bb2f-9039bfe09ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:04.997408 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-26ed05d9-823e-4e90-bb2f-9039bfe09ca6 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:04.998988 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-26ed05d9-823e-4e90-bb2f-9039bfe09ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:05.059596 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28595363-1936-492c-9e52-3d623478e158 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:05.060198 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28595363-1936-492c-9e52-3d623478e158 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:05.060678 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28595363-1936-492c-9e52-3d623478e158 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:05.062400 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 34/63] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:20:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:20:05.075030 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca45248-fe22-4256-a4eb-16180bbf92cc None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:05.075658 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca45248-fe22-4256-a4eb-16180bbf92cc None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:05.076254 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca45248-fe22-4256-a4eb-16180bbf92cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:05.099602 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 30/64] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:20:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:20:05.108959 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-eca45248-fe22-4256-a4eb-16180bbf92cc None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:05.111109 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-eca45248-fe22-4256-a4eb-16180bbf92cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:05.123040 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed05d9-823e-4e90-bb2f-9039bfe09ca6 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:05.125564 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:05.211352 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 35/65] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:20:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:20:05.213097 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994a66e-0028-41fd-a50d-85211a74216c None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:05.213598 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994a66e-0028-41fd-a50d-85211a74216c None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:05.214076 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994a66e-0028-41fd-a50d-85211a74216c None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:05.216284 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 36/66] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:20:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:05.226433 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672a4a3-d65e-45bc-ac86-de7287783d36 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:05.226725 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672a4a3-d65e-45bc-ac86-de7287783d36 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:05.227170 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672a4a3-d65e-45bc-ac86-de7287783d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:05.246398 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-b672a4a3-d65e-45bc-ac86-de7287783d36 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:05.247796 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-b672a4a3-d65e-45bc-ac86-de7287783d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:05.252367 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed05d9-823e-4e90-bb2f-9039bfe09ca6 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:05.280244 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:05.293379 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ea657-3397-4c34-b387-0f5df1f730ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:05.294184 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ea657-3397-4c34-b387-0f5df1f730ba None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:05.294466 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ea657-3397-4c34-b387-0f5df1f730ba None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:05.294740 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ea657-3397-4c34-b387-0f5df1f730ba None admin] PATH_INFO: `/v3/roles/member` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:05.305640 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32ea657-3397-4c34-b387-0f5df1f730ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:20:05.314645 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-c32ea657-3397-4c34-b387-0f5df1f730ba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:20:05.314645 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:05.314645 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:05.314645 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:05.314645 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:05.314645 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:05.314645 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:05.314645 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:05.314645 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:05.314645 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:05.314645 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:05.314645 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:05.314645 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:20:05.314645 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:20:05.314645 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:20:05.314645 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:20:05.315549 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:20:05.315549 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:20:05.315549 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:20:05.315549 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:20:05.315549 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:05.315549 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:05.315549 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:05.315549 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:05.315549 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:05.315549 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:05.315549 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:05.315549 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:20:05.315549 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:05.315549 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:05.315549 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:05.315549 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:05.316315 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:05.316315 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:05.316315 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:05.316315 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:05.316315 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:20:05.316315 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:20:05.316315 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:20:05.316315 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:20:05.316315 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:20:05.316315 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:20:05.316315 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:20:05.316315 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:20:05.319002 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 31/67] 10.222.0.16 () {56 vars in 1099 bytes} [Thu May 26 12:20:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:20:05.320119 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ea657-3397-4c34-b387-0f5df1f730ba None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:05.331426 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 37/68] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:20:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:20:05.338176 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b672a4a3-d65e-45bc-ac86-de7287783d36 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:05.394529 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:05.437942 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ea657-3397-4c34-b387-0f5df1f730ba None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:05.474866 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d9ebd-7ea1-4e14-b800-ead0c9a0adef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:05.475663 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d9ebd-7ea1-4e14-b800-ead0c9a0adef None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:05.475948 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d9ebd-7ea1-4e14-b800-ead0c9a0adef None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:05.476226 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d9ebd-7ea1-4e14-b800-ead0c9a0adef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:05.478224 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b672a4a3-d65e-45bc-ac86-de7287783d36 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:05.487465 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941d9ebd-7ea1-4e14-b800-ead0c9a0adef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:20:05.494987 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-941d9ebd-7ea1-4e14-b800-ead0c9a0adef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:20:05.494987 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:05.494987 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:05.494987 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:05.494987 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:05.494987 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:05.494987 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:05.494987 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:05.494987 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:05.494987 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:05.494987 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:05.494987 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:05.494987 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:20:05.494987 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:20:05.494987 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:20:05.494987 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:20:05.496010 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:20:05.496010 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:20:05.496010 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:20:05.496010 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:20:05.496010 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:05.496010 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:05.496010 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:05.496010 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:05.496010 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:05.496010 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:05.496010 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:05.496010 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:20:05.496010 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:05.496010 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:05.496010 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:05.496010 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:05.497066 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:05.497066 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:05.497066 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:05.497066 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:05.497066 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:20:05.497066 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:20:05.497066 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:20:05.497066 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:20:05.497066 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:20:05.497066 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:20:05.497066 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:20:05.497066 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:20:05.497066 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 32/69] 10.222.0.16 () {56 vars in 1096 bytes} [Thu May 26 12:20:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:20:05.502252 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d9ebd-7ea1-4e14-b800-ead0c9a0adef None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:05.518694 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d23f3-c288-4407-af1b-e8af5d4baf3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:05.519646 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d23f3-c288-4407-af1b-e8af5d4baf3a None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:05.519935 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d23f3-c288-4407-af1b-e8af5d4baf3a None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:05.520217 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d23f3-c288-4407-af1b-e8af5d4baf3a None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:05.521022 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51d23f3-c288-4407-af1b-e8af5d4baf3a None admin] RBAC: Adding query filter params (name=member) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:05.521336 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51d23f3-c288-4407-af1b-e8af5d4baf3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:05.522724 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51d23f3-c288-4407-af1b-e8af5d4baf3a None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:05.530952 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 38/70] 10.222.0.16 () {56 vars in 1101 bytes} [Thu May 26 12:20:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:05.532338 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97bda3-25f4-4e18-a558-1850e9b2eb96 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:05.532629 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97bda3-25f4-4e18-a558-1850e9b2eb96 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:05.532941 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97bda3-25f4-4e18-a558-1850e9b2eb96 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:05.534183 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 39/71] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:20:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:05.534881 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f97bda3-25f4-4e18-a558-1850e9b2eb96 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:05.564040 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:05.604265 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d9ebd-7ea1-4e14-b800-ead0c9a0adef None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:05.627267 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:05.636781 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f97bda3-25f4-4e18-a558-1850e9b2eb96 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:05.639614 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81798d9-41b6-4256-8fc2-7e4b0af3d3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:05.640424 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81798d9-41b6-4256-8fc2-7e4b0af3d3cd None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:05.640713 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81798d9-41b6-4256-8fc2-7e4b0af3d3cd None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:05.641022 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81798d9-41b6-4256-8fc2-7e4b0af3d3cd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:05.651179 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81798d9-41b6-4256-8fc2-7e4b0af3d3cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:20:05.659147 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-d81798d9-41b6-4256-8fc2-7e4b0af3d3cd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:20:05.659147 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:05.659147 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:05.659147 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:05.659147 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:05.659147 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:05.659147 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:05.659147 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:05.659147 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:05.659147 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:05.659147 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:05.659147 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:05.659147 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:20:05.659147 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:20:05.659147 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:20:05.659147 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:20:05.660000 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:20:05.660000 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:20:05.660000 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:20:05.660000 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:20:05.660000 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:05.660000 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:05.660000 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:05.660000 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:05.660000 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:05.660000 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:05.660000 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:05.660000 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:20:05.660000 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:05.660000 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:05.660000 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:05.660000 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:05.660779 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:05.660779 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:05.660779 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:05.660779 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:05.660779 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:20:05.660779 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:20:05.660779 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:20:05.660779 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:20:05.660779 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:20:05.660779 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:20:05.660779 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:20:05.660779 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:20:05.660779 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 33/72] 10.222.0.16 () {56 vars in 1114 bytes} [Thu May 26 12:20:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:20:05.661692 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84290e-551e-4ec1-ac8e-0e54d302487b None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:05.661843 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84290e-551e-4ec1-ac8e-0e54d302487b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:05.662109 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84290e-551e-4ec1-ac8e-0e54d302487b None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:05.663353 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 34/73] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:20:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:05.664455 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b84290e-551e-4ec1-ac8e-0e54d302487b None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:05.674531 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f54232-cc77-408b-85a6-6eea7ef8dfed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:05.675293 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f54232-cc77-408b-85a6-6eea7ef8dfed None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:05.675678 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f54232-cc77-408b-85a6-6eea7ef8dfed None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:05.675966 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f54232-cc77-408b-85a6-6eea7ef8dfed None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:05.676722 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f54232-cc77-408b-85a6-6eea7ef8dfed None admin] RBAC: Adding query filter params (name=admin) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:05.677075 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f54232-cc77-408b-85a6-6eea7ef8dfed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:05.678449 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f54232-cc77-408b-85a6-6eea7ef8dfed None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:05.687164 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 40/74] 10.222.0.16 () {56 vars in 1099 bytes} [Thu May 26 12:20:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:05.688491 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0787c55-ad29-4c7f-98b2-5826d8367dd0 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:05.689312 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0787c55-ad29-4c7f-98b2-5826d8367dd0 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:05.689589 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0787c55-ad29-4c7f-98b2-5826d8367dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:05.705139 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-b0787c55-ad29-4c7f-98b2-5826d8367dd0 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:05.706330 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-b0787c55-ad29-4c7f-98b2-5826d8367dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:05.768469 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b84290e-551e-4ec1-ac8e-0e54d302487b None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:05.772714 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 41/75] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:20:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:20:05.773592 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0787c55-ad29-4c7f-98b2-5826d8367dd0 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:05.795303 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:05.802147 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bc65bb-d9dd-45f2-8e27-2a63dc73911d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:05.803027 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc65bb-d9dd-45f2-8e27-2a63dc73911d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:05.803312 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc65bb-d9dd-45f2-8e27-2a63dc73911d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:05.803590 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc65bb-d9dd-45f2-8e27-2a63dc73911d None admin] PATH_INFO: `/v3/users/4069b216ae0743869ac1161864e0b3ff` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:05.817369 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bc65bb-d9dd-45f2-8e27-2a63dc73911d None admin] RBAC: Authorizing `identity:get_user(user_id=4069b216ae0743869ac1161864e0b3ff)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:05.818857 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bc65bb-d9dd-45f2-8e27-2a63dc73911d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:05.820506 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 35/76] 10.222.0.16 () {56 vars in 1177 bytes} [Thu May 26 12:20:05 2022] GET /identity/v3/users/4069b216ae0743869ac1161864e0b3ff => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:05.821800 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04eff97-36a9-4b1e-a980-23c0db5bc95b None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:05.822090 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04eff97-36a9-4b1e-a980-23c0db5bc95b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:05.822370 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04eff97-36a9-4b1e-a980-23c0db5bc95b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:05.838792 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a04eff97-36a9-4b1e-a980-23c0db5bc95b None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:05.839996 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a04eff97-36a9-4b1e-a980-23c0db5bc95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:05.874124 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:05.877856 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0787c55-ad29-4c7f-98b2-5826d8367dd0 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:05.907938 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 36/77] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:20:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:20:05.908757 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04eff97-36a9-4b1e-a980-23c0db5bc95b None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:05.911560 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23756129-3c1e-4419-8886-698afcb81fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:05.912228 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23756129-3c1e-4419-8886-698afcb81fb8 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:05.912517 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23756129-3c1e-4419-8886-698afcb81fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:05.912795 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23756129-3c1e-4419-8886-698afcb81fb8 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:05.913578 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23756129-3c1e-4419-8886-698afcb81fb8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:05.913887 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23756129-3c1e-4419-8886-698afcb81fb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:05.915258 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23756129-3c1e-4419-8886-698afcb81fb8 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:05.923898 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 42/78] 10.222.0.16 () {56 vars in 1111 bytes} [Thu May 26 12:20:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:05.924506 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23756129-3c1e-4419-8886-698afcb81fb8 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:06.005976 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:06.019166 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04eff97-36a9-4b1e-a980-23c0db5bc95b None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:06.025987 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23756129-3c1e-4419-8886-698afcb81fb8 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:06.052511 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e4fc1-680b-4a37-9b5c-1a84e432ca77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:06.053421 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e4fc1-680b-4a37-9b5c-1a84e432ca77 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:06.053705 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e4fc1-680b-4a37-9b5c-1a84e432ca77 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:06.053979 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e4fc1-680b-4a37-9b5c-1a84e432ca77 None admin] PATH_INFO: `/v3/users/25194ab74edc4c009c8aaa9efa80932f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:06.055180 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e4fc1-680b-4a37-9b5c-1a84e432ca77 None admin] RBAC: Authorizing `identity:get_user(user_id=25194ab74edc4c009c8aaa9efa80932f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:06.056637 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e4fc1-680b-4a37-9b5c-1a84e432ca77 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:06.058274 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 37/79] 10.222.0.16 () {56 vars in 1177 bytes} [Thu May 26 12:20:05 2022] GET /identity/v3/users/25194ab74edc4c009c8aaa9efa80932f => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:06.058766 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7423e29-3760-4251-be5f-c4b45a2506ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:06.059035 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e4fc1-680b-4a37-9b5c-1a84e432ca77 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:06.059643 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7423e29-3760-4251-be5f-c4b45a2506ea None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:06.059935 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7423e29-3760-4251-be5f-c4b45a2506ea None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:06.060216 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7423e29-3760-4251-be5f-c4b45a2506ea None admin] PATH_INFO: `/v3/roles/member` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:06.072536 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7423e29-3760-4251-be5f-c4b45a2506ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:20:06.082193 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-c7423e29-3760-4251-be5f-c4b45a2506ea None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:20:06.082193 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:06.082193 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:06.082193 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:06.082193 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:06.082193 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:06.082193 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:06.082193 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:06.082193 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:06.082193 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:06.082193 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:06.082193 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:06.082193 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:20:06.082193 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:20:06.082193 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:20:06.082193 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:20:06.083048 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:20:06.083048 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:20:06.083048 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:20:06.083048 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:20:06.083048 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:06.083048 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:06.083048 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:06.083048 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:06.083048 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:06.083048 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:06.083048 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:06.083048 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:20:06.083048 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:06.083048 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:06.083048 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:06.083048 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:06.083796 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:06.083796 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:06.083796 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:06.083796 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:06.083796 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:20:06.083796 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:20:06.083796 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:20:06.083796 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:20:06.083796 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:20:06.083796 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:20:06.083796 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:20:06.083796 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:20:06.083796 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 43/80] 10.222.0.16 () {56 vars in 1099 bytes} [Thu May 26 12:20:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:20:06.084421 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7423e29-3760-4251-be5f-c4b45a2506ea None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:06.106417 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:06.168042 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e4fc1-680b-4a37-9b5c-1a84e432ca77 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:06.199163 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7423e29-3760-4251-be5f-c4b45a2506ea None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:06.202287 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e864ff1-122d-4bbb-ab30-0a91b257f6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:06.202942 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e864ff1-122d-4bbb-ab30-0a91b257f6f8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:06.203232 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e864ff1-122d-4bbb-ab30-0a91b257f6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:06.203515 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e864ff1-122d-4bbb-ab30-0a91b257f6f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:06.236101 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c196bf0-d9eb-49a4-b034-3014af1e5a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:06.237118 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c196bf0-d9eb-49a4-b034-3014af1e5a73 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:06.237518 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c196bf0-d9eb-49a4-b034-3014af1e5a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:06.237808 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c196bf0-d9eb-49a4-b034-3014af1e5a73 None admin] PATH_INFO: `/v3/users/4069b216ae0743869ac1161864e0b3ff` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:06.239059 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c196bf0-d9eb-49a4-b034-3014af1e5a73 None admin] RBAC: Authorizing `identity:get_user(user_id=4069b216ae0743869ac1161864e0b3ff)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:06.240509 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c196bf0-d9eb-49a4-b034-3014af1e5a73 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:06.242197 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 44/81] 10.222.0.16 () {56 vars in 1177 bytes} [Thu May 26 12:20:06 2022] GET /identity/v3/users/4069b216ae0743869ac1161864e0b3ff => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:06.242965 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c196bf0-d9eb-49a4-b034-3014af1e5a73 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:06.255964 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:06.277179 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e864ff1-122d-4bbb-ab30-0a91b257f6f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:06.278666 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e864ff1-122d-4bbb-ab30-0a91b257f6f8 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:06.318073 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:06.344796 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c196bf0-d9eb-49a4-b034-3014af1e5a73 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:06.379195 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac044d83-0463-4cb6-bbc3-95579f28d6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:06.379990 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac044d83-0463-4cb6-bbc3-95579f28d6d9 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:06.380282 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac044d83-0463-4cb6-bbc3-95579f28d6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:06.380562 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac044d83-0463-4cb6-bbc3-95579f28d6d9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:06.381779 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac044d83-0463-4cb6-bbc3-95579f28d6d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:06.382286 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 38/82] 10.222.0.16 () {58 vars in 1282 bytes} [Thu May 26 12:20:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:20:06.383221 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e864ff1-122d-4bbb-ab30-0a91b257f6f8 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:06.387773 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac044d83-0463-4cb6-bbc3-95579f28d6d9 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:06.389658 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 45/83] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:20:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:06.390270 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac044d83-0463-4cb6-bbc3-95579f28d6d9 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:06.470375 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:06.488289 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e864ff1-122d-4bbb-ab30-0a91b257f6f8 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:06.492609 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac044d83-0463-4cb6-bbc3-95579f28d6d9 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:06.525778 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d3c9b0-ba1d-4038-8035-9f69f232d290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:06.526435 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3c9b0-ba1d-4038-8035-9f69f232d290 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:06.526722 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3c9b0-ba1d-4038-8035-9f69f232d290 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:06.526997 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3c9b0-ba1d-4038-8035-9f69f232d290 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:06.527743 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d3c9b0-ba1d-4038-8035-9f69f232d290 None admin] RBAC: Adding query filter params (name=member) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:06.528050 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d3c9b0-ba1d-4038-8035-9f69f232d290 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:06.529455 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d3c9b0-ba1d-4038-8035-9f69f232d290 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:06.529693 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ed7ea-fdf2-4fe1-95bc-d684d85150ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:06.530341 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ed7ea-fdf2-4fe1-95bc-d684d85150ef None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:06.530630 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ed7ea-fdf2-4fe1-95bc-d684d85150ef None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:06.530907 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ed7ea-fdf2-4fe1-95bc-d684d85150ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:06.538334 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 46/84] 10.222.0.16 () {56 vars in 1101 bytes} [Thu May 26 12:20:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:06.539955 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:06.540687 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d3c9b0-ba1d-4038-8035-9f69f232d290 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:06.603815 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401ed7ea-fdf2-4fe1-95bc-d684d85150ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:06.605357 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401ed7ea-fdf2-4fe1-95bc-d684d85150ef None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:06.642940 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d3c9b0-ba1d-4038-8035-9f69f232d290 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:06.677102 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008fca3a-b854-43f7-8773-8cd063024c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:06.677785 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fca3a-b854-43f7-8773-8cd063024c29 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:06.678075 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fca3a-b854-43f7-8773-8cd063024c29 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:06.678355 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fca3a-b854-43f7-8773-8cd063024c29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:06.689738 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:06.703197 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 39/85] 10.222.0.16 () {58 vars in 1282 bytes} [Thu May 26 12:20:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:20:06.704061 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ed7ea-fdf2-4fe1-95bc-d684d85150ef None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:06.744100 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:06.757229 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008fca3a-b854-43f7-8773-8cd063024c29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:06.758710 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008fca3a-b854-43f7-8773-8cd063024c29 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:06.812212 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ed7ea-fdf2-4fe1-95bc-d684d85150ef None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:06.848007 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd2ffd0-ee31-40ab-9b14-7c6212c45ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:06.848893 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd2ffd0-ee31-40ab-9b14-7c6212c45ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:06.849178 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd2ffd0-ee31-40ab-9b14-7c6212c45ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:06.849458 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd2ffd0-ee31-40ab-9b14-7c6212c45ca5 None admin] PATH_INFO: `/v3/projects/6ae47773ffcf4aad9f7fb9bf16e40752` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:06.850646 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd2ffd0-ee31-40ab-9b14-7c6212c45ca5 None admin] RBAC: Authorizing `identity:get_project(project_id=6ae47773ffcf4aad9f7fb9bf16e40752)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:06.852122 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd2ffd0-ee31-40ab-9b14-7c6212c45ca5 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:06.853832 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 40/86] 10.222.0.16 () {56 vars in 1186 bytes} [Thu May 26 12:20:06 2022] GET /identity/v3/projects/6ae47773ffcf4aad9f7fb9bf16e40752 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:06.857063 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 47/87] 10.222.0.16 () {58 vars in 1282 bytes} [Thu May 26 12:20:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:20:06.857908 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008fca3a-b854-43f7-8773-8cd063024c29 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:06.859477 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd2ffd0-ee31-40ab-9b14-7c6212c45ca5 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:06.898926 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:06.959185 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd2ffd0-ee31-40ab-9b14-7c6212c45ca5 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:06.959618 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008fca3a-b854-43f7-8773-8cd063024c29 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:06.966662 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:06.994294 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c018db-643e-4800-b0c4-c337bd906dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:06.994606 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f19040-3ef9-46c6-889f-7fdae0cadfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:06.995277 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f19040-3ef9-46c6-889f-7fdae0cadfa4 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:06.995457 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c018db-643e-4800-b0c4-c337bd906dd4 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:06.995568 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f19040-3ef9-46c6-889f-7fdae0cadfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:06.995743 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c018db-643e-4800-b0c4-c337bd906dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:06.995843 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f19040-3ef9-46c6-889f-7fdae0cadfa4 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:06.996023 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c018db-643e-4800-b0c4-c337bd906dd4 None admin] PATH_INFO: `/v3/users/4069b216ae0743869ac1161864e0b3ff` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:06.996579 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f19040-3ef9-46c6-889f-7fdae0cadfa4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:06.997258 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c018db-643e-4800-b0c4-c337bd906dd4 None admin] RBAC: Authorizing `identity:get_user(user_id=4069b216ae0743869ac1161864e0b3ff)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:06.998094 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f19040-3ef9-46c6-889f-7fdae0cadfa4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:06.998734 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c018db-643e-4800-b0c4-c337bd906dd4 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:07.000355 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 48/88] 10.222.0.16 () {56 vars in 1177 bytes} [Thu May 26 12:20:06 2022] GET /identity/v3/users/4069b216ae0743869ac1161864e0b3ff => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:07.001735 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c018db-643e-4800-b0c4-c337bd906dd4 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:07.020141 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 41/89] 10.222.0.16 () {60 vars in 1132 bytes} [Thu May 26 12:20:06 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:20:07.020811 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f19040-3ef9-46c6-889f-7fdae0cadfa4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:07.144579 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c018db-643e-4800-b0c4-c337bd906dd4 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:07.159292 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:07.171778 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f19040-3ef9-46c6-889f-7fdae0cadfa4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:07.189456 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69331dbf-1688-450f-bb44-36af7f5dd5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:07.190337 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69331dbf-1688-450f-bb44-36af7f5dd5b2 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:07.190621 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69331dbf-1688-450f-bb44-36af7f5dd5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:07.190897 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69331dbf-1688-450f-bb44-36af7f5dd5b2 None admin] PATH_INFO: `/v3/projects/6ae47773ffcf4aad9f7fb9bf16e40752` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:07.192162 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69331dbf-1688-450f-bb44-36af7f5dd5b2 None admin] RBAC: Authorizing `identity:get_project(project_id=6ae47773ffcf4aad9f7fb9bf16e40752)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:07.193661 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69331dbf-1688-450f-bb44-36af7f5dd5b2 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:07.195532 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 49/90] 10.222.0.16 () {56 vars in 1186 bytes} [Thu May 26 12:20:07 2022] GET /identity/v3/projects/6ae47773ffcf4aad9f7fb9bf16e40752 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:07.196204 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69331dbf-1688-450f-bb44-36af7f5dd5b2 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:07.217695 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49202e1-e316-4a7d-8d30-08a19347679d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:07.218366 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49202e1-e316-4a7d-8d30-08a19347679d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:07.218661 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49202e1-e316-4a7d-8d30-08a19347679d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:07.218941 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49202e1-e316-4a7d-8d30-08a19347679d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:07.219786 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49202e1-e316-4a7d-8d30-08a19347679d None admin] RBAC: Adding query filter params (role.id=b0bf2a578f0a4319b93dd3b8a26a96b7, scope.project.id=6ae47773ffcf4aad9f7fb9bf16e40752, user.id=4069b216ae0743869ac1161864e0b3ff) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:07.220101 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49202e1-e316-4a7d-8d30-08a19347679d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:07.221611 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49202e1-e316-4a7d-8d30-08a19347679d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:07.228082 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 42/91] 10.222.0.16 () {56 vars in 1374 bytes} [Thu May 26 12:20:07 2022] GET /identity/v3/role_assignments?user.id=4069b216ae0743869ac1161864e0b3ff&scope.project.id=6ae47773ffcf4aad9f7fb9bf16e40752&role.id=b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:07.229068 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49202e1-e316-4a7d-8d30-08a19347679d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:07.272402 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:07.365376 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69331dbf-1688-450f-bb44-36af7f5dd5b2 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:07.388110 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49202e1-e316-4a7d-8d30-08a19347679d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:07.416570 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc6513a-d467-4b8a-8ab4-66715104f39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:07.418032 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6513a-d467-4b8a-8ab4-66715104f39a None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:07.418560 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6513a-d467-4b8a-8ab4-66715104f39a None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:07.418976 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6513a-d467-4b8a-8ab4-66715104f39a None admin] PATH_INFO: `/v3/projects/6ae47773ffcf4aad9f7fb9bf16e40752` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:07.421173 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc6513a-d467-4b8a-8ab4-66715104f39a None admin] RBAC: Authorizing `identity:get_project(project_id=6ae47773ffcf4aad9f7fb9bf16e40752)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:07.424169 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc6513a-d467-4b8a-8ab4-66715104f39a None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:07.427984 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 50/92] 10.222.0.16 () {56 vars in 1186 bytes} [Thu May 26 12:20:07 2022] GET /identity/v3/projects/6ae47773ffcf4aad9f7fb9bf16e40752 => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:07.428612 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc6513a-d467-4b8a-8ab4-66715104f39a None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:07.439546 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9ff9e-b9e4-4570-95a8-d780803955a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:07.442124 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9ff9e-b9e4-4570-95a8-d780803955a6 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:07.442124 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9ff9e-b9e4-4570-95a8-d780803955a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:07.442124 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9ff9e-b9e4-4570-95a8-d780803955a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:07.492502 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:07.536497 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f9ff9e-b9e4-4570-95a8-d780803955a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:07.538379 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f9ff9e-b9e4-4570-95a8-d780803955a6 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:07.562650 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc6513a-d467-4b8a-8ab4-66715104f39a None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:07.573317 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:07.627697 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5eafc4-d38c-4a84-a9f2-10be18bdea60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:07.628723 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5eafc4-d38c-4a84-a9f2-10be18bdea60 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:07.629221 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5eafc4-d38c-4a84-a9f2-10be18bdea60 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:07.629689 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5eafc4-d38c-4a84-a9f2-10be18bdea60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:07.630851 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5eafc4-d38c-4a84-a9f2-10be18bdea60 None admin] RBAC: Adding query filter params (role.id=1a8e523ecbc84d818c2a9af0fb54da74, scope.project.id=6ae47773ffcf4aad9f7fb9bf16e40752, user.id=25194ab74edc4c009c8aaa9efa80932f) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:07.631434 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5eafc4-d38c-4a84-a9f2-10be18bdea60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:07.633129 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5eafc4-d38c-4a84-a9f2-10be18bdea60 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:07.649761 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 51/93] 10.222.0.16 () {56 vars in 1374 bytes} [Thu May 26 12:20:07 2022] GET /identity/v3/role_assignments?user.id=25194ab74edc4c009c8aaa9efa80932f&scope.project.id=6ae47773ffcf4aad9f7fb9bf16e40752&role.id=1a8e523ecbc84d818c2a9af0fb54da74 => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:07.650440 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5eafc4-d38c-4a84-a9f2-10be18bdea60 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:07.713680 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 43/94] 10.222.0.16 () {58 vars in 1282 bytes} [Thu May 26 12:20:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:20:07.718784 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9ff9e-b9e4-4570-95a8-d780803955a6 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:07.831589 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5eafc4-d38c-4a84-a9f2-10be18bdea60 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:07.842323 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:07.888873 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f186121d-d1aa-4317-b761-b50ccb6203d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:07.888873 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186121d-d1aa-4317-b761-b50ccb6203d4 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:07.888873 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186121d-d1aa-4317-b761-b50ccb6203d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:07.888873 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186121d-d1aa-4317-b761-b50ccb6203d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:07.889265 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f186121d-d1aa-4317-b761-b50ccb6203d4 None admin] RBAC: Adding query filter params (role.id=e0f421b5486c47aebb20ea10342cb1e3, scope.project.id=6ae47773ffcf4aad9f7fb9bf16e40752, user.id=4069b216ae0743869ac1161864e0b3ff) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:07.889265 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f186121d-d1aa-4317-b761-b50ccb6203d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:07.889265 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f186121d-d1aa-4317-b761-b50ccb6203d4 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:07.899058 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 52/95] 10.222.0.16 () {56 vars in 1374 bytes} [Thu May 26 12:20:07 2022] GET /identity/v3/role_assignments?user.id=4069b216ae0743869ac1161864e0b3ff&scope.project.id=6ae47773ffcf4aad9f7fb9bf16e40752&role.id=e0f421b5486c47aebb20ea10342cb1e3 => generated 259 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:07.949710 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9ff9e-b9e4-4570-95a8-d780803955a6 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:08.005470 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:08.015736 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef49d8-4d8d-47c8-a4a2-9c74aefa461a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:08.017549 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef49d8-4d8d-47c8-a4a2-9c74aefa461a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:08.019074 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef49d8-4d8d-47c8-a4a2-9c74aefa461a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:08.019635 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef49d8-4d8d-47c8-a4a2-9c74aefa461a None admin] PATH_INFO: `/v3/projects/2941055814804552be2880516801e30d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:08.021245 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ef49d8-4d8d-47c8-a4a2-9c74aefa461a None admin] RBAC: Authorizing `identity:get_project(project_id=2941055814804552be2880516801e30d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:08.023434 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ef49d8-4d8d-47c8-a4a2-9c74aefa461a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:08.025867 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 44/96] 10.222.0.16 () {56 vars in 1186 bytes} [Thu May 26 12:20:07 2022] GET /identity/v3/projects/2941055814804552be2880516801e30d => generated 312 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:08.038052 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f186121d-d1aa-4317-b761-b50ccb6203d4 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:08.179547 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f186121d-d1aa-4317-b761-b50ccb6203d4 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:08.230806 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126f41c-d9d3-4508-b341-bedc535074f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:08.231475 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126f41c-d9d3-4508-b341-bedc535074f9 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:08.231762 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126f41c-d9d3-4508-b341-bedc535074f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:08.232039 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126f41c-d9d3-4508-b341-bedc535074f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:08.232909 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126f41c-d9d3-4508-b341-bedc535074f9 None admin] RBAC: Adding query filter params (role.id=b0bf2a578f0a4319b93dd3b8a26a96b7, scope.project.id=2941055814804552be2880516801e30d, user.id=4069b216ae0743869ac1161864e0b3ff) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:08.233283 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126f41c-d9d3-4508-b341-bedc535074f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:08.234780 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126f41c-d9d3-4508-b341-bedc535074f9 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:08.245831 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 53/97] 10.222.0.16 () {56 vars in 1374 bytes} [Thu May 26 12:20:08 2022] GET /identity/v3/role_assignments?user.id=4069b216ae0743869ac1161864e0b3ff&scope.project.id=2941055814804552be2880516801e30d&role.id=b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:10.019396 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3889138-0e82-4b3b-9597-5672d6b825d0 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:10.020392 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3889138-0e82-4b3b-9597-5672d6b825d0 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:10.020913 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3889138-0e82-4b3b-9597-5672d6b825d0 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:10.022836 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 45/98] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:20:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:10.028387 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9d7b1-14f8-473e-93a5-e3dc50e2c7c5 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:10.029367 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9d7b1-14f8-473e-93a5-e3dc50e2c7c5 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:10.029844 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9d7b1-14f8-473e-93a5-e3dc50e2c7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:10.053827 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-52f9d7b1-14f8-473e-93a5-e3dc50e2c7c5 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:10.055348 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-52f9d7b1-14f8-473e-93a5-e3dc50e2c7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:10.085159 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:10.139116 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 54/99] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:20:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:20:10.182295 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3889138-0e82-4b3b-9597-5672d6b825d0 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:10.310046 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3889138-0e82-4b3b-9597-5672d6b825d0 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:10.354629 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a08aac8-4d0e-4b73-8825-64421d46247d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:10.355424 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08aac8-4d0e-4b73-8825-64421d46247d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:10.355709 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08aac8-4d0e-4b73-8825-64421d46247d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:10.355982 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08aac8-4d0e-4b73-8825-64421d46247d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:10.366993 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a08aac8-4d0e-4b73-8825-64421d46247d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:20:10.374694 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-8a08aac8-4d0e-4b73-8825-64421d46247d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:20:10.374694 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:10.374694 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:10.374694 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:10.374694 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:10.374694 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:10.374694 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:10.374694 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:10.374694 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:10.374694 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:10.374694 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:10.374694 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:10.374694 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:20:10.374694 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:20:10.374694 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:20:10.374694 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:20:10.375572 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:20:10.375572 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:20:10.375572 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:20:10.375572 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:20:10.375572 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:10.375572 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:10.375572 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:10.375572 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:10.375572 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:10.375572 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:10.375572 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:10.375572 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:20:10.375572 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:10.375572 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:10.375572 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:10.375572 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:10.376373 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:10.376373 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:10.376373 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:10.376373 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:10.376373 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:20:10.376373 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:20:10.376373 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:20:10.376373 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:20:10.376373 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:20:10.376373 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:20:10.376373 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:20:10.376373 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:20:10.376373 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 46/100] 10.222.0.16 () {56 vars in 1099 bytes} [Thu May 26 12:20:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:20:10.386881 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f9d7b1-14f8-473e-93a5-e3dc50e2c7c5 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:10.501051 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05409520-b10f-4b31-ba4d-2541c2a16989 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:10.501371 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05409520-b10f-4b31-ba4d-2541c2a16989 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:10.501630 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05409520-b10f-4b31-ba4d-2541c2a16989 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:10.503149 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 47/101] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:20:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:20:10.508577 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb51750c-5466-4dc6-b9cc-8635b6959321 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:10.508877 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb51750c-5466-4dc6-b9cc-8635b6959321 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:10.509155 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb51750c-5466-4dc6-b9cc-8635b6959321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:10.530206 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-fb51750c-5466-4dc6-b9cc-8635b6959321 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:10.533298 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-fb51750c-5466-4dc6-b9cc-8635b6959321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:10.540258 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f9d7b1-14f8-473e-93a5-e3dc50e2c7c5 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:10.602947 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e1893-5b59-40d6-bc8b-56fd4573518a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:10.603537 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e1893-5b59-40d6-bc8b-56fd4573518a None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:10.603831 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e1893-5b59-40d6-bc8b-56fd4573518a None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:10.604109 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e1893-5b59-40d6-bc8b-56fd4573518a None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:10.606537 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920e1893-5b59-40d6-bc8b-56fd4573518a None admin] RBAC: Adding query filter params (name=member) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:10.606845 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920e1893-5b59-40d6-bc8b-56fd4573518a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:10.608271 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920e1893-5b59-40d6-bc8b-56fd4573518a None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:10.629204 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 55/102] 10.222.0.16 () {56 vars in 1101 bytes} [Thu May 26 12:20:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:10.635069 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e1893-5b59-40d6-bc8b-56fd4573518a None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:10.637140 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:10.656057 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 48/103] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:20:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:20:10.662680 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aeb2f2-195d-49be-971b-e524e00a3c65 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:10.663052 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aeb2f2-195d-49be-971b-e524e00a3c65 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:10.663404 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aeb2f2-195d-49be-971b-e524e00a3c65 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:10.664957 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 49/104] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:20:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:20:10.670303 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c05d6-85d4-480e-8e10-2433df5f3844 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:10.670958 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c05d6-85d4-480e-8e10-2433df5f3844 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:10.673581 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c05d6-85d4-480e-8e10-2433df5f3844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:10.692318 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:10.698130 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-ea2c05d6-85d4-480e-8e10-2433df5f3844 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:10.700350 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ea2c05d6-85d4-480e-8e10-2433df5f3844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:10.774301 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e1893-5b59-40d6-bc8b-56fd4573518a None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:10.814463 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 50/105] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:20:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:20:10.815596 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dabd910-e996-42b4-a138-70f49520884d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:10.815924 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c05d6-85d4-480e-8e10-2433df5f3844 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:10.816651 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dabd910-e996-42b4-a138-70f49520884d None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:10.817041 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dabd910-e996-42b4-a138-70f49520884d None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:10.817501 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dabd910-e996-42b4-a138-70f49520884d None admin] PATH_INFO: `/v3/users/4069b216ae0743869ac1161864e0b3ff` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:10.819162 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dabd910-e996-42b4-a138-70f49520884d None admin] RBAC: Authorizing `identity:get_user(user_id=4069b216ae0743869ac1161864e0b3ff)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:10.821776 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dabd910-e996-42b4-a138-70f49520884d None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:10.828559 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 56/106] 10.222.0.16 () {56 vars in 1177 bytes} [Thu May 26 12:20:10 2022] GET /identity/v3/users/4069b216ae0743869ac1161864e0b3ff => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:10.830313 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0bb4a5-97ef-4980-bd4b-3b26041d4df6 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:10.830829 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0bb4a5-97ef-4980-bd4b-3b26041d4df6 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:10.831305 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0bb4a5-97ef-4980-bd4b-3b26041d4df6 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:10.833300 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 57/107] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:20:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:10.834196 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0bb4a5-97ef-4980-bd4b-3b26041d4df6 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:10.945723 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:10.953836 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c05d6-85d4-480e-8e10-2433df5f3844 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:10.954704 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0bb4a5-97ef-4980-bd4b-3b26041d4df6 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:10.972273 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:10.993596 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e0396-e3be-4224-9c94-dd48be64ce9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:10.994705 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e0396-e3be-4224-9c94-dd48be64ce9e None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:10.995171 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e0396-e3be-4224-9c94-dd48be64ce9e None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:10.995612 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e0396-e3be-4224-9c94-dd48be64ce9e None admin] PATH_INFO: `/v3/projects/6ae47773ffcf4aad9f7fb9bf16e40752` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:10.996948 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2e0396-e3be-4224-9c94-dd48be64ce9e None admin] RBAC: Authorizing `identity:get_project(project_id=6ae47773ffcf4aad9f7fb9bf16e40752)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:10.997380 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e3569-e36c-447c-a0f7-3114fcbead65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:10.998188 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e3569-e36c-447c-a0f7-3114fcbead65 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:10.998530 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e3569-e36c-447c-a0f7-3114fcbead65 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:10.998818 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e3569-e36c-447c-a0f7-3114fcbead65 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:10.999235 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2e0396-e3be-4224-9c94-dd48be64ce9e None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:11.002204 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 58/108] 10.222.0.16 () {56 vars in 1186 bytes} [Thu May 26 12:20:10 2022] GET /identity/v3/projects/6ae47773ffcf4aad9f7fb9bf16e40752 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:11.003277 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e0396-e3be-4224-9c94-dd48be64ce9e None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:11.011264 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931e3569-e36c-447c-a0f7-3114fcbead65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:20:11.020165 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-931e3569-e36c-447c-a0f7-3114fcbead65 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:20:11.020165 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:11.020165 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:11.020165 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:11.020165 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:11.020165 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:11.020165 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:11.020165 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:11.020165 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:11.020165 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:11.020165 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:11.020165 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:11.020165 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:20:11.020165 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:20:11.020165 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:20:11.020165 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:20:11.021488 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:20:11.021488 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:20:11.021488 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:20:11.021488 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:20:11.021488 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:11.021488 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:11.021488 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:11.021488 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:11.021488 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:11.021488 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:11.021488 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:11.021488 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:20:11.021488 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:11.021488 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:11.021488 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:11.021488 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:11.022260 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:11.022260 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:11.022260 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:11.022260 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:11.022260 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:20:11.022260 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:20:11.022260 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:20:11.022260 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:20:11.022260 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:20:11.022260 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:20:11.022260 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:20:11.022260 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:20:11.022260 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 51/109] 10.222.0.16 () {56 vars in 1099 bytes} [Thu May 26 12:20:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:20:11.023572 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f7e9a-5b50-4b52-bfc1-9540dac6ed7e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:11.023846 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f7e9a-5b50-4b52-bfc1-9540dac6ed7e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:11.025170 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f7e9a-5b50-4b52-bfc1-9540dac6ed7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:11.048591 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-6b5f7e9a-5b50-4b52-bfc1-9540dac6ed7e None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:11.050093 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6b5f7e9a-5b50-4b52-bfc1-9540dac6ed7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:11.120071 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e0396-e3be-4224-9c94-dd48be64ce9e None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:11.145274 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 52/110] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:20:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:20:11.146328 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f7e9a-5b50-4b52-bfc1-9540dac6ed7e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:11.174254 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a24ca28-495d-42e0-b920-8f248433eeb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:11.176290 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24ca28-495d-42e0-b920-8f248433eeb4 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:11.176816 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24ca28-495d-42e0-b920-8f248433eeb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:11.177388 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24ca28-495d-42e0-b920-8f248433eeb4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:11.179822 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a24ca28-495d-42e0-b920-8f248433eeb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:11.182045 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a24ca28-495d-42e0-b920-8f248433eeb4 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:11.185269 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 59/111] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:20:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:11.187291 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a24ca28-495d-42e0-b920-8f248433eeb4 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:11.235567 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:11.286986 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f7e9a-5b50-4b52-bfc1-9540dac6ed7e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:11.290337 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:11.330646 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a24ca28-495d-42e0-b920-8f248433eeb4 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:11.331481 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255729c1-b2f7-4302-9c88-c5b4ed79b13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:11.332423 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255729c1-b2f7-4302-9c88-c5b4ed79b13e None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:11.332710 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255729c1-b2f7-4302-9c88-c5b4ed79b13e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:11.333013 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255729c1-b2f7-4302-9c88-c5b4ed79b13e None admin] PATH_INFO: `/v3/projects/6ae47773ffcf4aad9f7fb9bf16e40752/users/4069b216ae0743869ac1161864e0b3ff/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:11.336159 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255729c1-b2f7-4302-9c88-c5b4ed79b13e None admin] RBAC: Authorizing `identity:create_grant(project_id=6ae47773ffcf4aad9f7fb9bf16e40752, user_id=4069b216ae0743869ac1161864e0b3ff, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:11.337749 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255729c1-b2f7-4302-9c88-c5b4ed79b13e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:11.354687 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 53/112] 10.222.0.16 () {58 vars in 1439 bytes} [Thu May 26 12:20:11 2022] PUT /identity/v3/projects/6ae47773ffcf4aad9f7fb9bf16e40752/users/4069b216ae0743869ac1161864e0b3ff/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:20:11.355653 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255729c1-b2f7-4302-9c88-c5b4ed79b13e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:11.375697 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ef5ef-2212-4ddd-b381-948c04cd83e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:11.377052 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ef5ef-2212-4ddd-b381-948c04cd83e3 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:11.377606 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ef5ef-2212-4ddd-b381-948c04cd83e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:11.378086 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ef5ef-2212-4ddd-b381-948c04cd83e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:11.379123 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ef5ef-2212-4ddd-b381-948c04cd83e3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:11.379751 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ef5ef-2212-4ddd-b381-948c04cd83e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:11.381560 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ef5ef-2212-4ddd-b381-948c04cd83e3 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:11.392726 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 60/113] 10.222.0.16 () {56 vars in 1101 bytes} [Thu May 26 12:20:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:11.394170 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ef5ef-2212-4ddd-b381-948c04cd83e3 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:11.478456 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255729c1-b2f7-4302-9c88-c5b4ed79b13e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:11.525901 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828a84e-c59a-4483-96fe-abb38c58f497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:11.527303 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828a84e-c59a-4483-96fe-abb38c58f497 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:11.527587 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828a84e-c59a-4483-96fe-abb38c58f497 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:11.527861 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828a84e-c59a-4483-96fe-abb38c58f497 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:11.534504 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:11.543461 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ef5ef-2212-4ddd-b381-948c04cd83e3 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:11.545299 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b828a84e-c59a-4483-96fe-abb38c58f497 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:20:11.561487 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-b828a84e-c59a-4483-96fe-abb38c58f497 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:20:11.561487 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:11.561487 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:11.561487 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:11.561487 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:11.561487 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:11.561487 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:11.561487 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:11.561487 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:11.561487 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:11.561487 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:11.561487 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:11.561487 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:20:11.561487 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:20:11.561487 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:20:11.561487 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:20:11.562404 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:20:11.562404 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:20:11.562404 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:20:11.562404 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:20:11.562404 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:11.562404 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:11.562404 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:11.562404 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:11.562404 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:11.562404 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:11.562404 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:11.562404 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:20:11.562404 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:11.562404 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:11.562404 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:11.562404 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:11.563165 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:11.563165 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:11.563165 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:11.563165 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:11.563165 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:20:11.563165 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:20:11.563165 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:20:11.563165 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:20:11.563165 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:20:11.563165 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:20:11.563165 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:20:11.563165 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:20:11.565928 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 54/114] 10.222.0.16 () {56 vars in 1096 bytes} [Thu May 26 12:20:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:20:11.568872 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828a84e-c59a-4483-96fe-abb38c58f497 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:11.602969 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8fce2-4074-4012-9f6b-e1cc25b138e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:11.604422 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8fce2-4074-4012-9f6b-e1cc25b138e0 None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:11.605088 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8fce2-4074-4012-9f6b-e1cc25b138e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:11.605666 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8fce2-4074-4012-9f6b-e1cc25b138e0 None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:11.606805 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8fce2-4074-4012-9f6b-e1cc25b138e0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:11.609033 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8fce2-4074-4012-9f6b-e1cc25b138e0 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:11.616243 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:11.647431 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 61/115] 10.222.0.16 () {60 vars in 1141 bytes} [Thu May 26 12:20:11 2022] POST /identity/v3/projects => generated 302 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:20:11.648904 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967cb5c-df0b-4d91-a6a9-ad4d94718009 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:11.649572 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967cb5c-df0b-4d91-a6a9-ad4d94718009 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:11.649950 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967cb5c-df0b-4d91-a6a9-ad4d94718009 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:11.653255 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 62/116] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:20:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:11.654113 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0967cb5c-df0b-4d91-a6a9-ad4d94718009 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:11.696512 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828a84e-c59a-4483-96fe-abb38c58f497 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:11.783625 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5787d19-a0c8-497a-a9cb-18051cfaf297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:11.784515 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5787d19-a0c8-497a-a9cb-18051cfaf297 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:11.784808 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5787d19-a0c8-497a-a9cb-18051cfaf297 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:11.785108 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5787d19-a0c8-497a-a9cb-18051cfaf297 None admin] PATH_INFO: `/v3/users/f227769089e8416f9b64e59fe2e31b0b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:11.787070 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0967cb5c-df0b-4d91-a6a9-ad4d94718009 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:11.829687 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb0cf62-b413-428a-8561-db136cba9a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:11.831037 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb0cf62-b413-428a-8561-db136cba9a68 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:11.831425 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb0cf62-b413-428a-8561-db136cba9a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:11.831846 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb0cf62-b413-428a-8561-db136cba9a68 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:11.832761 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb0cf62-b413-428a-8561-db136cba9a68 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:11.833242 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb0cf62-b413-428a-8561-db136cba9a68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:11.835627 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb0cf62-b413-428a-8561-db136cba9a68 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:11.845612 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5787d19-a0c8-497a-a9cb-18051cfaf297 None admin] RBAC: Authorizing `identity:get_user(user_id=f227769089e8416f9b64e59fe2e31b0b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:11.846095 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 63/117] 10.222.0.16 () {56 vars in 1099 bytes} [Thu May 26 12:20:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:11.847130 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5787d19-a0c8-497a-a9cb-18051cfaf297 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:11.847471 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8df074-6fc2-45b7-bb31-973d8f633cb6 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:11.847863 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8df074-6fc2-45b7-bb31-973d8f633cb6 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:11.848243 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8df074-6fc2-45b7-bb31-973d8f633cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:11.849015 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 55/118] 10.222.0.16 () {56 vars in 1177 bytes} [Thu May 26 12:20:11 2022] GET /identity/v3/users/f227769089e8416f9b64e59fe2e31b0b => generated 289 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:11.857905 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5787d19-a0c8-497a-a9cb-18051cfaf297 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:11.867079 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-7a8df074-6fc2-45b7-bb31-973d8f633cb6 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:11.869310 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-7a8df074-6fc2-45b7-bb31-973d8f633cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:11.881217 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:11.964794 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 64/119] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:20:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:20:11.966617 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8df074-6fc2-45b7-bb31-973d8f633cb6 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:11.984357 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:12.010018 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5787d19-a0c8-497a-a9cb-18051cfaf297 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:12.047634 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f270e11-8120-4ee8-b2c8-3b95c27f35e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:12.048366 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f270e11-8120-4ee8-b2c8-3b95c27f35e3 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:12.048650 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f270e11-8120-4ee8-b2c8-3b95c27f35e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:12.048959 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f270e11-8120-4ee8-b2c8-3b95c27f35e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:12.090753 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8df074-6fc2-45b7-bb31-973d8f633cb6 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:12.133761 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ac53e-f15a-4002-91ef-dc7cd77bf8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:12.135720 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ac53e-f15a-4002-91ef-dc7cd77bf8e9 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:12.136303 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ac53e-f15a-4002-91ef-dc7cd77bf8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:12.136960 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ac53e-f15a-4002-91ef-dc7cd77bf8e9 None admin] PATH_INFO: `/v3/users/25194ab74edc4c009c8aaa9efa80932f` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:12.138411 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ac53e-f15a-4002-91ef-dc7cd77bf8e9 None admin] RBAC: Authorizing `identity:get_user(user_id=25194ab74edc4c009c8aaa9efa80932f)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:12.140154 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ac53e-f15a-4002-91ef-dc7cd77bf8e9 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:12.142780 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 65/120] 10.222.0.16 () {56 vars in 1177 bytes} [Thu May 26 12:20:11 2022] GET /identity/v3/users/25194ab74edc4c009c8aaa9efa80932f => generated 247 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:12.144303 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd851b0-c29b-4be2-8fe2-12981bd16efe None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:12.144808 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd851b0-c29b-4be2-8fe2-12981bd16efe None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:12.145308 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd851b0-c29b-4be2-8fe2-12981bd16efe None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:12.146755 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 66/121] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:20:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:12.147632 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd851b0-c29b-4be2-8fe2-12981bd16efe None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:12.149229 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f270e11-8120-4ee8-b2c8-3b95c27f35e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:12.151049 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f270e11-8120-4ee8-b2c8-3b95c27f35e3 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:12.158150 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:12.255327 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:12.267718 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd851b0-c29b-4be2-8fe2-12981bd16efe None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:12.277708 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 56/122] 10.222.0.16 () {58 vars in 1282 bytes} [Thu May 26 12:20:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:20:12.278905 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f270e11-8120-4ee8-b2c8-3b95c27f35e3 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:12.311591 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed96b402-9323-4e1d-9ed9-290ffb19da50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:12.312339 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96b402-9323-4e1d-9ed9-290ffb19da50 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:12.312626 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96b402-9323-4e1d-9ed9-290ffb19da50 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:12.313232 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96b402-9323-4e1d-9ed9-290ffb19da50 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:12.326727 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed96b402-9323-4e1d-9ed9-290ffb19da50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:20:12.336973 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-ed96b402-9323-4e1d-9ed9-290ffb19da50 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:20:12.336973 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:12.336973 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:12.336973 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:12.336973 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:12.336973 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:12.336973 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:12.336973 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:12.336973 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:12.336973 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:12.336973 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:12.336973 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:12.336973 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:20:12.336973 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:20:12.336973 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:20:12.336973 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:20:12.337848 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:20:12.337848 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:20:12.337848 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:20:12.337848 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:20:12.337848 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:12.337848 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:12.337848 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:12.337848 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:12.337848 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:12.337848 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:12.337848 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:12.337848 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:20:12.337848 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:12.337848 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:12.337848 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:12.337848 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:12.338683 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:12.338683 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:12.338683 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:12.338683 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:12.338683 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:20:12.338683 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:20:12.338683 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:20:12.338683 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:20:12.338683 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:20:12.338683 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:20:12.338683 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:20:12.338683 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:20:12.338683 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 67/123] 10.222.0.16 () {56 vars in 1114 bytes} [Thu May 26 12:20:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:20:12.342041 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785370d-96f2-4554-80a5-4c9bca7b692b None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:12.342530 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785370d-96f2-4554-80a5-4c9bca7b692b None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:12.342997 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785370d-96f2-4554-80a5-4c9bca7b692b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:12.371063 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-1785370d-96f2-4554-80a5-4c9bca7b692b None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:12.372594 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-1785370d-96f2-4554-80a5-4c9bca7b692b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:12.406492 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f270e11-8120-4ee8-b2c8-3b95c27f35e3 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:12.435662 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:12.446429 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 68/124] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:20:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:20:12.447554 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785370d-96f2-4554-80a5-4c9bca7b692b None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:12.455274 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431df6aa-9eab-444b-b659-4655f8f1a424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:12.459706 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431df6aa-9eab-444b-b659-4655f8f1a424 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:12.460203 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431df6aa-9eab-444b-b659-4655f8f1a424 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:12.460725 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431df6aa-9eab-444b-b659-4655f8f1a424 None admin] PATH_INFO: `/v3/projects/6ae47773ffcf4aad9f7fb9bf16e40752` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:12.463779 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431df6aa-9eab-444b-b659-4655f8f1a424 None admin] RBAC: Authorizing `identity:get_project(project_id=6ae47773ffcf4aad9f7fb9bf16e40752)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:12.466164 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431df6aa-9eab-444b-b659-4655f8f1a424 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:12.470224 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 57/125] 10.222.0.16 () {56 vars in 1186 bytes} [Thu May 26 12:20:12 2022] GET /identity/v3/projects/6ae47773ffcf4aad9f7fb9bf16e40752 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:12.475710 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431df6aa-9eab-444b-b659-4655f8f1a424 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:12.532649 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:12.580253 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785370d-96f2-4554-80a5-4c9bca7b692b None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:12.593575 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431df6aa-9eab-444b-b659-4655f8f1a424 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:12.626982 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ca64ea-3685-4b0f-aa7c-050683630af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:12.628318 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca64ea-3685-4b0f-aa7c-050683630af4 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:12.628866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca64ea-3685-4b0f-aa7c-050683630af4 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:12.629383 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca64ea-3685-4b0f-aa7c-050683630af4 None admin] PATH_INFO: `/v3/projects/6ae47773ffcf4aad9f7fb9bf16e40752` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:12.630892 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ca64ea-3685-4b0f-aa7c-050683630af4 None admin] RBAC: Authorizing `identity:get_project(project_id=6ae47773ffcf4aad9f7fb9bf16e40752)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:12.632750 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ca64ea-3685-4b0f-aa7c-050683630af4 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:12.633370 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a082d-09fc-47a6-ad8f-7a61e3ec3bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:12.634041 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a082d-09fc-47a6-ad8f-7a61e3ec3bc1 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:12.634330 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a082d-09fc-47a6-ad8f-7a61e3ec3bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:12.634608 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a082d-09fc-47a6-ad8f-7a61e3ec3bc1 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:12.635358 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a082d-09fc-47a6-ad8f-7a61e3ec3bc1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:12.635668 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a082d-09fc-47a6-ad8f-7a61e3ec3bc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:12.636453 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 69/126] 10.222.0.16 () {56 vars in 1186 bytes} [Thu May 26 12:20:12 2022] GET /identity/v3/projects/6ae47773ffcf4aad9f7fb9bf16e40752 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:12.637329 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a082d-09fc-47a6-ad8f-7a61e3ec3bc1 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:12.637680 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ca64ea-3685-4b0f-aa7c-050683630af4 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:12.648923 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 58/127] 10.222.0.16 () {56 vars in 1111 bytes} [Thu May 26 12:20:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:12.650019 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a082d-09fc-47a6-ad8f-7a61e3ec3bc1 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:12.718363 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:12.760137 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ca64ea-3685-4b0f-aa7c-050683630af4 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:12.771091 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a082d-09fc-47a6-ad8f-7a61e3ec3bc1 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:12.785854 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:12.798769 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d385e9-1b08-4afd-ab52-22fc44668089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:12.799660 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d385e9-1b08-4afd-ab52-22fc44668089 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:12.799949 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d385e9-1b08-4afd-ab52-22fc44668089 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:12.800223 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d385e9-1b08-4afd-ab52-22fc44668089 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:12.811226 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d385e9-1b08-4afd-ab52-22fc44668089 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:20:12.811592 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e3b6b3-5b72-4f18-ab7e-ab02347d30f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:12.812699 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3b6b3-5b72-4f18-ab7e-ab02347d30f6 None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:12.813229 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3b6b3-5b72-4f18-ab7e-ab02347d30f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:12.813746 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3b6b3-5b72-4f18-ab7e-ab02347d30f6 None admin] PATH_INFO: `/v3/projects/6ae47773ffcf4aad9f7fb9bf16e40752/users/25194ab74edc4c009c8aaa9efa80932f/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:12.815999 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e3b6b3-5b72-4f18-ab7e-ab02347d30f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=6ae47773ffcf4aad9f7fb9bf16e40752, user_id=25194ab74edc4c009c8aaa9efa80932f, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:12.817785 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e3b6b3-5b72-4f18-ab7e-ab02347d30f6 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:12.819317 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-f8d385e9-1b08-4afd-ab52-22fc44668089 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:20:12.819317 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:12.819317 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:12.819317 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:12.819317 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:12.819317 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:12.819317 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:12.819317 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:12.819317 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:12.819317 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:12.819317 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:12.819317 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:12.819317 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:20:12.819317 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:20:12.819317 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:20:12.819317 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:20:12.820199 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:20:12.820199 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:20:12.820199 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:20:12.820199 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:20:12.820199 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:12.820199 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:12.820199 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:12.820199 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:12.820199 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:12.820199 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:12.820199 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:12.820199 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:20:12.820199 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:12.820199 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:12.820199 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:12.820199 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:12.821013 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:12.821013 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:12.821013 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:12.821013 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:12.821013 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:20:12.821013 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:20:12.821013 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:20:12.821013 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:20:12.821013 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:20:12.821013 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:20:12.821013 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:20:12.821013 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:20:12.825392 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 70/128] 10.222.0.16 () {56 vars in 1099 bytes} [Thu May 26 12:20:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:20:12.827369 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d385e9-1b08-4afd-ab52-22fc44668089 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:12.834912 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 59/129] 10.222.0.16 () {58 vars in 1439 bytes} [Thu May 26 12:20:12 2022] PUT /identity/v3/projects/6ae47773ffcf4aad9f7fb9bf16e40752/users/25194ab74edc4c009c8aaa9efa80932f/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:20:12.836377 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e3b6b3-5b72-4f18-ab7e-ab02347d30f6 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:12.943705 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d385e9-1b08-4afd-ab52-22fc44668089 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:12.958199 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e3b6b3-5b72-4f18-ab7e-ab02347d30f6 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:12.971584 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:12.983750 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ddb947-f2b5-491a-aea7-569a09e7837f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:12.984414 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ddb947-f2b5-491a-aea7-569a09e7837f None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:12.984700 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ddb947-f2b5-491a-aea7-569a09e7837f None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:12.985012 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ddb947-f2b5-491a-aea7-569a09e7837f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:12.986234 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ddb947-f2b5-491a-aea7-569a09e7837f None admin] RBAC: Adding query filter params (role.id=c23f3f2e6c7e4a259066d5527cd0ab25, scope.project.id=6ae47773ffcf4aad9f7fb9bf16e40752, user.id=f227769089e8416f9b64e59fe2e31b0b) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:12.986343 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ddb947-f2b5-491a-aea7-569a09e7837f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:12.987734 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ddb947-f2b5-491a-aea7-569a09e7837f None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:12.994302 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 71/130] 10.222.0.16 () {56 vars in 1374 bytes} [Thu May 26 12:20:12 2022] GET /identity/v3/role_assignments?user.id=f227769089e8416f9b64e59fe2e31b0b&scope.project.id=6ae47773ffcf4aad9f7fb9bf16e40752&role.id=c23f3f2e6c7e4a259066d5527cd0ab25 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:12.995181 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ddb947-f2b5-491a-aea7-569a09e7837f None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:13.011574 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c1544-c842-47ee-b50a-5c509a1eaa0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:13.013127 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c1544-c842-47ee-b50a-5c509a1eaa0e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:13.013630 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c1544-c842-47ee-b50a-5c509a1eaa0e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:13.014187 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c1544-c842-47ee-b50a-5c509a1eaa0e None admin] PATH_INFO: `/v3/users/4069b216ae0743869ac1161864e0b3ff` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:13.016321 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0c1544-c842-47ee-b50a-5c509a1eaa0e None admin] RBAC: Authorizing `identity:get_user(user_id=4069b216ae0743869ac1161864e0b3ff)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:13.018902 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0c1544-c842-47ee-b50a-5c509a1eaa0e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:13.021075 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 60/131] 10.222.0.16 () {56 vars in 1177 bytes} [Thu May 26 12:20:12 2022] GET /identity/v3/users/4069b216ae0743869ac1161864e0b3ff => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:13.037880 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c1544-c842-47ee-b50a-5c509a1eaa0e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:13.105149 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:13.119215 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ddb947-f2b5-491a-aea7-569a09e7837f None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:13.157995 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d425532d-bd0e-47a4-bc13-89538b6ac04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:13.159446 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425532d-bd0e-47a4-bc13-89538b6ac04b None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:13.159994 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425532d-bd0e-47a4-bc13-89538b6ac04b None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:13.160512 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425532d-bd0e-47a4-bc13-89538b6ac04b None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:13.161697 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d425532d-bd0e-47a4-bc13-89538b6ac04b None admin] RBAC: Adding query filter params (name=member) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:13.162247 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d425532d-bd0e-47a4-bc13-89538b6ac04b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:13.163900 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d425532d-bd0e-47a4-bc13-89538b6ac04b None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:13.178777 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 72/132] 10.222.0.16 () {56 vars in 1101 bytes} [Thu May 26 12:20:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:13.180356 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d425532d-bd0e-47a4-bc13-89538b6ac04b None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:13.186136 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c1544-c842-47ee-b50a-5c509a1eaa0e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:13.226817 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063cb111-f4c0-4819-a1a2-331e2aff7628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:13.228111 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063cb111-f4c0-4819-a1a2-331e2aff7628 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:13.228111 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063cb111-f4c0-4819-a1a2-331e2aff7628 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:13.228365 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063cb111-f4c0-4819-a1a2-331e2aff7628 None admin] PATH_INFO: `/v3/projects/6ae47773ffcf4aad9f7fb9bf16e40752` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:13.229856 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063cb111-f4c0-4819-a1a2-331e2aff7628 None admin] RBAC: Authorizing `identity:get_project(project_id=6ae47773ffcf4aad9f7fb9bf16e40752)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:13.231538 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063cb111-f4c0-4819-a1a2-331e2aff7628 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:13.233460 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 61/133] 10.222.0.16 () {56 vars in 1186 bytes} [Thu May 26 12:20:13 2022] GET /identity/v3/projects/6ae47773ffcf4aad9f7fb9bf16e40752 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:20:13.239422 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063cb111-f4c0-4819-a1a2-331e2aff7628 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:13.241175 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:13.300802 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d425532d-bd0e-47a4-bc13-89538b6ac04b None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:13.341347 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dfbdb8-1f1a-4641-86fa-7b62b447aaa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:13.342596 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dfbdb8-1f1a-4641-86fa-7b62b447aaa2 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:13.343099 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dfbdb8-1f1a-4641-86fa-7b62b447aaa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:13.343581 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dfbdb8-1f1a-4641-86fa-7b62b447aaa2 None admin] PATH_INFO: `/v3/users/4069b216ae0743869ac1161864e0b3ff` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:13.346087 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dfbdb8-1f1a-4641-86fa-7b62b447aaa2 None admin] RBAC: Authorizing `identity:get_user(user_id=4069b216ae0743869ac1161864e0b3ff)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:13.348638 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dfbdb8-1f1a-4641-86fa-7b62b447aaa2 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:13.351574 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 73/134] 10.222.0.16 () {56 vars in 1177 bytes} [Thu May 26 12:20:13 2022] GET /identity/v3/users/4069b216ae0743869ac1161864e0b3ff => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:20:13.357259 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dfbdb8-1f1a-4641-86fa-7b62b447aaa2 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:13.358755 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063cb111-f4c0-4819-a1a2-331e2aff7628 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:13.369990 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:13.402827 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72576bf-c972-42d2-a1b8-f53de2fc7e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:13.404167 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72576bf-c972-42d2-a1b8-f53de2fc7e78 None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:13.404350 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72576bf-c972-42d2-a1b8-f53de2fc7e78 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:13.404732 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72576bf-c972-42d2-a1b8-f53de2fc7e78 None admin] PATH_INFO: `/v3/projects/6ae47773ffcf4aad9f7fb9bf16e40752/users/4069b216ae0743869ac1161864e0b3ff/roles/e0f421b5486c47aebb20ea10342cb1e3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:13.407201 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72576bf-c972-42d2-a1b8-f53de2fc7e78 None admin] RBAC: Authorizing `identity:create_grant(project_id=6ae47773ffcf4aad9f7fb9bf16e40752, user_id=4069b216ae0743869ac1161864e0b3ff, role_id=e0f421b5486c47aebb20ea10342cb1e3)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:13.408910 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72576bf-c972-42d2-a1b8-f53de2fc7e78 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:13.422583 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 62/135] 10.222.0.16 () {58 vars in 1439 bytes} [Thu May 26 12:20:13 2022] PUT /identity/v3/projects/6ae47773ffcf4aad9f7fb9bf16e40752/users/4069b216ae0743869ac1161864e0b3ff/roles/e0f421b5486c47aebb20ea10342cb1e3 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:20:13.480512 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dfbdb8-1f1a-4641-86fa-7b62b447aaa2 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:13.501760 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:13.521080 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a451136e-c5bd-4326-b4b4-dfae0855a6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:13.522030 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451136e-c5bd-4326-b4b4-dfae0855a6e7 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:13.522320 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451136e-c5bd-4326-b4b4-dfae0855a6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:13.522602 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451136e-c5bd-4326-b4b4-dfae0855a6e7 None admin] PATH_INFO: `/v3/projects/2941055814804552be2880516801e30d` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:13.523887 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a451136e-c5bd-4326-b4b4-dfae0855a6e7 None admin] RBAC: Authorizing `identity:get_project(project_id=2941055814804552be2880516801e30d)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:13.525413 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a451136e-c5bd-4326-b4b4-dfae0855a6e7 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:13.527372 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 74/136] 10.222.0.16 () {56 vars in 1186 bytes} [Thu May 26 12:20:13 2022] GET /identity/v3/projects/2941055814804552be2880516801e30d => generated 312 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:13.533392 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72576bf-c972-42d2-a1b8-f53de2fc7e78 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:13.666863 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72576bf-c972-42d2-a1b8-f53de2fc7e78 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:13.702231 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a35685a-5325-472f-84f7-156c212508b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:13.703144 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35685a-5325-472f-84f7-156c212508b0 None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:13.703432 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35685a-5325-472f-84f7-156c212508b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:13.703712 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35685a-5325-472f-84f7-156c212508b0 None admin] PATH_INFO: `/v3/projects/2941055814804552be2880516801e30d/users/4069b216ae0743869ac1161864e0b3ff/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:13.705787 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a35685a-5325-472f-84f7-156c212508b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=2941055814804552be2880516801e30d, user_id=4069b216ae0743869ac1161864e0b3ff, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:13.707284 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a35685a-5325-472f-84f7-156c212508b0 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:13.721262 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 63/137] 10.222.0.16 () {58 vars in 1439 bytes} [Thu May 26 12:20:13 2022] PUT /identity/v3/projects/2941055814804552be2880516801e30d/users/4069b216ae0743869ac1161864e0b3ff/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:20:14.130973 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6785f2-ce8c-4293-a38a-d4dbb44efb23 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:14.131342 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6785f2-ce8c-4293-a38a-d4dbb44efb23 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:14.131535 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6785f2-ce8c-4293-a38a-d4dbb44efb23 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:14.133068 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 75/138] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:20:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:14.138197 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc586b34-a8bf-4932-8b12-32e8ed8d2b45 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:14.138662 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc586b34-a8bf-4932-8b12-32e8ed8d2b45 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:14.138749 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc586b34-a8bf-4932-8b12-32e8ed8d2b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:14.159812 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-bc586b34-a8bf-4932-8b12-32e8ed8d2b45 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:14.161031 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-bc586b34-a8bf-4932-8b12-32e8ed8d2b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:14.184274 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:14.232124 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 64/139] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:20:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:20:14.257407 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6785f2-ce8c-4293-a38a-d4dbb44efb23 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:14.386503 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6785f2-ce8c-4293-a38a-d4dbb44efb23 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:14.431263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a415d4f1-ab9e-4197-acf8-51caf2f87c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:14.432064 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415d4f1-ab9e-4197-acf8-51caf2f87c49 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:14.432343 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415d4f1-ab9e-4197-acf8-51caf2f87c49 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:14.432617 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415d4f1-ab9e-4197-acf8-51caf2f87c49 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:14.443164 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a415d4f1-ab9e-4197-acf8-51caf2f87c49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:20:14.450906 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-a415d4f1-ab9e-4197-acf8-51caf2f87c49 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:20:14.450906 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:14.450906 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:14.450906 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:14.450906 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:14.450906 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:14.450906 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:14.450906 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:14.450906 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:14.450906 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:14.450906 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:14.450906 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:14.450906 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:20:14.450906 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:20:14.450906 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:20:14.450906 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:20:14.451775 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:20:14.451775 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:20:14.451775 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:20:14.451775 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:20:14.451775 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:14.451775 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:14.451775 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:14.451775 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:14.451775 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:14.451775 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:14.451775 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:14.451775 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:20:14.451775 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:14.451775 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:14.451775 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:14.451775 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:14.452544 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:14.452544 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:14.452544 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:14.452544 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:14.452544 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:20:14.452544 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:20:14.452544 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:20:14.452544 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:20:14.452544 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:20:14.452544 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:20:14.452544 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:20:14.452544 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:20:14.452544 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 76/140] 10.222.0.16 () {56 vars in 1099 bytes} [Thu May 26 12:20:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:20:14.458897 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc586b34-a8bf-4932-8b12-32e8ed8d2b45 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:14.531345 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983e89a-d076-488d-b649-7012dc6cc113 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:14.531665 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983e89a-d076-488d-b649-7012dc6cc113 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:14.531900 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983e89a-d076-488d-b649-7012dc6cc113 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:14.533996 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 77/141] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:20:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:14.539077 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc0ea5-fcd6-4937-b694-7ff959f28537 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:14.539357 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc0ea5-fcd6-4937-b694-7ff959f28537 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:14.539630 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc0ea5-fcd6-4937-b694-7ff959f28537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:14.561860 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-68cc0ea5-fcd6-4937-b694-7ff959f28537 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:14.563061 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-68cc0ea5-fcd6-4937-b694-7ff959f28537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:14.618357 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc586b34-a8bf-4932-8b12-32e8ed8d2b45 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:14.647633 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:14.689143 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049df7b1-6eb0-4c9d-80cf-0bce95adb5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:14.689823 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049df7b1-6eb0-4c9d-80cf-0bce95adb5d6 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:14.690104 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049df7b1-6eb0-4c9d-80cf-0bce95adb5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:14.690374 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049df7b1-6eb0-4c9d-80cf-0bce95adb5d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:14.691126 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049df7b1-6eb0-4c9d-80cf-0bce95adb5d6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:14.691431 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049df7b1-6eb0-4c9d-80cf-0bce95adb5d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:14.692812 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049df7b1-6eb0-4c9d-80cf-0bce95adb5d6 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:14.707613 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 78/142] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:20:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:20:14.716694 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 65/143] 10.222.0.16 () {56 vars in 1101 bytes} [Thu May 26 12:20:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:14.722260 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc0ea5-fcd6-4937-b694-7ff959f28537 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:14.745118 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049df7b1-6eb0-4c9d-80cf-0bce95adb5d6 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:14.789215 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:14.920046 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc0ea5-fcd6-4937-b694-7ff959f28537 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:14.935031 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049df7b1-6eb0-4c9d-80cf-0bce95adb5d6 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:14.967503 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f14ddb-035d-4811-8815-94bb4497fe20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:14.969119 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f14ddb-035d-4811-8815-94bb4497fe20 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:14.970080 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f14ddb-035d-4811-8815-94bb4497fe20 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:14.970647 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f14ddb-035d-4811-8815-94bb4497fe20 None admin] PATH_INFO: `/v3/users/4069b216ae0743869ac1161864e0b3ff` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:14.972204 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f14ddb-035d-4811-8815-94bb4497fe20 None admin] RBAC: Authorizing `identity:get_user(user_id=4069b216ae0743869ac1161864e0b3ff)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:14.974139 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f14ddb-035d-4811-8815-94bb4497fe20 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:14.976536 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 79/144] 10.222.0.16 () {56 vars in 1177 bytes} [Thu May 26 12:20:14 2022] GET /identity/v3/users/4069b216ae0743869ac1161864e0b3ff => generated 275 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:14.982748 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f14ddb-035d-4811-8815-94bb4497fe20 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:15.025712 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde5a2a-fe47-428c-8ca3-8aeaf13d3231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:15.026699 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde5a2a-fe47-428c-8ca3-8aeaf13d3231 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:15.027065 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde5a2a-fe47-428c-8ca3-8aeaf13d3231 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:15.027450 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde5a2a-fe47-428c-8ca3-8aeaf13d3231 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:15.028780 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bde5a2a-fe47-428c-8ca3-8aeaf13d3231 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:15.030373 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bde5a2a-fe47-428c-8ca3-8aeaf13d3231 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:15.033024 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 66/145] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:20:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:15.038365 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde5a2a-fe47-428c-8ca3-8aeaf13d3231 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:15.064043 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:15.163432 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f14ddb-035d-4811-8815-94bb4497fe20 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:15.238502 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b387639-aefe-44a7-9b07-033411bb0846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:15.239635 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b387639-aefe-44a7-9b07-033411bb0846 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:15.240085 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b387639-aefe-44a7-9b07-033411bb0846 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:15.240662 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b387639-aefe-44a7-9b07-033411bb0846 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:15.245207 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:15.265882 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde5a2a-fe47-428c-8ca3-8aeaf13d3231 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:15.335664 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c638098-0917-4cf5-a4b3-a2a02bba8aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:15.336357 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c638098-0917-4cf5-a4b3-a2a02bba8aec None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:15.336648 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c638098-0917-4cf5-a4b3-a2a02bba8aec None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:15.336958 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c638098-0917-4cf5-a4b3-a2a02bba8aec None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:15.337685 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c638098-0917-4cf5-a4b3-a2a02bba8aec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:15.339170 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c638098-0917-4cf5-a4b3-a2a02bba8aec None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:15.374233 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 67/146] 10.222.0.16 () {60 vars in 1132 bytes} [Thu May 26 12:20:15 2022] POST /identity/v3/users => generated 283 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:20:15.378024 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b387639-aefe-44a7-9b07-033411bb0846 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:15.380088 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b387639-aefe-44a7-9b07-033411bb0846 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:15.461123 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:15.530675 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 80/147] 10.222.0.16 () {58 vars in 1282 bytes} [Thu May 26 12:20:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:20:15.536809 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c638098-0917-4cf5-a4b3-a2a02bba8aec None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:15.657741 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c638098-0917-4cf5-a4b3-a2a02bba8aec None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:15.692690 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c7eced-e7cb-4aff-97fc-be2e299d01ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:15.693597 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7eced-e7cb-4aff-97fc-be2e299d01ca None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:15.693885 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7eced-e7cb-4aff-97fc-be2e299d01ca None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:15.694167 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7eced-e7cb-4aff-97fc-be2e299d01ca None admin] PATH_INFO: `/v3/projects/6ae47773ffcf4aad9f7fb9bf16e40752` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:15.695376 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c7eced-e7cb-4aff-97fc-be2e299d01ca None admin] RBAC: Authorizing `identity:get_project(project_id=6ae47773ffcf4aad9f7fb9bf16e40752)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:15.696869 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c7eced-e7cb-4aff-97fc-be2e299d01ca None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:15.698746 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 68/148] 10.222.0.16 () {56 vars in 1186 bytes} [Thu May 26 12:20:15 2022] GET /identity/v3/projects/6ae47773ffcf4aad9f7fb9bf16e40752 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:15.705209 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b387639-aefe-44a7-9b07-033411bb0846 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:15.838109 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b387639-aefe-44a7-9b07-033411bb0846 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:15.882566 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89903e2-75bd-459d-b0d5-d6a4cc89d2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:15.883579 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89903e2-75bd-459d-b0d5-d6a4cc89d2ee None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:15.884088 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89903e2-75bd-459d-b0d5-d6a4cc89d2ee None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:15.884580 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89903e2-75bd-459d-b0d5-d6a4cc89d2ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:15.885652 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89903e2-75bd-459d-b0d5-d6a4cc89d2ee None admin] RBAC: Adding query filter params (role.id=b0bf2a578f0a4319b93dd3b8a26a96b7, scope.project.id=6ae47773ffcf4aad9f7fb9bf16e40752, user.id=4069b216ae0743869ac1161864e0b3ff) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:15.886166 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89903e2-75bd-459d-b0d5-d6a4cc89d2ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:15.887811 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89903e2-75bd-459d-b0d5-d6a4cc89d2ee None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:15.897890 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 81/149] 10.222.0.16 () {56 vars in 1374 bytes} [Thu May 26 12:20:15 2022] GET /identity/v3/role_assignments?user.id=4069b216ae0743869ac1161864e0b3ff&scope.project.id=6ae47773ffcf4aad9f7fb9bf16e40752&role.id=b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:16.458259 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8abbe4-0f4b-43fc-911c-adebaa6e5ed6 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:16.459076 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8abbe4-0f4b-43fc-911c-adebaa6e5ed6 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:16.459076 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8abbe4-0f4b-43fc-911c-adebaa6e5ed6 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:16.460202 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 69/150] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:20:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:16.467298 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74369eae-b97f-4055-87da-5b6ae6e25b6f None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:16.467799 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74369eae-b97f-4055-87da-5b6ae6e25b6f None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:16.467873 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74369eae-b97f-4055-87da-5b6ae6e25b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:16.487533 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-74369eae-b97f-4055-87da-5b6ae6e25b6f None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:16.488747 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-74369eae-b97f-4055-87da-5b6ae6e25b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:16.490983 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:16.570089 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 82/151] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:20:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:20:16.573633 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661d309-b00b-4fa4-a218-177dbc3e865a None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:16.573954 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661d309-b00b-4fa4-a218-177dbc3e865a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:16.574249 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661d309-b00b-4fa4-a218-177dbc3e865a None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:16.575654 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 70/152] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:20:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:16.582883 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f39d9-63f4-4d04-817f-22bba5407765 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:16.583172 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f39d9-63f4-4d04-817f-22bba5407765 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:16.583447 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f39d9-63f4-4d04-817f-22bba5407765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:16.602304 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-f98f39d9-63f4-4d04-817f-22bba5407765 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:16.603819 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-f98f39d9-63f4-4d04-817f-22bba5407765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:16.605644 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5661d309-b00b-4fa4-a218-177dbc3e865a None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:16.632089 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:16.685464 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 83/153] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:20:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:20:16.712643 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f39d9-63f4-4d04-817f-22bba5407765 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:16.809350 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5661d309-b00b-4fa4-a218-177dbc3e865a None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:16.845328 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:16.865977 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b3bd25-1f6b-490a-b320-c10f8d1ae8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:16.867164 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b3bd25-1f6b-490a-b320-c10f8d1ae8ea None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:16.867695 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b3bd25-1f6b-490a-b320-c10f8d1ae8ea None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:16.868141 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b3bd25-1f6b-490a-b320-c10f8d1ae8ea None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:16.888403 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b3bd25-1f6b-490a-b320-c10f8d1ae8ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:20:16.896253 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-75b3bd25-1f6b-490a-b320-c10f8d1ae8ea None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:20:16.896253 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:16.896253 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:16.896253 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:16.896253 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:16.896253 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:16.896253 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:16.896253 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:16.896253 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:16.896253 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:16.896253 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:16.896253 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:16.896253 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:20:16.896253 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:20:16.896253 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:20:16.896253 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:20:16.897260 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:20:16.897260 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:20:16.897260 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:20:16.897260 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:20:16.897260 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:16.897260 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:16.897260 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:16.897260 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:16.897260 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:16.897260 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:16.897260 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:16.897260 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:20:16.897260 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:16.897260 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:16.897260 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:16.897260 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:16.898026 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:16.898026 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:16.898026 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:16.898026 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:16.898026 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:20:16.898026 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:20:16.898026 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:20:16.898026 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:20:16.898026 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:20:16.898026 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:20:16.898026 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:20:16.898026 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:20:16.898026 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 71/154] 10.222.0.16 () {56 vars in 1099 bytes} [Thu May 26 12:20:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:20:16.898703 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fdf7f2-061d-4bcd-8409-54bdeb400326 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:16.899537 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fdf7f2-061d-4bcd-8409-54bdeb400326 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:16.899537 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fdf7f2-061d-4bcd-8409-54bdeb400326 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:16.900681 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 72/155] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:20:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:16.903061 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f39d9-63f4-4d04-817f-22bba5407765 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:16.907215 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fdf7f2-061d-4bcd-8409-54bdeb400326 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:16.952703 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e57e5a1-d714-4bee-8235-f1bf24e74584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:16.953540 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e57e5a1-d714-4bee-8235-f1bf24e74584 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:16.953824 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e57e5a1-d714-4bee-8235-f1bf24e74584 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:16.954174 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e57e5a1-d714-4bee-8235-f1bf24e74584 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:16.969143 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e57e5a1-d714-4bee-8235-f1bf24e74584 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:20:16.977041 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-8e57e5a1-d714-4bee-8235-f1bf24e74584 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:20:16.977041 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:16.977041 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:16.977041 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:16.977041 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:16.977041 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:16.977041 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:16.977041 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:16.977041 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:16.977041 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:16.977041 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:16.977041 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:16.977041 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:20:16.977041 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:20:16.977041 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:20:16.977041 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:20:16.978077 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:20:16.978077 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:20:16.978077 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:20:16.978077 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:20:16.978077 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:16.978077 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:16.978077 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:16.978077 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:16.978077 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:16.978077 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:16.978077 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:16.978077 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:20:16.978077 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:16.978077 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:16.978077 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:16.978077 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:16.978866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:16.978866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:16.978866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:16.978866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:16.978866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:20:16.978866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:20:16.978866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:20:16.978866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:20:16.978866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:20:16.978866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:20:16.978866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:20:16.978866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:20:16.978866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 84/156] 10.222.0.16 () {56 vars in 1096 bytes} [Thu May 26 12:20:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:20:16.984234 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06299f46-6177-4d2a-b234-dae07dc3db61 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:16.984530 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06299f46-6177-4d2a-b234-dae07dc3db61 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:16.984807 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06299f46-6177-4d2a-b234-dae07dc3db61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:17.004253 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-06299f46-6177-4d2a-b234-dae07dc3db61 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:17.005477 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-06299f46-6177-4d2a-b234-dae07dc3db61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:17.008075 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:17.054432 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fdf7f2-061d-4bcd-8409-54bdeb400326 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:17.088178 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 85/157] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:20:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:20:17.089205 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06299f46-6177-4d2a-b234-dae07dc3db61 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:17.102791 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ab43f-5e4a-4f5d-8383-9bab7ddf0d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:17.104031 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ab43f-5e4a-4f5d-8383-9bab7ddf0d19 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:17.104582 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ab43f-5e4a-4f5d-8383-9bab7ddf0d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:17.105225 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ab43f-5e4a-4f5d-8383-9bab7ddf0d19 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:17.106565 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23ab43f-5e4a-4f5d-8383-9bab7ddf0d19 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:17.107350 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23ab43f-5e4a-4f5d-8383-9bab7ddf0d19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:17.109130 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23ab43f-5e4a-4f5d-8383-9bab7ddf0d19 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:17.119738 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 73/158] 10.222.0.16 () {56 vars in 1101 bytes} [Thu May 26 12:20:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:17.121382 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d3fb8-c7d2-44bd-985a-59e3f2b13bd3 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:17.122027 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d3fb8-c7d2-44bd-985a-59e3f2b13bd3 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:17.122518 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d3fb8-c7d2-44bd-985a-59e3f2b13bd3 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:17.123991 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 74/159] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:20:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:17.125568 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d3fb8-c7d2-44bd-985a-59e3f2b13bd3 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:17.153823 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:17.203480 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06299f46-6177-4d2a-b234-dae07dc3db61 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:17.242635 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c347a0f-644b-4580-8bc7-fcf559e8fc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:17.243318 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c347a0f-644b-4580-8bc7-fcf559e8fc1d None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:17.243602 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c347a0f-644b-4580-8bc7-fcf559e8fc1d None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:17.243877 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c347a0f-644b-4580-8bc7-fcf559e8fc1d None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:17.244629 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c347a0f-644b-4580-8bc7-fcf559e8fc1d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:17.244968 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c347a0f-644b-4580-8bc7-fcf559e8fc1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:17.246604 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c347a0f-644b-4580-8bc7-fcf559e8fc1d None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:17.256882 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 86/160] 10.222.0.16 () {56 vars in 1099 bytes} [Thu May 26 12:20:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:17.257532 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c347a0f-644b-4580-8bc7-fcf559e8fc1d None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:17.342538 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d3fb8-c7d2-44bd-985a-59e3f2b13bd3 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:17.402725 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c154f2-a820-4e1a-8a30-f3346df8ab1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:17.403532 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c154f2-a820-4e1a-8a30-f3346df8ab1f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:17.403815 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c154f2-a820-4e1a-8a30-f3346df8ab1f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:17.404092 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c154f2-a820-4e1a-8a30-f3346df8ab1f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:17.407536 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:17.419596 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c347a0f-644b-4580-8bc7-fcf559e8fc1d None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:17.425086 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c154f2-a820-4e1a-8a30-f3346df8ab1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:20:17.433133 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-41c154f2-a820-4e1a-8a30-f3346df8ab1f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:20:17.433133 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:17.433133 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:17.433133 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:17.433133 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:17.433133 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:17.433133 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:17.433133 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:17.433133 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:17.433133 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:17.433133 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:17.433133 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:17.433133 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:20:17.433133 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:20:17.433133 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:20:17.433133 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:20:17.434081 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:20:17.434081 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:20:17.434081 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:20:17.434081 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:20:17.434081 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:17.434081 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:17.434081 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:17.434081 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:17.434081 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:17.434081 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:17.434081 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:17.434081 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:20:17.434081 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:17.434081 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:17.434081 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:17.434081 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:17.434861 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:17.434861 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:17.434861 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:17.434861 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:17.434861 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:20:17.434861 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:20:17.434861 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:20:17.434861 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:20:17.434861 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:20:17.434861 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:20:17.434861 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:20:17.434861 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:20:17.434861 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 75/161] 10.222.0.16 () {56 vars in 1099 bytes} [Thu May 26 12:20:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:20:17.436063 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f94cfa-6c00-4c3a-be45-7da26364191b None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:17.440381 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f94cfa-6c00-4c3a-be45-7da26364191b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:17.440665 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f94cfa-6c00-4c3a-be45-7da26364191b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:17.457826 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:17.478892 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a4f94cfa-6c00-4c3a-be45-7da26364191b None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:17.480109 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a4f94cfa-6c00-4c3a-be45-7da26364191b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:17.501633 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9595848-8b01-4a03-982d-d97c04e011f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:17.502448 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9595848-8b01-4a03-982d-d97c04e011f4 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:17.502728 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9595848-8b01-4a03-982d-d97c04e011f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:17.503004 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9595848-8b01-4a03-982d-d97c04e011f4 None admin] PATH_INFO: `/v3/users/f227769089e8416f9b64e59fe2e31b0b` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:17.504255 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9595848-8b01-4a03-982d-d97c04e011f4 None admin] RBAC: Authorizing `identity:get_user(user_id=f227769089e8416f9b64e59fe2e31b0b)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:17.505810 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9595848-8b01-4a03-982d-d97c04e011f4 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:17.507474 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 87/162] 10.222.0.16 () {56 vars in 1177 bytes} [Thu May 26 12:20:17 2022] GET /identity/v3/users/f227769089e8416f9b64e59fe2e31b0b => generated 289 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:17.512600 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9595848-8b01-4a03-982d-d97c04e011f4 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:17.564918 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 76/163] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:20:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:20:17.566024 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f94cfa-6c00-4c3a-be45-7da26364191b None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:17.652297 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9595848-8b01-4a03-982d-d97c04e011f4 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:17.688747 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262792f-99e2-4e92-9464-da3f51a43f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:17.689931 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262792f-99e2-4e92-9464-da3f51a43f53 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:17.690318 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262792f-99e2-4e92-9464-da3f51a43f53 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:17.690721 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262792f-99e2-4e92-9464-da3f51a43f53 None admin] PATH_INFO: `/v3/users/25194ab74edc4c009c8aaa9efa80932f` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:17.692032 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d262792f-99e2-4e92-9464-da3f51a43f53 None admin] RBAC: Authorizing `identity:get_user(user_id=25194ab74edc4c009c8aaa9efa80932f)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:17.693727 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d262792f-99e2-4e92-9464-da3f51a43f53 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:17.695997 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 88/164] 10.222.0.16 () {56 vars in 1177 bytes} [Thu May 26 12:20:17 2022] GET /identity/v3/users/25194ab74edc4c009c8aaa9efa80932f => generated 247 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:17.697054 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262792f-99e2-4e92-9464-da3f51a43f53 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:17.765391 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:17.785589 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f94cfa-6c00-4c3a-be45-7da26364191b None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:17.806753 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262792f-99e2-4e92-9464-da3f51a43f53 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:17.832513 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:17.846163 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dbc939-4ea7-4245-9abc-0f64b9be3f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:17.847404 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dbc939-4ea7-4245-9abc-0f64b9be3f2d None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:17.847888 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dbc939-4ea7-4245-9abc-0f64b9be3f2d None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:17.848358 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dbc939-4ea7-4245-9abc-0f64b9be3f2d None admin] PATH_INFO: `/v3/projects/6ae47773ffcf4aad9f7fb9bf16e40752` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:17.849822 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dbc939-4ea7-4245-9abc-0f64b9be3f2d None admin] RBAC: Authorizing `identity:get_project(project_id=6ae47773ffcf4aad9f7fb9bf16e40752)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:17.851599 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dbc939-4ea7-4245-9abc-0f64b9be3f2d None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:17.854226 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 89/165] 10.222.0.16 () {56 vars in 1186 bytes} [Thu May 26 12:20:17 2022] GET /identity/v3/projects/6ae47773ffcf4aad9f7fb9bf16e40752 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:17.855298 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dbc939-4ea7-4245-9abc-0f64b9be3f2d None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:17.868020 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd10c35-a74d-4829-a24d-7ba9837dd546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:17.868718 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd10c35-a74d-4829-a24d-7ba9837dd546 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:17.869039 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd10c35-a74d-4829-a24d-7ba9837dd546 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:17.869315 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd10c35-a74d-4829-a24d-7ba9837dd546 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:17.870265 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd10c35-a74d-4829-a24d-7ba9837dd546 None admin] RBAC: Adding query filter params (name=member) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:17.870493 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd10c35-a74d-4829-a24d-7ba9837dd546 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:17.871896 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd10c35-a74d-4829-a24d-7ba9837dd546 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:17.892382 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 77/166] 10.222.0.16 () {56 vars in 1101 bytes} [Thu May 26 12:20:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:17.893086 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd10c35-a74d-4829-a24d-7ba9837dd546 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:17.967029 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dbc939-4ea7-4245-9abc-0f64b9be3f2d None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:17.992609 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:18.003822 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4611a941-bc1b-48d3-a836-f350940bcb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:18.005036 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611a941-bc1b-48d3-a836-f350940bcb0e None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:18.005679 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611a941-bc1b-48d3-a836-f350940bcb0e None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:18.006164 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611a941-bc1b-48d3-a836-f350940bcb0e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:18.017866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4611a941-bc1b-48d3-a836-f350940bcb0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:20:18.026444 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-4611a941-bc1b-48d3-a836-f350940bcb0e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:20:18.026444 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:18.026444 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:18.026444 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:18.026444 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:18.026444 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:18.026444 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:18.026444 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:18.026444 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:18.026444 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:18.026444 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:18.026444 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:18.026444 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:20:18.026444 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:20:18.026444 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:20:18.026444 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:20:18.027295 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:20:18.027295 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:20:18.027295 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:20:18.027295 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:20:18.027295 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:18.027295 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:18.027295 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:18.027295 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:18.027295 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:18.027295 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:18.027295 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:18.027295 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:20:18.027295 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:18.027295 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:18.027295 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:18.027295 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:18.028093 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:18.028093 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:18.028093 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:18.028093 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:18.028093 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:20:18.028093 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:20:18.028093 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:20:18.028093 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:20:18.028093 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:20:18.028093 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:20:18.028093 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:20:18.028093 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:20:18.031077 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 90/167] 10.222.0.16 () {56 vars in 1114 bytes} [Thu May 26 12:20:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:20:18.036905 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4611a941-bc1b-48d3-a836-f350940bcb0e None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:18.114631 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd10c35-a74d-4829-a24d-7ba9837dd546 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:18.147137 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4611a941-bc1b-48d3-a836-f350940bcb0e None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:18.183870 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a7640-2619-41dc-93f0-2e4559d290ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:18.185335 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a7640-2619-41dc-93f0-2e4559d290ac None admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:18.185831 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a7640-2619-41dc-93f0-2e4559d290ac None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:18.186312 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a7640-2619-41dc-93f0-2e4559d290ac None admin] PATH_INFO: `/v3/projects/6ae47773ffcf4aad9f7fb9bf16e40752/users/f227769089e8416f9b64e59fe2e31b0b/roles/c23f3f2e6c7e4a259066d5527cd0ab25` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:18.188569 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23a7640-2619-41dc-93f0-2e4559d290ac None admin] RBAC: Authorizing `identity:create_grant(project_id=6ae47773ffcf4aad9f7fb9bf16e40752, user_id=f227769089e8416f9b64e59fe2e31b0b, role_id=c23f3f2e6c7e4a259066d5527cd0ab25)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:18.190407 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23a7640-2619-41dc-93f0-2e4559d290ac None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:18.207856 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 91/168] 10.222.0.16 () {58 vars in 1439 bytes} [Thu May 26 12:20:18 2022] PUT /identity/v3/projects/6ae47773ffcf4aad9f7fb9bf16e40752/users/f227769089e8416f9b64e59fe2e31b0b/roles/c23f3f2e6c7e4a259066d5527cd0ab25 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:20:18.209559 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a7640-2619-41dc-93f0-2e4559d290ac None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:18.245662 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e40a1d2-33df-4008-8b0c-84ee12091495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:18.246458 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40a1d2-33df-4008-8b0c-84ee12091495 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:18.246858 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40a1d2-33df-4008-8b0c-84ee12091495 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:18.247239 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40a1d2-33df-4008-8b0c-84ee12091495 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:18.277371 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:18.349172 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a7640-2619-41dc-93f0-2e4559d290ac None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:18.399141 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f53da3-6d45-4e4c-84a2-8e86263b89ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:18.400446 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f53da3-6d45-4e4c-84a2-8e86263b89ff None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:18.400980 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f53da3-6d45-4e4c-84a2-8e86263b89ff None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:18.401513 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f53da3-6d45-4e4c-84a2-8e86263b89ff None admin] PATH_INFO: `/v3/users/4069b216ae0743869ac1161864e0b3ff` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:18.403260 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f53da3-6d45-4e4c-84a2-8e86263b89ff None admin] RBAC: Authorizing `identity:get_user(user_id=4069b216ae0743869ac1161864e0b3ff)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:18.405173 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f53da3-6d45-4e4c-84a2-8e86263b89ff None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:18.407140 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 92/169] 10.222.0.16 () {56 vars in 1177 bytes} [Thu May 26 12:20:18 2022] GET /identity/v3/users/4069b216ae0743869ac1161864e0b3ff => generated 275 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:18.408820 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f53da3-6d45-4e4c-84a2-8e86263b89ff None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:18.450646 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:18.500683 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e40a1d2-33df-4008-8b0c-84ee12091495 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:18.506495 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e40a1d2-33df-4008-8b0c-84ee12091495 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:18.544739 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f53da3-6d45-4e4c-84a2-8e86263b89ff None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:18.569268 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:18.587929 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3cdb23-696e-4ac3-881f-447e909f532b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:18.588614 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3cdb23-696e-4ac3-881f-447e909f532b None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:18.588930 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3cdb23-696e-4ac3-881f-447e909f532b None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:18.589215 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3cdb23-696e-4ac3-881f-447e909f532b None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:18.590082 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3cdb23-696e-4ac3-881f-447e909f532b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:18.590705 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3cdb23-696e-4ac3-881f-447e909f532b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:18.592320 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3cdb23-696e-4ac3-881f-447e909f532b None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:18.602073 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 93/170] 10.222.0.16 () {56 vars in 1111 bytes} [Thu May 26 12:20:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:18.603007 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3cdb23-696e-4ac3-881f-447e909f532b None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:18.669268 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 78/171] 10.222.0.16 () {58 vars in 1282 bytes} [Thu May 26 12:20:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 776 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:20:18.670118 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e40a1d2-33df-4008-8b0c-84ee12091495 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:18.716806 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3cdb23-696e-4ac3-881f-447e909f532b None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:18.758726 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb71ec-48b3-4840-9c88-979731028876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:18.759386 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb71ec-48b3-4840-9c88-979731028876 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:18.759670 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb71ec-48b3-4840-9c88-979731028876 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:18.759947 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb71ec-48b3-4840-9c88-979731028876 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:18.823206 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:18.849202 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:18.854793 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e40a1d2-33df-4008-8b0c-84ee12091495 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:18.898253 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeb71ec-48b3-4840-9c88-979731028876 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:18.899744 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeb71ec-48b3-4840-9c88-979731028876 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:18.924646 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4479b6-3692-4c1e-93d7-089d927be542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:18.925563 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4479b6-3692-4c1e-93d7-089d927be542 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:18.925849 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4479b6-3692-4c1e-93d7-089d927be542 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:18.926125 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4479b6-3692-4c1e-93d7-089d927be542 None admin] PATH_INFO: `/v3/users/4069b216ae0743869ac1161864e0b3ff` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:18.928887 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4479b6-3692-4c1e-93d7-089d927be542 None admin] RBAC: Authorizing `identity:get_user(user_id=4069b216ae0743869ac1161864e0b3ff)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:18.930349 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4479b6-3692-4c1e-93d7-089d927be542 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:18.931988 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 79/172] 10.222.0.16 () {56 vars in 1177 bytes} [Thu May 26 12:20:18 2022] GET /identity/v3/users/4069b216ae0743869ac1161864e0b3ff => generated 275 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:18.932754 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4479b6-3692-4c1e-93d7-089d927be542 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:19.090006 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 94/173] 10.222.0.16 () {58 vars in 1282 bytes} [Thu May 26 12:20:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:20:19.092006 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb71ec-48b3-4840-9c88-979731028876 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:19.120050 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4479b6-3692-4c1e-93d7-089d927be542 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:19.184782 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d6ec51-6278-4a17-b3fb-8164baeec37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:19.186067 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6ec51-6278-4a17-b3fb-8164baeec37d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:19.186551 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6ec51-6278-4a17-b3fb-8164baeec37d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:19.187025 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6ec51-6278-4a17-b3fb-8164baeec37d None admin] PATH_INFO: `/v3/projects/6ae47773ffcf4aad9f7fb9bf16e40752` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:19.189125 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d6ec51-6278-4a17-b3fb-8164baeec37d None admin] RBAC: Authorizing `identity:get_project(project_id=6ae47773ffcf4aad9f7fb9bf16e40752)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:19.192064 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d6ec51-6278-4a17-b3fb-8164baeec37d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:19.195988 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 80/174] 10.222.0.16 () {56 vars in 1186 bytes} [Thu May 26 12:20:18 2022] GET /identity/v3/projects/6ae47773ffcf4aad9f7fb9bf16e40752 => generated 298 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:19.198600 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c418244-83d7-4007-afc5-3e2c692530a0 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:19.199896 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c418244-83d7-4007-afc5-3e2c692530a0 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:19.201293 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c418244-83d7-4007-afc5-3e2c692530a0 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:19.203902 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 81/175] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:20:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:19.205615 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c418244-83d7-4007-afc5-3e2c692530a0 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:19.228151 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:19.253676 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:19.268400 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb71ec-48b3-4840-9c88-979731028876 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:19.332511 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd3b7e-0774-4e4d-be56-129e1fcea90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:19.333194 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd3b7e-0774-4e4d-be56-129e1fcea90b None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:19.333475 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd3b7e-0774-4e4d-be56-129e1fcea90b None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:19.333748 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd3b7e-0774-4e4d-be56-129e1fcea90b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:19.381527 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c418244-83d7-4007-afc5-3e2c692530a0 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:19.417056 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9fda29-dff4-4394-aaf9-150c8c0da627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:19.417965 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fda29-dff4-4394-aaf9-150c8c0da627 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:19.418292 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fda29-dff4-4394-aaf9-150c8c0da627 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:19.418565 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fda29-dff4-4394-aaf9-150c8c0da627 None admin] PATH_INFO: `/v3/projects/2941055814804552be2880516801e30d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:19.419801 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9fda29-dff4-4394-aaf9-150c8c0da627 None admin] RBAC: Authorizing `identity:get_project(project_id=2941055814804552be2880516801e30d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:19.421404 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9fda29-dff4-4394-aaf9-150c8c0da627 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:19.423930 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 82/176] 10.222.0.16 () {56 vars in 1186 bytes} [Thu May 26 12:20:19 2022] GET /identity/v3/projects/2941055814804552be2880516801e30d => generated 312 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:19.424573 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9fda29-dff4-4394-aaf9-150c8c0da627 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:19.463630 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd3b7e-0774-4e4d-be56-129e1fcea90b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:19.465300 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd3b7e-0774-4e4d-be56-129e1fcea90b None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:19.553192 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:19.567961 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9fda29-dff4-4394-aaf9-150c8c0da627 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:19.629204 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:19.645061 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1272e34b-d734-4dc4-8fea-5e84c4d715bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:19.645639 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272e34b-d734-4dc4-8fea-5e84c4d715bb None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:19.645918 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272e34b-d734-4dc4-8fea-5e84c4d715bb None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:19.646195 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272e34b-d734-4dc4-8fea-5e84c4d715bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:19.647031 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1272e34b-d734-4dc4-8fea-5e84c4d715bb None admin] RBAC: Adding query filter params (role.id=1a8e523ecbc84d818c2a9af0fb54da74, scope.project.id=6ae47773ffcf4aad9f7fb9bf16e40752, user.id=25194ab74edc4c009c8aaa9efa80932f) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:19.647336 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1272e34b-d734-4dc4-8fea-5e84c4d715bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:19.648791 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1272e34b-d734-4dc4-8fea-5e84c4d715bb None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:19.662992 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 83/177] 10.222.0.16 () {56 vars in 1374 bytes} [Thu May 26 12:20:19 2022] GET /identity/v3/role_assignments?user.id=25194ab74edc4c009c8aaa9efa80932f&scope.project.id=6ae47773ffcf4aad9f7fb9bf16e40752&role.id=1a8e523ecbc84d818c2a9af0fb54da74 => generated 608 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:19.664251 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490eb1f-a443-492e-9ecf-17489a0c6b3f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:19.664599 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490eb1f-a443-492e-9ecf-17489a0c6b3f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:19.664904 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490eb1f-a443-492e-9ecf-17489a0c6b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:19.674429 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 95/178] 10.222.0.16 () {58 vars in 1282 bytes} [Thu May 26 12:20:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 583 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:20:19.675394 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd3b7e-0774-4e4d-be56-129e1fcea90b None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:19.714338 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-0490eb1f-a443-492e-9ecf-17489a0c6b3f None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:19.716857 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0490eb1f-a443-492e-9ecf-17489a0c6b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:19.827698 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 84/179] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:20:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:20:19.828907 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0490eb1f-a443-492e-9ecf-17489a0c6b3f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:19.886955 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd3b7e-0774-4e4d-be56-129e1fcea90b None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:19.937175 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea85f73-f5c1-4dc6-be73-665b6bd08019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:19.937755 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea85f73-f5c1-4dc6-be73-665b6bd08019 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:19.938036 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea85f73-f5c1-4dc6-be73-665b6bd08019 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:19.938370 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea85f73-f5c1-4dc6-be73-665b6bd08019 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:19.939233 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea85f73-f5c1-4dc6-be73-665b6bd08019 None admin] RBAC: Adding query filter params (role.id=b0bf2a578f0a4319b93dd3b8a26a96b7, scope.project.id=2941055814804552be2880516801e30d, user.id=4069b216ae0743869ac1161864e0b3ff) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:19.939544 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea85f73-f5c1-4dc6-be73-665b6bd08019 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:19.941046 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea85f73-f5c1-4dc6-be73-665b6bd08019 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:19.948663 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 96/180] 10.222.0.16 () {56 vars in 1374 bytes} [Thu May 26 12:20:19 2022] GET /identity/v3/role_assignments?user.id=4069b216ae0743869ac1161864e0b3ff&scope.project.id=2941055814804552be2880516801e30d&role.id=b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 608 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:19.954055 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:19.955083 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533fcd7-09bb-43e9-8e8c-c3189cbd3bcf None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:19.955371 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533fcd7-09bb-43e9-8e8c-c3189cbd3bcf None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:19.955641 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533fcd7-09bb-43e9-8e8c-c3189cbd3bcf None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:19.957383 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 97/181] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:20:19 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:19.957916 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6533fcd7-09bb-43e9-8e8c-c3189cbd3bcf None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:19.978316 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0490eb1f-a443-492e-9ecf-17489a0c6b3f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:20.022968 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6153414-cab1-431f-8366-5644d1d6e2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:20.025183 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6153414-cab1-431f-8366-5644d1d6e2d1 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:20.030764 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6153414-cab1-431f-8366-5644d1d6e2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:20.031200 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:20.031596 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6153414-cab1-431f-8366-5644d1d6e2d1 None admin] PATH_INFO: `/v3/projects/6ae47773ffcf4aad9f7fb9bf16e40752` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:20.033297 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6153414-cab1-431f-8366-5644d1d6e2d1 None admin] RBAC: Authorizing `identity:get_project(project_id=6ae47773ffcf4aad9f7fb9bf16e40752)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:20.035106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6153414-cab1-431f-8366-5644d1d6e2d1 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:20.037434 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 85/182] 10.222.0.16 () {56 vars in 1186 bytes} [Thu May 26 12:20:19 2022] GET /identity/v3/projects/6ae47773ffcf4aad9f7fb9bf16e40752 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:20.039096 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20260b88-a375-45d7-b845-2fbc3162062d None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:20.039552 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20260b88-a375-45d7-b845-2fbc3162062d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:20.040008 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20260b88-a375-45d7-b845-2fbc3162062d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:20.063121 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-20260b88-a375-45d7-b845-2fbc3162062d None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:20.064961 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-20260b88-a375-45d7-b845-2fbc3162062d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:20.127224 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6533fcd7-09bb-43e9-8e8c-c3189cbd3bcf None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:20.139128 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 86/183] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:20:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:20:20.140506 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecac44b-2b71-4026-a74b-b02003781c3e None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:20.140790 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecac44b-2b71-4026-a74b-b02003781c3e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:20.149319 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecac44b-2b71-4026-a74b-b02003781c3e None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:20.150850 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 87/184] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:20:20 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:20.154387 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecac44b-2b71-4026-a74b-b02003781c3e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:20.186519 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c249385-57e3-4e95-b04c-ecdc814ce49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:20.187824 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c249385-57e3-4e95-b04c-ecdc814ce49f None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:20.188475 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c249385-57e3-4e95-b04c-ecdc814ce49f None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:20.188999 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c249385-57e3-4e95-b04c-ecdc814ce49f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:20.204426 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c249385-57e3-4e95-b04c-ecdc814ce49f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:20:20.214386 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-0c249385-57e3-4e95-b04c-ecdc814ce49f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:20:20.214386 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:20.214386 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:20.214386 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:20.214386 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:20.214386 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:20.214386 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:20.214386 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:20.214386 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:20.214386 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:20.214386 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:20.214386 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:20.214386 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:20:20.214386 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:20:20.214386 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:20:20.214386 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:20:20.215289 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:20:20.215289 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:20:20.215289 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:20:20.215289 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:20:20.215289 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:20.215289 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:20.215289 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:20.215289 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:20.215289 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:20.215289 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:20.215289 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:20.215289 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:20:20.215289 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:20.215289 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:20.215289 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:20.215289 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:20.216340 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:20.216340 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:20.216340 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:20.216340 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:20.216340 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:20:20.216340 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:20:20.216340 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:20:20.216340 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:20:20.216340 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:20:20.216340 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:20:20.216340 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:20:20.216340 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:20:20.220550 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 98/185] 10.222.0.16 () {56 vars in 1096 bytes} [Thu May 26 12:20:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:20:20.222240 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b55d0-dcda-41b8-b602-fb4e171c8ac6 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:20.223055 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b55d0-dcda-41b8-b602-fb4e171c8ac6 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:20.223504 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b55d0-dcda-41b8-b602-fb4e171c8ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:20.243672 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-192b55d0-dcda-41b8-b602-fb4e171c8ac6 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:20.245345 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-192b55d0-dcda-41b8-b602-fb4e171c8ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:20.268343 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:20.297675 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecac44b-2b71-4026-a74b-b02003781c3e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:20.333639 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 99/186] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:20:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:20:20.334731 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b55d0-dcda-41b8-b602-fb4e171c8ac6 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:20.345498 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a46dfa3-b73e-4801-bd8c-c601010ddbc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:20.346535 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46dfa3-b73e-4801-bd8c-c601010ddbc4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:20.347017 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46dfa3-b73e-4801-bd8c-c601010ddbc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:20.347489 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46dfa3-b73e-4801-bd8c-c601010ddbc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:20.348613 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a46dfa3-b73e-4801-bd8c-c601010ddbc4 None admin] RBAC: Adding query filter params (role.id=e0f421b5486c47aebb20ea10342cb1e3, scope.project.id=6ae47773ffcf4aad9f7fb9bf16e40752, user.id=4069b216ae0743869ac1161864e0b3ff) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:20.349178 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a46dfa3-b73e-4801-bd8c-c601010ddbc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:20.350983 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a46dfa3-b73e-4801-bd8c-c601010ddbc4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:20.357814 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 88/187] 10.222.0.16 () {56 vars in 1374 bytes} [Thu May 26 12:20:20 2022] GET /identity/v3/role_assignments?user.id=4069b216ae0743869ac1161864e0b3ff&scope.project.id=6ae47773ffcf4aad9f7fb9bf16e40752&role.id=e0f421b5486c47aebb20ea10342cb1e3 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:20.364628 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a46dfa3-b73e-4801-bd8c-c601010ddbc4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:20.365348 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:20.470558 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b55d0-dcda-41b8-b602-fb4e171c8ac6 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:20.499346 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a46dfa3-b73e-4801-bd8c-c601010ddbc4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:20.519875 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e7001c-406f-4388-9134-81c259eba26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:20.521108 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e7001c-406f-4388-9134-81c259eba26b None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:20.521391 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e7001c-406f-4388-9134-81c259eba26b None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:20.521665 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e7001c-406f-4388-9134-81c259eba26b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:20.537469 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e7001c-406f-4388-9134-81c259eba26b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:20:20.539455 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d6a48-6878-47d4-ab34-28367057164b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:20.540240 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d6a48-6878-47d4-ab34-28367057164b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:20.542001 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d6a48-6878-47d4-ab34-28367057164b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:20.542001 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d6a48-6878-47d4-ab34-28367057164b None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:20.542001 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0d6a48-6878-47d4-ab34-28367057164b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:20.542280 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0d6a48-6878-47d4-ab34-28367057164b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:20.544420 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0d6a48-6878-47d4-ab34-28367057164b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:20.546387 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-c9e7001c-406f-4388-9134-81c259eba26b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:20:20.546387 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:20.546387 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:20.546387 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:20.546387 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:20.546387 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:20.546387 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:20.546387 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:20.546387 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:20.546387 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:20.546387 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:20.546387 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:20.546387 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:20:20.546387 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:20:20.546387 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:20:20.546387 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:20:20.547349 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:20:20.547349 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:20:20.547349 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:20:20.547349 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:20:20.547349 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:20.547349 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:20.547349 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:20.547349 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:20.547349 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:20.547349 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:20.547349 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:20.547349 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:20:20.547349 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:20.547349 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:20.547349 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:20.547349 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:20.549247 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:20.549247 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:20.549247 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:20.549247 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:20.549247 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:20:20.549247 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:20:20.549247 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:20:20.549247 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:20:20.549247 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:20:20.549247 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:20:20.549247 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:20:20.549247 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:20:20.549247 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 100/188] 10.222.0.16 () {56 vars in 1114 bytes} [Thu May 26 12:20:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:20:20.549247 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e7001c-406f-4388-9134-81c259eba26b None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:20.558541 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 89/189] 10.222.0.16 () {56 vars in 1099 bytes} [Thu May 26 12:20:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:20.560230 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d6a48-6878-47d4-ab34-28367057164b None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:20.576445 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:20.658113 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:20.673561 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e7001c-406f-4388-9134-81c259eba26b None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:20.687570 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d6a48-6878-47d4-ab34-28367057164b None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:20.717692 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f19c2-4587-41b4-8621-c46ad6ec7989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:20.718729 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f19c2-4587-41b4-8621-c46ad6ec7989 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:20.719010 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f19c2-4587-41b4-8621-c46ad6ec7989 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:20.719444 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f19c2-4587-41b4-8621-c46ad6ec7989 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:20.720690 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812f19c2-4587-41b4-8621-c46ad6ec7989 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:20.722123 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812f19c2-4587-41b4-8621-c46ad6ec7989 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:20.727921 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 101/190] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:20:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:20.727921 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f19c2-4587-41b4-8621-c46ad6ec7989 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:20.732892 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2d2b6-9969-476d-8d22-7172b5fda7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:20.733610 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2d2b6-9969-476d-8d22-7172b5fda7dd None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:20.733892 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2d2b6-9969-476d-8d22-7172b5fda7dd None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:20.734165 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2d2b6-9969-476d-8d22-7172b5fda7dd None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:20.735037 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e2d2b6-9969-476d-8d22-7172b5fda7dd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:20.735875 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e2d2b6-9969-476d-8d22-7172b5fda7dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:20.737302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e2d2b6-9969-476d-8d22-7172b5fda7dd None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:20.746596 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 90/191] 10.222.0.16 () {56 vars in 1111 bytes} [Thu May 26 12:20:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:20.747253 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2d2b6-9969-476d-8d22-7172b5fda7dd None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:20.826798 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:20.836136 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f19c2-4587-41b4-8621-c46ad6ec7989 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:20.864574 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2d2b6-9969-476d-8d22-7172b5fda7dd None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:20.876102 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2e9a1-c322-464c-8689-81a8eb7c0e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:20.877199 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2e9a1-c322-464c-8689-81a8eb7c0e81 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:20.877481 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2e9a1-c322-464c-8689-81a8eb7c0e81 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:20.877752 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2e9a1-c322-464c-8689-81a8eb7c0e81 None admin] PATH_INFO: `/v3/users/c08563e8db794b6ba52239b8754737ae` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:20.893537 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac2e9a1-c322-464c-8689-81a8eb7c0e81 None admin] RBAC: Authorizing `identity:get_user(user_id=c08563e8db794b6ba52239b8754737ae)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:20.895072 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac2e9a1-c322-464c-8689-81a8eb7c0e81 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:20.901009 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 102/192] 10.222.0.16 () {56 vars in 1177 bytes} [Thu May 26 12:20:20 2022] GET /identity/v3/users/c08563e8db794b6ba52239b8754737ae => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:20.901009 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2e9a1-c322-464c-8689-81a8eb7c0e81 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:20.903236 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17922af5-431c-4bbe-a984-d1f28a7e8722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:20.903909 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17922af5-431c-4bbe-a984-d1f28a7e8722 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:20.904194 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17922af5-431c-4bbe-a984-d1f28a7e8722 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:20.905202 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17922af5-431c-4bbe-a984-d1f28a7e8722 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:20.905202 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17922af5-431c-4bbe-a984-d1f28a7e8722 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:20.906649 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17922af5-431c-4bbe-a984-d1f28a7e8722 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:20.918157 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:20.929956 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 91/193] 10.222.0.16 () {60 vars in 1132 bytes} [Thu May 26 12:20:20 2022] POST /identity/v3/users => generated 297 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:20:20.930939 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17922af5-431c-4bbe-a984-d1f28a7e8722 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:21.043628 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17922af5-431c-4bbe-a984-d1f28a7e8722 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:21.052111 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2e9a1-c322-464c-8689-81a8eb7c0e81 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:21.073860 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:21.083718 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828c46a-4068-4ab8-b702-1f8d8c25799b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:21.084377 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828c46a-4068-4ab8-b702-1f8d8c25799b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:21.084689 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828c46a-4068-4ab8-b702-1f8d8c25799b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:21.084984 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828c46a-4068-4ab8-b702-1f8d8c25799b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:21.092926 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299c4ab-cea1-46ec-bad6-c267330700f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:21.093819 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299c4ab-cea1-46ec-bad6-c267330700f4 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:21.094131 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299c4ab-cea1-46ec-bad6-c267330700f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:21.094409 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299c4ab-cea1-46ec-bad6-c267330700f4 None admin] PATH_INFO: `/v3/users/c08563e8db794b6ba52239b8754737ae` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:21.096214 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5299c4ab-cea1-46ec-bad6-c267330700f4 None admin] RBAC: Authorizing `identity:get_user(user_id=c08563e8db794b6ba52239b8754737ae)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:21.097722 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5299c4ab-cea1-46ec-bad6-c267330700f4 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:21.103686 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 103/194] 10.222.0.16 () {56 vars in 1177 bytes} [Thu May 26 12:20:20 2022] GET /identity/v3/users/c08563e8db794b6ba52239b8754737ae => generated 283 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:21.103686 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9c0cc-82a8-4cec-9010-386c2edb189d None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:21.103686 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9c0cc-82a8-4cec-9010-386c2edb189d None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:21.103686 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9c0cc-82a8-4cec-9010-386c2edb189d None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:21.103686 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 104/195] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:20:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:21.105915 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a9c0cc-82a8-4cec-9010-386c2edb189d None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:21.170479 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3828c46a-4068-4ab8-b702-1f8d8c25799b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:21.171974 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3828c46a-4068-4ab8-b702-1f8d8c25799b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:21.202576 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:21.226647 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a9c0cc-82a8-4cec-9010-386c2edb189d None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:21.271483 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bae29f-84d6-47eb-bfde-b4237be61f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:21.272133 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bae29f-84d6-47eb-bfde-b4237be61f54 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:21.272415 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bae29f-84d6-47eb-bfde-b4237be61f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:21.272688 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bae29f-84d6-47eb-bfde-b4237be61f54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:21.301187 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 92/196] 10.222.0.16 () {58 vars in 1282 bytes} [Thu May 26 12:20:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:20:21.303784 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d34a1-e256-41f7-8086-817d0a42b630 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:21.304298 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d34a1-e256-41f7-8086-817d0a42b630 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:21.304790 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d34a1-e256-41f7-8086-817d0a42b630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:21.327049 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-fb3d34a1-e256-41f7-8086-817d0a42b630 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:21.328792 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-fb3d34a1-e256-41f7-8086-817d0a42b630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:21.359420 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bae29f-84d6-47eb-bfde-b4237be61f54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:21.361177 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:21.361988 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bae29f-84d6-47eb-bfde-b4237be61f54 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:21.416312 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 93/197] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:20:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:20:21.417414 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d34a1-e256-41f7-8086-817d0a42b630 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:21.472251 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:21.494624 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 105/198] 10.222.0.16 () {58 vars in 1282 bytes} [Thu May 26 12:20:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:20:21.495467 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bae29f-84d6-47eb-bfde-b4237be61f54 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:21.534597 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d34a1-e256-41f7-8086-817d0a42b630 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:21.569901 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0623f29-869c-4c93-b8b6-09a314a1cd2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:21.570856 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0623f29-869c-4c93-b8b6-09a314a1cd2c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:21.571249 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0623f29-869c-4c93-b8b6-09a314a1cd2c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:21.571634 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0623f29-869c-4c93-b8b6-09a314a1cd2c None admin] PATH_INFO: `/v3/projects/b7b56cecd1b744e7aa956f6480beb5cf` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:21.573130 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0623f29-869c-4c93-b8b6-09a314a1cd2c None admin] RBAC: Authorizing `identity:get_project(project_id=b7b56cecd1b744e7aa956f6480beb5cf)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:21.574717 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0623f29-869c-4c93-b8b6-09a314a1cd2c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:21.576538 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 94/199] 10.222.0.16 () {56 vars in 1186 bytes} [Thu May 26 12:20:21 2022] GET /identity/v3/projects/b7b56cecd1b744e7aa956f6480beb5cf => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:21.577432 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0623f29-869c-4c93-b8b6-09a314a1cd2c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:21.604491 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:21.613128 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bae29f-84d6-47eb-bfde-b4237be61f54 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:21.657197 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b12680b-0c6b-41aa-9162-4eaf84da3e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:21.657995 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12680b-0c6b-41aa-9162-4eaf84da3e24 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:21.658276 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12680b-0c6b-41aa-9162-4eaf84da3e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:21.658810 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12680b-0c6b-41aa-9162-4eaf84da3e24 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:21.671732 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b12680b-0c6b-41aa-9162-4eaf84da3e24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:20:21.687053 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-6b12680b-0c6b-41aa-9162-4eaf84da3e24 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:20:21.687053 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:21.687053 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:21.687053 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:21.687053 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:21.687053 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:21.687053 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:21.687053 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:21.687053 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:21.687053 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:21.687053 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:21.687053 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:21.687053 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:20:21.687053 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:20:21.687053 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:20:21.687053 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:20:21.687987 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:20:21.687987 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:20:21.687987 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:20:21.687987 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:20:21.687987 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:21.687987 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:21.687987 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:21.687987 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:21.687987 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:21.687987 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:21.687987 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:21.687987 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:20:21.687987 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:21.687987 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:21.687987 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:21.687987 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:21.689371 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:21.689371 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:21.689371 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:21.689371 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:21.689371 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:20:21.689371 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:20:21.689371 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:20:21.689371 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:20:21.689371 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:20:21.689371 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:20:21.689371 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:20:21.689371 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:20:21.689371 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 106/200] 10.222.0.16 () {56 vars in 1099 bytes} [Thu May 26 12:20:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:20:21.690020 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b12680b-0c6b-41aa-9162-4eaf84da3e24 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:21.694636 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0623f29-869c-4c93-b8b6-09a314a1cd2c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:21.737963 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26026ee-2e2f-4841-b461-02bef39a0a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:21.738835 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26026ee-2e2f-4841-b461-02bef39a0a03 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:21.739168 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26026ee-2e2f-4841-b461-02bef39a0a03 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:21.739445 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26026ee-2e2f-4841-b461-02bef39a0a03 None admin] PATH_INFO: `/v3/projects/b7b56cecd1b744e7aa956f6480beb5cf` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:21.740808 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26026ee-2e2f-4841-b461-02bef39a0a03 None admin] RBAC: Authorizing `identity:get_project(project_id=b7b56cecd1b744e7aa956f6480beb5cf)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:21.742513 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26026ee-2e2f-4841-b461-02bef39a0a03 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:21.743716 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:21.756955 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 95/201] 10.222.0.16 () {56 vars in 1186 bytes} [Thu May 26 12:20:21 2022] GET /identity/v3/projects/b7b56cecd1b744e7aa956f6480beb5cf => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:21.756955 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26026ee-2e2f-4841-b461-02bef39a0a03 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:21.805158 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b12680b-0c6b-41aa-9162-4eaf84da3e24 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:21.841095 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc587541-6fac-4299-856c-a879c4d977db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:21.842188 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc587541-6fac-4299-856c-a879c4d977db None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:21.842188 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc587541-6fac-4299-856c-a879c4d977db None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:21.842535 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc587541-6fac-4299-856c-a879c4d977db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:21.843490 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc587541-6fac-4299-856c-a879c4d977db None admin] RBAC: Adding query filter params (role.id=1a8e523ecbc84d818c2a9af0fb54da74, scope.project.id=b7b56cecd1b744e7aa956f6480beb5cf, user.id=c08563e8db794b6ba52239b8754737ae) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:21.843914 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc587541-6fac-4299-856c-a879c4d977db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:21.846052 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc587541-6fac-4299-856c-a879c4d977db None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:21.856863 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 107/202] 10.222.0.16 () {56 vars in 1374 bytes} [Thu May 26 12:20:21 2022] GET /identity/v3/role_assignments?user.id=c08563e8db794b6ba52239b8754737ae&scope.project.id=b7b56cecd1b744e7aa956f6480beb5cf&role.id=1a8e523ecbc84d818c2a9af0fb54da74 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:21.856863 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc587541-6fac-4299-856c-a879c4d977db None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:21.877107 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:21.889957 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26026ee-2e2f-4841-b461-02bef39a0a03 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:21.949973 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa494e4e-9ff4-4bf7-b198-cd8fe3328505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:21.951082 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa494e4e-9ff4-4bf7-b198-cd8fe3328505 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:21.951711 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa494e4e-9ff4-4bf7-b198-cd8fe3328505 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:21.952293 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa494e4e-9ff4-4bf7-b198-cd8fe3328505 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:21.953381 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa494e4e-9ff4-4bf7-b198-cd8fe3328505 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:21.954453 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa494e4e-9ff4-4bf7-b198-cd8fe3328505 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:21.956110 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa494e4e-9ff4-4bf7-b198-cd8fe3328505 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:21.966401 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 96/203] 10.222.0.16 () {56 vars in 1101 bytes} [Thu May 26 12:20:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:21.974304 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa494e4e-9ff4-4bf7-b198-cd8fe3328505 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:22.025372 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc587541-6fac-4299-856c-a879c4d977db None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:22.041566 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:22.127008 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814d4cd-d242-477e-b6b6-79f04febd1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:22.132332 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814d4cd-d242-477e-b6b6-79f04febd1ad None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:22.132332 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814d4cd-d242-477e-b6b6-79f04febd1ad None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:22.132332 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814d4cd-d242-477e-b6b6-79f04febd1ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:22.132332 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f814d4cd-d242-477e-b6b6-79f04febd1ad None admin] RBAC: Adding query filter params (role.id=e0f421b5486c47aebb20ea10342cb1e3, scope.project.id=b7b56cecd1b744e7aa956f6480beb5cf, user.id=c08563e8db794b6ba52239b8754737ae) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:22.132332 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f814d4cd-d242-477e-b6b6-79f04febd1ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:22.132332 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f814d4cd-d242-477e-b6b6-79f04febd1ad None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:22.140714 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 108/204] 10.222.0.16 () {56 vars in 1374 bytes} [Thu May 26 12:20:21 2022] GET /identity/v3/role_assignments?user.id=c08563e8db794b6ba52239b8754737ae&scope.project.id=b7b56cecd1b744e7aa956f6480beb5cf&role.id=e0f421b5486c47aebb20ea10342cb1e3 => generated 259 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:22.157747 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa494e4e-9ff4-4bf7-b198-cd8fe3328505 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:22.218928 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b6fe2-a7aa-4015-a6ac-d4889d04636f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:22.220007 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b6fe2-a7aa-4015-a6ac-d4889d04636f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:22.220294 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b6fe2-a7aa-4015-a6ac-d4889d04636f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:22.220567 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b6fe2-a7aa-4015-a6ac-d4889d04636f None admin] PATH_INFO: `/v3/users/f227769089e8416f9b64e59fe2e31b0b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:22.221921 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5b6fe2-a7aa-4015-a6ac-d4889d04636f None admin] RBAC: Authorizing `identity:get_user(user_id=f227769089e8416f9b64e59fe2e31b0b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:22.223405 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5b6fe2-a7aa-4015-a6ac-d4889d04636f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:22.225427 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 97/205] 10.222.0.16 () {56 vars in 1177 bytes} [Thu May 26 12:20:21 2022] GET /identity/v3/users/f227769089e8416f9b64e59fe2e31b0b => generated 289 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:22.231093 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814d4cd-d242-477e-b6b6-79f04febd1ad None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:22.389870 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814d4cd-d242-477e-b6b6-79f04febd1ad None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:22.442485 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d6464b-221c-48ef-bb08-aa523157075d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:22.443150 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6464b-221c-48ef-bb08-aa523157075d None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:22.443438 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6464b-221c-48ef-bb08-aa523157075d None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:22.443718 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6464b-221c-48ef-bb08-aa523157075d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:22.496216 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:22.545939 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d6464b-221c-48ef-bb08-aa523157075d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:22.547444 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d6464b-221c-48ef-bb08-aa523157075d None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:22.697695 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 109/206] 10.222.0.16 () {58 vars in 1282 bytes} [Thu May 26 12:20:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:20:22.704372 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b6fe2-a7aa-4015-a6ac-d4889d04636f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:22.735342 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:22.844608 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b6fe2-a7aa-4015-a6ac-d4889d04636f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:22.888001 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dffe3f-bf29-4df8-96bc-61b5611505a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:22.888889 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dffe3f-bf29-4df8-96bc-61b5611505a6 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:22.889181 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dffe3f-bf29-4df8-96bc-61b5611505a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:22.889462 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dffe3f-bf29-4df8-96bc-61b5611505a6 None admin] PATH_INFO: `/v3/projects/6ae47773ffcf4aad9f7fb9bf16e40752` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:22.893568 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dffe3f-bf29-4df8-96bc-61b5611505a6 None admin] RBAC: Authorizing `identity:get_project(project_id=6ae47773ffcf4aad9f7fb9bf16e40752)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:22.895044 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dffe3f-bf29-4df8-96bc-61b5611505a6 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:22.897267 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 98/207] 10.222.0.16 () {56 vars in 1186 bytes} [Thu May 26 12:20:22 2022] GET /identity/v3/projects/6ae47773ffcf4aad9f7fb9bf16e40752 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:22.903015 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d6464b-221c-48ef-bb08-aa523157075d None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:23.013155 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:23.060517 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d6464b-221c-48ef-bb08-aa523157075d None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:23.110718 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf9efa-21de-4749-8ccd-46d6a89af370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:23.111377 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf9efa-21de-4749-8ccd-46d6a89af370 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:23.111661 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf9efa-21de-4749-8ccd-46d6a89af370 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:23.111999 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf9efa-21de-4749-8ccd-46d6a89af370 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:23.112868 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecf9efa-21de-4749-8ccd-46d6a89af370 None admin] RBAC: Adding query filter params (role.id=c23f3f2e6c7e4a259066d5527cd0ab25, scope.project.id=6ae47773ffcf4aad9f7fb9bf16e40752, user.id=f227769089e8416f9b64e59fe2e31b0b) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:23.113191 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecf9efa-21de-4749-8ccd-46d6a89af370 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:23.114650 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecf9efa-21de-4749-8ccd-46d6a89af370 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:23.121474 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 110/208] 10.222.0.16 () {56 vars in 1374 bytes} [Thu May 26 12:20:22 2022] GET /identity/v3/role_assignments?user.id=f227769089e8416f9b64e59fe2e31b0b&scope.project.id=6ae47773ffcf4aad9f7fb9bf16e40752&role.id=c23f3f2e6c7e4a259066d5527cd0ab25 => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:23.408076 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5892f1-baaa-4c53-b965-1cb6f8237f62 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:23.408430 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5892f1-baaa-4c53-b965-1cb6f8237f62 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:23.408531 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5892f1-baaa-4c53-b965-1cb6f8237f62 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:23.410404 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 99/209] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:20:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:23.416148 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50569a-e70f-4115-9561-076118842c89 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:23.416440 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50569a-e70f-4115-9561-076118842c89 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:23.416719 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50569a-e70f-4115-9561-076118842c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:23.434272 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-0d50569a-e70f-4115-9561-076118842c89 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:23.435488 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-0d50569a-e70f-4115-9561-076118842c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:23.525092 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 111/210] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:20:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:20:23.544820 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5892f1-baaa-4c53-b965-1cb6f8237f62 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:23.638808 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:23.649969 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5892f1-baaa-4c53-b965-1cb6f8237f62 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:23.683896 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955d8ba4-99bf-413c-a8f7-427f2d6be29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:23.684660 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d8ba4-99bf-413c-a8f7-427f2d6be29d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:23.684973 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d8ba4-99bf-413c-a8f7-427f2d6be29d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:23.685256 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d8ba4-99bf-413c-a8f7-427f2d6be29d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:23.696943 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955d8ba4-99bf-413c-a8f7-427f2d6be29d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:20:23.705432 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-955d8ba4-99bf-413c-a8f7-427f2d6be29d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:20:23.705432 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:23.705432 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:23.705432 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:23.705432 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:23.705432 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:23.705432 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:23.705432 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:23.705432 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:23.705432 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:23.705432 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:23.705432 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:23.705432 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:20:23.705432 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:20:23.705432 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:20:23.705432 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:20:23.706747 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:20:23.706747 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:20:23.706747 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:20:23.706747 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:20:23.706747 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:23.706747 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:23.706747 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:23.706747 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:23.706747 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:23.706747 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:23.706747 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:23.706747 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:20:23.706747 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:23.706747 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:23.706747 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:23.706747 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:23.707543 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:23.707543 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:23.707543 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:23.707543 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:23.707543 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:20:23.707543 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:20:23.707543 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:20:23.707543 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:20:23.707543 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:20:23.707543 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:20:23.707543 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:20:23.707543 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:20:23.709411 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 100/211] 10.222.0.16 () {56 vars in 1099 bytes} [Thu May 26 12:20:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:20:23.712046 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011d025-9d87-4f66-ae7f-2a3ec393d55d None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:23.712465 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011d025-9d87-4f66-ae7f-2a3ec393d55d None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:23.713916 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011d025-9d87-4f66-ae7f-2a3ec393d55d None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:23.714642 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955d8ba4-99bf-413c-a8f7-427f2d6be29d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:23.716042 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 112/212] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:20:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:23.722598 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b409473-c70b-4668-9fdf-2502ea0777fd None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:23.723028 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b409473-c70b-4668-9fdf-2502ea0777fd None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:23.723402 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b409473-c70b-4668-9fdf-2502ea0777fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:23.745628 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-3b409473-c70b-4668-9fdf-2502ea0777fd None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:23.747174 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-3b409473-c70b-4668-9fdf-2502ea0777fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:23.826394 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:23.837098 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 113/213] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:20:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:20:23.863664 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955d8ba4-99bf-413c-a8f7-427f2d6be29d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:23.865752 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b409473-c70b-4668-9fdf-2502ea0777fd None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:23.899028 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21668cae-082d-407a-833d-5be16b3ea59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:23.899701 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21668cae-082d-407a-833d-5be16b3ea59b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:23.900090 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21668cae-082d-407a-833d-5be16b3ea59b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:23.900377 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21668cae-082d-407a-833d-5be16b3ea59b None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:23.901274 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21668cae-082d-407a-833d-5be16b3ea59b None admin] RBAC: Adding query filter params (name=member) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:23.901589 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21668cae-082d-407a-833d-5be16b3ea59b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:23.903021 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21668cae-082d-407a-833d-5be16b3ea59b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:23.912488 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 101/214] 10.222.0.16 () {56 vars in 1101 bytes} [Thu May 26 12:20:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:20:23.918187 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21668cae-082d-407a-833d-5be16b3ea59b None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:23.944241 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:23.978065 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b409473-c70b-4668-9fdf-2502ea0777fd None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:24.016001 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fdb026-885a-425e-9eb8-d8141d7a828c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:24.017596 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fdb026-885a-425e-9eb8-d8141d7a828c None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:24.017879 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fdb026-885a-425e-9eb8-d8141d7a828c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:24.018950 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fdb026-885a-425e-9eb8-d8141d7a828c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:24.020151 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fdb026-885a-425e-9eb8-d8141d7a828c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:24.021627 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fdb026-885a-425e-9eb8-d8141d7a828c None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:24.023562 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 114/215] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:20:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:20:24.028796 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fdb026-885a-425e-9eb8-d8141d7a828c None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:24.055473 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21668cae-082d-407a-833d-5be16b3ea59b None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:24.098399 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a325605-125b-45a7-b443-d4055e294c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:24.099364 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a325605-125b-45a7-b443-d4055e294c0f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:24.099725 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a325605-125b-45a7-b443-d4055e294c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:24.100069 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a325605-125b-45a7-b443-d4055e294c0f None admin] PATH_INFO: `/v3/users/28f9fb6152884e54b5f6ed365ab0f5d0` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:24.109750 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:24.118025 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a325605-125b-45a7-b443-d4055e294c0f None admin] RBAC: Authorizing `identity:get_user(user_id=28f9fb6152884e54b5f6ed365ab0f5d0)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:24.119630 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a325605-125b-45a7-b443-d4055e294c0f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:24.127815 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 102/216] 10.222.0.16 () {56 vars in 1177 bytes} [Thu May 26 12:20:23 2022] GET /identity/v3/users/28f9fb6152884e54b5f6ed365ab0f5d0 => generated 297 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:20:24.129028 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a325605-125b-45a7-b443-d4055e294c0f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:24.153713 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fdb026-885a-425e-9eb8-d8141d7a828c None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:24.197072 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aa4fe6-2f33-4a1b-b32d-2cce9b5dd679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:24.198206 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa4fe6-2f33-4a1b-b32d-2cce9b5dd679 None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:24.198576 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa4fe6-2f33-4a1b-b32d-2cce9b5dd679 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:24.199069 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa4fe6-2f33-4a1b-b32d-2cce9b5dd679 None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:24.199956 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aa4fe6-2f33-4a1b-b32d-2cce9b5dd679 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:24.201960 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aa4fe6-2f33-4a1b-b32d-2cce9b5dd679 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:24.211450 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:24.236049 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 115/217] 10.222.0.16 () {60 vars in 1132 bytes} [Thu May 26 12:20:24 2022] POST /identity/v3/users => generated 297 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:20:24.256616 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a325605-125b-45a7-b443-d4055e294c0f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:24.301314 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd46e0-3dfd-4fc9-9215-3479791eba3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:24.302474 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd46e0-3dfd-4fc9-9215-3479791eba3a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:24.303029 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd46e0-3dfd-4fc9-9215-3479791eba3a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:24.303581 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd46e0-3dfd-4fc9-9215-3479791eba3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:24.384738 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cd46e0-3dfd-4fc9-9215-3479791eba3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:24.386675 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cd46e0-3dfd-4fc9-9215-3479791eba3a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:24.463020 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:24.478870 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae63c87-32a1-491a-80f0-5cb07f52b620 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:24.479181 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae63c87-32a1-491a-80f0-5cb07f52b620 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:24.479435 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae63c87-32a1-491a-80f0-5cb07f52b620 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:24.483713 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 116/218] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:20:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:24.488700 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5e1f8-4e44-4c02-aeda-6edb6525121b None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:24.489029 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5e1f8-4e44-4c02-aeda-6edb6525121b None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:24.489307 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5e1f8-4e44-4c02-aeda-6edb6525121b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:24.508268 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-6bc5e1f8-4e44-4c02-aeda-6edb6525121b None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:24.508455 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 103/219] 10.222.0.16 () {58 vars in 1282 bytes} [Thu May 26 12:20:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:20:24.509610 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-6bc5e1f8-4e44-4c02-aeda-6edb6525121b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:24.513970 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd46e0-3dfd-4fc9-9215-3479791eba3a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:24.584503 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 117/220] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:20:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:20:24.607286 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5e1f8-4e44-4c02-aeda-6edb6525121b None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:24.618667 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd46e0-3dfd-4fc9-9215-3479791eba3a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:24.653728 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25e8bb3-c3ab-4725-8910-c5c0235cca8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:24.654599 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e8bb3-c3ab-4725-8910-c5c0235cca8f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:24.654885 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e8bb3-c3ab-4725-8910-c5c0235cca8f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:24.655169 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e8bb3-c3ab-4725-8910-c5c0235cca8f None admin] PATH_INFO: `/v3/projects/b7b56cecd1b744e7aa956f6480beb5cf` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:24.656409 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25e8bb3-c3ab-4725-8910-c5c0235cca8f None admin] RBAC: Authorizing `identity:get_project(project_id=b7b56cecd1b744e7aa956f6480beb5cf)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:24.658439 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25e8bb3-c3ab-4725-8910-c5c0235cca8f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:24.660463 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 104/221] 10.222.0.16 () {56 vars in 1186 bytes} [Thu May 26 12:20:24 2022] GET /identity/v3/projects/b7b56cecd1b744e7aa956f6480beb5cf => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:24.667683 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25e8bb3-c3ab-4725-8910-c5c0235cca8f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:24.671309 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:24.717126 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:24.746771 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5e1f8-4e44-4c02-aeda-6edb6525121b None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:24.793109 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25e8bb3-c3ab-4725-8910-c5c0235cca8f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:24.797027 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5464d8e1-f299-4437-9fba-4e23aa5fa848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:24.797874 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464d8e1-f299-4437-9fba-4e23aa5fa848 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:24.798161 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464d8e1-f299-4437-9fba-4e23aa5fa848 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:24.798441 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464d8e1-f299-4437-9fba-4e23aa5fa848 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:24.812663 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5464d8e1-f299-4437-9fba-4e23aa5fa848 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:20:24.824277 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-5464d8e1-f299-4437-9fba-4e23aa5fa848 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:20:24.824277 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:24.824277 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:24.824277 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:24.824277 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:24.824277 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:24.824277 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:24.824277 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:24.824277 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:24.824277 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:24.824277 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:24.824277 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:24.824277 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:20:24.824277 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:20:24.824277 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:20:24.824277 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:20:24.825206 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:20:24.825206 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:20:24.825206 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:20:24.825206 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:20:24.825206 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:24.825206 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:24.825206 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:24.825206 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:24.825206 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:24.825206 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:24.825206 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:24.825206 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:20:24.825206 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:24.825206 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:24.825206 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:24.825206 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:24.826001 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:24.826001 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:24.826001 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:24.826001 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:24.826001 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:20:24.826001 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:20:24.826001 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:20:24.826001 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:20:24.826001 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:20:24.826001 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:20:24.826001 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:20:24.826001 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:20:24.827164 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 118/222] 10.222.0.16 () {56 vars in 1096 bytes} [Thu May 26 12:20:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:20:24.832574 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5464d8e1-f299-4437-9fba-4e23aa5fa848 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:24.833240 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e1f1e-3996-48a3-b68c-86dd53980641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:24.833912 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e1f1e-3996-48a3-b68c-86dd53980641 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:24.834194 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e1f1e-3996-48a3-b68c-86dd53980641 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:24.834469 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e1f1e-3996-48a3-b68c-86dd53980641 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:24.835307 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876e1f1e-3996-48a3-b68c-86dd53980641 None admin] RBAC: Adding query filter params (role.id=b0bf2a578f0a4319b93dd3b8a26a96b7, scope.project.id=b7b56cecd1b744e7aa956f6480beb5cf, user.id=28f9fb6152884e54b5f6ed365ab0f5d0) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:24.835619 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876e1f1e-3996-48a3-b68c-86dd53980641 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:24.837095 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876e1f1e-3996-48a3-b68c-86dd53980641 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:24.851990 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 105/223] 10.222.0.16 () {56 vars in 1374 bytes} [Thu May 26 12:20:24 2022] GET /identity/v3/role_assignments?user.id=28f9fb6152884e54b5f6ed365ab0f5d0&scope.project.id=b7b56cecd1b744e7aa956f6480beb5cf&role.id=b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:24.967819 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5464d8e1-f299-4437-9fba-4e23aa5fa848 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:24.970505 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23b604-bf8f-4212-bb8e-5542897ff4e7 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:24.970794 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23b604-bf8f-4212-bb8e-5542897ff4e7 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:24.971076 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23b604-bf8f-4212-bb8e-5542897ff4e7 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:24.972481 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 106/224] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:20:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:24.977846 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:24.978340 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212cb82f-6668-4643-966a-5e504cbea5a0 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:24.978631 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212cb82f-6668-4643-966a-5e504cbea5a0 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:24.978967 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212cb82f-6668-4643-966a-5e504cbea5a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:25.009638 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b51574-f1f9-4578-8a95-dc61befe0b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:25.010482 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b51574-f1f9-4578-8a95-dc61befe0b07 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:25.010770 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b51574-f1f9-4578-8a95-dc61befe0b07 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:25.011047 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b51574-f1f9-4578-8a95-dc61befe0b07 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:25.011820 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b51574-f1f9-4578-8a95-dc61befe0b07 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:25.012272 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b51574-f1f9-4578-8a95-dc61befe0b07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:25.013739 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b51574-f1f9-4578-8a95-dc61befe0b07 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:25.017008 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-212cb82f-6668-4643-966a-5e504cbea5a0 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:25.018289 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-212cb82f-6668-4643-966a-5e504cbea5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:25.023708 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 119/225] 10.222.0.16 () {56 vars in 1099 bytes} [Thu May 26 12:20:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:20:25.030729 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b51574-f1f9-4578-8a95-dc61befe0b07 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:25.118235 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 107/226] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:20:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:20:25.143624 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212cb82f-6668-4643-966a-5e504cbea5a0 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:25.178130 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:25.197506 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b51574-f1f9-4578-8a95-dc61befe0b07 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:25.249569 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212cb82f-6668-4643-966a-5e504cbea5a0 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:25.271380 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b6a11-b7cf-4dc9-9f5c-1117ac1d9a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:25.272573 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b6a11-b7cf-4dc9-9f5c-1117ac1d9a9f None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:25.273156 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b6a11-b7cf-4dc9-9f5c-1117ac1d9a9f None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:25.273613 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b6a11-b7cf-4dc9-9f5c-1117ac1d9a9f None admin] PATH_INFO: `/v3/users/c08563e8db794b6ba52239b8754737ae` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:25.275076 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06b6a11-b7cf-4dc9-9f5c-1117ac1d9a9f None admin] RBAC: Authorizing `identity:get_user(user_id=c08563e8db794b6ba52239b8754737ae)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:25.276948 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06b6a11-b7cf-4dc9-9f5c-1117ac1d9a9f None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:25.284860 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 120/227] 10.222.0.16 () {56 vars in 1177 bytes} [Thu May 26 12:20:25 2022] GET /identity/v3/users/c08563e8db794b6ba52239b8754737ae => generated 283 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:20:25.285862 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b6a11-b7cf-4dc9-9f5c-1117ac1d9a9f None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:25.292358 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e018e-f30b-4e98-9037-12be22bbbd63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:25.293266 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e018e-f30b-4e98-9037-12be22bbbd63 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:25.293550 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e018e-f30b-4e98-9037-12be22bbbd63 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:25.293829 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e018e-f30b-4e98-9037-12be22bbbd63 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:25.305491 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37e018e-f30b-4e98-9037-12be22bbbd63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:20:25.314459 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-b37e018e-f30b-4e98-9037-12be22bbbd63 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:20:25.314459 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:25.314459 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:25.314459 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:25.314459 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:25.314459 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:25.314459 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:25.314459 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:25.314459 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:25.314459 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:25.314459 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:25.314459 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:25.314459 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:20:25.314459 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:20:25.314459 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:20:25.314459 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:20:25.315355 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:20:25.315355 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:20:25.315355 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:20:25.315355 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:20:25.315355 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:25.315355 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:25.315355 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:25.315355 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:25.315355 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:25.315355 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:25.315355 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:25.315355 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:20:25.315355 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:25.315355 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:25.315355 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:25.315355 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:25.316145 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:25.316145 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:25.316145 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:25.316145 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:25.316145 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:20:25.316145 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:20:25.316145 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:20:25.316145 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:20:25.316145 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:20:25.316145 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:20:25.316145 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:20:25.316145 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:20:25.320062 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 108/228] 10.222.0.16 () {56 vars in 1114 bytes} [Thu May 26 12:20:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:20:25.321985 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e018e-f30b-4e98-9037-12be22bbbd63 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:25.370554 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:25.437885 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:25.455639 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e018e-f30b-4e98-9037-12be22bbbd63 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:25.456180 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b6a11-b7cf-4dc9-9f5c-1117ac1d9a9f None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:25.492267 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebebb4a2-66c7-490e-b2d6-41db382c9648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:25.500921 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebebb4a2-66c7-490e-b2d6-41db382c9648 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:25.500921 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebebb4a2-66c7-490e-b2d6-41db382c9648 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:25.500921 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebebb4a2-66c7-490e-b2d6-41db382c9648 None admin] PATH_INFO: `/v3/projects/b7b56cecd1b744e7aa956f6480beb5cf` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:25.501742 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebebb4a2-66c7-490e-b2d6-41db382c9648 None admin] RBAC: Authorizing `identity:get_project(project_id=b7b56cecd1b744e7aa956f6480beb5cf)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:25.503663 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebebb4a2-66c7-490e-b2d6-41db382c9648 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:25.506209 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 121/229] 10.222.0.16 () {56 vars in 1186 bytes} [Thu May 26 12:20:25 2022] GET /identity/v3/projects/b7b56cecd1b744e7aa956f6480beb5cf => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:25.511856 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebebb4a2-66c7-490e-b2d6-41db382c9648 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:25.514200 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2770b36f-0cdc-4d63-9579-5c54049cb4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:25.514868 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770b36f-0cdc-4d63-9579-5c54049cb4ce None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:25.515190 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770b36f-0cdc-4d63-9579-5c54049cb4ce None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:25.515466 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770b36f-0cdc-4d63-9579-5c54049cb4ce None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:25.516231 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2770b36f-0cdc-4d63-9579-5c54049cb4ce None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:25.516569 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2770b36f-0cdc-4d63-9579-5c54049cb4ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:25.521122 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2770b36f-0cdc-4d63-9579-5c54049cb4ce None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:25.537691 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 109/230] 10.222.0.16 () {56 vars in 1111 bytes} [Thu May 26 12:20:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:25.543480 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2770b36f-0cdc-4d63-9579-5c54049cb4ce None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:25.669922 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2770b36f-0cdc-4d63-9579-5c54049cb4ce None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:25.674997 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebebb4a2-66c7-490e-b2d6-41db382c9648 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:25.690527 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:25.713808 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8220c0-2fea-4fc9-acd8-3b74b60ec5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:25.716260 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8220c0-2fea-4fc9-acd8-3b74b60ec5ee None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:25.716943 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8220c0-2fea-4fc9-acd8-3b74b60ec5ee None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:25.718578 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8220c0-2fea-4fc9-acd8-3b74b60ec5ee None admin] PATH_INFO: `/v3/users/c08563e8db794b6ba52239b8754737ae` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:25.722554 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8220c0-2fea-4fc9-acd8-3b74b60ec5ee None admin] RBAC: Authorizing `identity:get_user(user_id=c08563e8db794b6ba52239b8754737ae)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:25.725188 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8220c0-2fea-4fc9-acd8-3b74b60ec5ee None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:25.728455 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 110/231] 10.222.0.16 () {56 vars in 1177 bytes} [Thu May 26 12:20:25 2022] GET /identity/v3/users/c08563e8db794b6ba52239b8754737ae => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:25.738065 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8220c0-2fea-4fc9-acd8-3b74b60ec5ee None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:25.740020 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48485ef-ed11-46e0-bd50-a9f4017a16ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:25.741003 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48485ef-ed11-46e0-bd50-a9f4017a16ac None admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:25.741290 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48485ef-ed11-46e0-bd50-a9f4017a16ac None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:25.741557 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48485ef-ed11-46e0-bd50-a9f4017a16ac None admin] PATH_INFO: `/v3/projects/b7b56cecd1b744e7aa956f6480beb5cf/users/c08563e8db794b6ba52239b8754737ae/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:25.743773 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48485ef-ed11-46e0-bd50-a9f4017a16ac None admin] RBAC: Authorizing `identity:create_grant(project_id=b7b56cecd1b744e7aa956f6480beb5cf, user_id=c08563e8db794b6ba52239b8754737ae, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:25.745067 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48485ef-ed11-46e0-bd50-a9f4017a16ac None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:25.775117 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:25.778761 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 122/232] 10.222.0.16 () {58 vars in 1439 bytes} [Thu May 26 12:20:25 2022] PUT /identity/v3/projects/b7b56cecd1b744e7aa956f6480beb5cf/users/c08563e8db794b6ba52239b8754737ae/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:20:25.900731 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8220c0-2fea-4fc9-acd8-3b74b60ec5ee None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:25.953674 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3194cc56-3055-486a-9d47-f90e2814c39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:25.955095 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194cc56-3055-486a-9d47-f90e2814c39b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:25.955375 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194cc56-3055-486a-9d47-f90e2814c39b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:25.955648 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194cc56-3055-486a-9d47-f90e2814c39b None admin] PATH_INFO: `/v3/projects/b7b56cecd1b744e7aa956f6480beb5cf` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:25.961798 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3194cc56-3055-486a-9d47-f90e2814c39b None admin] RBAC: Authorizing `identity:get_project(project_id=b7b56cecd1b744e7aa956f6480beb5cf)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:25.963331 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3194cc56-3055-486a-9d47-f90e2814c39b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:25.965495 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 111/233] 10.222.0.16 () {56 vars in 1186 bytes} [Thu May 26 12:20:25 2022] GET /identity/v3/projects/b7b56cecd1b744e7aa956f6480beb5cf => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:25.972259 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48485ef-ed11-46e0-bd50-a9f4017a16ac None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:26.100163 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48485ef-ed11-46e0-bd50-a9f4017a16ac None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:26.138497 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bd7a0a-147c-4a9b-b583-290e3e5ab405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:26.139386 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd7a0a-147c-4a9b-b583-290e3e5ab405 None admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:26.139668 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd7a0a-147c-4a9b-b583-290e3e5ab405 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:26.139944 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd7a0a-147c-4a9b-b583-290e3e5ab405 None admin] PATH_INFO: `/v3/projects/b7b56cecd1b744e7aa956f6480beb5cf/users/c08563e8db794b6ba52239b8754737ae/roles/e0f421b5486c47aebb20ea10342cb1e3` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:26.143269 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bd7a0a-147c-4a9b-b583-290e3e5ab405 None admin] RBAC: Authorizing `identity:create_grant(project_id=b7b56cecd1b744e7aa956f6480beb5cf, user_id=c08563e8db794b6ba52239b8754737ae, role_id=e0f421b5486c47aebb20ea10342cb1e3)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:26.144701 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bd7a0a-147c-4a9b-b583-290e3e5ab405 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:26.159888 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 123/234] 10.222.0.16 () {58 vars in 1439 bytes} [Thu May 26 12:20:25 2022] PUT /identity/v3/projects/b7b56cecd1b744e7aa956f6480beb5cf/users/c08563e8db794b6ba52239b8754737ae/roles/e0f421b5486c47aebb20ea10342cb1e3 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:20:27.139902 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab444fb7-7f52-4a2c-b051-59b7e48588bd None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:27.140389 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab444fb7-7f52-4a2c-b051-59b7e48588bd None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:27.140389 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab444fb7-7f52-4a2c-b051-59b7e48588bd None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:27.142579 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 112/235] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:20:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:27.144905 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11273922-a44b-4bf0-8a90-9ff493f7c94f None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:27.145296 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11273922-a44b-4bf0-8a90-9ff493f7c94f None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:27.145458 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11273922-a44b-4bf0-8a90-9ff493f7c94f None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:27.147041 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 124/236] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:20:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:27.151972 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43024927-4519-48bb-9582-6edadf62a6ea None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:27.152264 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43024927-4519-48bb-9582-6edadf62a6ea None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:27.152542 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43024927-4519-48bb-9582-6edadf62a6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:27.152637 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db3862-3259-42e4-b5ce-f950a2fc4493 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:27.152831 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db3862-3259-42e4-b5ce-f950a2fc4493 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:27.153137 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db3862-3259-42e4-b5ce-f950a2fc4493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:27.170936 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-08db3862-3259-42e4-b5ce-f950a2fc4493 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:27.172462 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-08db3862-3259-42e4-b5ce-f950a2fc4493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:27.177753 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-43024927-4519-48bb-9582-6edadf62a6ea None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:27.178939 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-43024927-4519-48bb-9582-6edadf62a6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:27.209014 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:27.287051 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 125/237] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:20:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:20:27.308197 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 113/238] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:20:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:20:27.331194 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db3862-3259-42e4-b5ce-f950a2fc4493 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:27.342358 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43024927-4519-48bb-9582-6edadf62a6ea None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:27.366435 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:27.503163 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db3862-3259-42e4-b5ce-f950a2fc4493 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:27.508214 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43024927-4519-48bb-9582-6edadf62a6ea None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:27.546740 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55236406-3f17-4ef4-a320-7b42f976ee89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:27.549354 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55236406-3f17-4ef4-a320-7b42f976ee89 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:27.549996 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55236406-3f17-4ef4-a320-7b42f976ee89 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:27.551541 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55236406-3f17-4ef4-a320-7b42f976ee89 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:27.569402 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55236406-3f17-4ef4-a320-7b42f976ee89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:20:27.574547 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb010bd-57e8-431a-b866-2b4f5b809aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:27.576257 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb010bd-57e8-431a-b866-2b4f5b809aa7 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:27.582580 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-55236406-3f17-4ef4-a320-7b42f976ee89 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:20:27.582580 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:27.582580 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:27.582580 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:27.582580 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:27.582580 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:27.582580 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:27.582580 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:27.582580 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:27.582580 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:27.582580 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:27.582580 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:27.582580 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:20:27.582580 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:20:27.582580 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:20:27.582580 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:20:27.583488 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:20:27.583488 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:20:27.583488 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:20:27.583488 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:20:27.583488 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:27.583488 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:27.583488 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:27.583488 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:27.583488 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:27.583488 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:27.583488 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:27.583488 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:20:27.583488 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:27.583488 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:27.583488 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:27.583488 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:27.584285 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:27.584285 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:27.584285 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:27.584285 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:27.584285 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:20:27.584285 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:20:27.584285 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:20:27.584285 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:20:27.584285 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:20:27.584285 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:20:27.584285 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:20:27.584285 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:20:27.585720 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb010bd-57e8-431a-b866-2b4f5b809aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:27.586196 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb010bd-57e8-431a-b866-2b4f5b809aa7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:27.587601 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb010bd-57e8-431a-b866-2b4f5b809aa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:27.589311 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb010bd-57e8-431a-b866-2b4f5b809aa7 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:27.591760 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 114/239] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:20:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:20:27.592905 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 126/240] 10.222.0.16 () {56 vars in 1099 bytes} [Thu May 26 12:20:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:20:27.598605 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb010bd-57e8-431a-b866-2b4f5b809aa7 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:27.602953 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55236406-3f17-4ef4-a320-7b42f976ee89 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:27.649576 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:27.728189 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:27.757822 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb010bd-57e8-431a-b866-2b4f5b809aa7 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:27.765375 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55236406-3f17-4ef4-a320-7b42f976ee89 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:27.801724 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e2688-9fbc-4957-9baf-e041faad2516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:27.802517 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e2688-9fbc-4957-9baf-e041faad2516 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:27.802869 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e2688-9fbc-4957-9baf-e041faad2516 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:27.803217 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e2688-9fbc-4957-9baf-e041faad2516 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:27.804053 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152e2688-9fbc-4957-9baf-e041faad2516 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:27.804430 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152e2688-9fbc-4957-9baf-e041faad2516 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:27.805939 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152e2688-9fbc-4957-9baf-e041faad2516 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:27.809797 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc7933f-4d2f-4f92-a69f-3447e76d3f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:27.810705 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7933f-4d2f-4f92-a69f-3447e76d3f23 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:27.811177 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7933f-4d2f-4f92-a69f-3447e76d3f23 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:27.812192 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7933f-4d2f-4f92-a69f-3447e76d3f23 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:27.813800 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc7933f-4d2f-4f92-a69f-3447e76d3f23 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:27.815529 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc7933f-4d2f-4f92-a69f-3447e76d3f23 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:27.816358 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 127/241] 10.222.0.16 () {56 vars in 1101 bytes} [Thu May 26 12:20:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:27.817841 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b8a9f-2628-4d38-8e1d-5a29ba73656b None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:27.818203 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b8a9f-2628-4d38-8e1d-5a29ba73656b None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:27.818552 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b8a9f-2628-4d38-8e1d-5a29ba73656b None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:27.824076 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 128/242] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:20:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:27.824979 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b8a9f-2628-4d38-8e1d-5a29ba73656b None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:27.841775 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 115/243] 10.222.0.16 () {60 vars in 1132 bytes} [Thu May 26 12:20:27 2022] POST /identity/v3/users => generated 293 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:20:27.844335 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f43495d-8536-4409-8bf0-f7a02e0d090b None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:27.845060 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f43495d-8536-4409-8bf0-f7a02e0d090b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:27.845686 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f43495d-8536-4409-8bf0-f7a02e0d090b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:27.869405 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-0f43495d-8536-4409-8bf0-f7a02e0d090b None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:27.871023 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0f43495d-8536-4409-8bf0-f7a02e0d090b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:27.920004 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:27.949851 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b8a9f-2628-4d38-8e1d-5a29ba73656b None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:27.970015 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 116/244] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:20:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:20:27.993707 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf726d2-ad69-4396-b0fb-651593faed47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:27.994433 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f43495d-8536-4409-8bf0-f7a02e0d090b None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:27.995122 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf726d2-ad69-4396-b0fb-651593faed47 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:27.995634 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf726d2-ad69-4396-b0fb-651593faed47 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:27.996080 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf726d2-ad69-4396-b0fb-651593faed47 None admin] PATH_INFO: `/v3/users/7b50af76be32494ba5593df37f418563` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:28.016599 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf726d2-ad69-4396-b0fb-651593faed47 None admin] RBAC: Authorizing `identity:get_user(user_id=7b50af76be32494ba5593df37f418563)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:28.019027 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf726d2-ad69-4396-b0fb-651593faed47 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:28.021641 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 129/245] 10.222.0.16 () {56 vars in 1177 bytes} [Thu May 26 12:20:27 2022] GET /identity/v3/users/7b50af76be32494ba5593df37f418563 => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:28.033879 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf726d2-ad69-4396-b0fb-651593faed47 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:28.144460 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf726d2-ad69-4396-b0fb-651593faed47 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:28.145779 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:28.185751 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f43495d-8536-4409-8bf0-f7a02e0d090b None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:28.201080 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d81d5a-11cf-4bb1-bc0e-435a623fc8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:28.202428 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d81d5a-11cf-4bb1-bc0e-435a623fc8b9 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:28.202850 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d81d5a-11cf-4bb1-bc0e-435a623fc8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:28.203252 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d81d5a-11cf-4bb1-bc0e-435a623fc8b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:28.208733 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:28.233186 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54923f28-e924-4529-a173-70cef259a91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:28.234248 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54923f28-e924-4529-a173-70cef259a91f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:28.234534 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54923f28-e924-4529-a173-70cef259a91f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:28.234876 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54923f28-e924-4529-a173-70cef259a91f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:28.252869 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54923f28-e924-4529-a173-70cef259a91f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:20:28.261355 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-54923f28-e924-4529-a173-70cef259a91f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:20:28.261355 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:28.261355 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:28.261355 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:28.261355 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:28.261355 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:28.261355 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:28.261355 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:28.261355 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:28.261355 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:28.261355 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:28.261355 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:28.261355 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:20:28.261355 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:20:28.261355 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:20:28.261355 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:20:28.262443 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:20:28.262443 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:20:28.262443 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:20:28.262443 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:20:28.262443 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:28.262443 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:28.262443 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:28.262443 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:28.262443 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:28.262443 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:28.262443 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:28.262443 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:20:28.262443 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:28.262443 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:28.262443 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:28.262443 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:28.263443 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:28.263443 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:28.263443 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:28.263443 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:28.263443 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:20:28.263443 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:20:28.263443 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:20:28.263443 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:20:28.263443 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:20:28.263443 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:20:28.263443 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:20:28.263443 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:20:28.265184 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 117/246] 10.222.0.16 () {56 vars in 1099 bytes} [Thu May 26 12:20:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:20:28.271317 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54923f28-e924-4529-a173-70cef259a91f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:28.297481 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d81d5a-11cf-4bb1-bc0e-435a623fc8b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:28.299723 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d81d5a-11cf-4bb1-bc0e-435a623fc8b9 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:28.411214 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54923f28-e924-4529-a173-70cef259a91f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:28.440759 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 130/247] 10.222.0.16 () {58 vars in 1282 bytes} [Thu May 26 12:20:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:20:28.447152 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d81d5a-11cf-4bb1-bc0e-435a623fc8b9 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:28.455271 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab47ff17-f403-4aa0-a2b3-8fb5e9bc8038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:28.456124 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47ff17-f403-4aa0-a2b3-8fb5e9bc8038 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:28.456502 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47ff17-f403-4aa0-a2b3-8fb5e9bc8038 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:28.458104 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47ff17-f403-4aa0-a2b3-8fb5e9bc8038 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:28.459051 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab47ff17-f403-4aa0-a2b3-8fb5e9bc8038 None admin] RBAC: Adding query filter params (name=member) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:28.459466 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab47ff17-f403-4aa0-a2b3-8fb5e9bc8038 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:28.461195 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab47ff17-f403-4aa0-a2b3-8fb5e9bc8038 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:28.463162 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:28.474390 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 118/248] 10.222.0.16 () {56 vars in 1101 bytes} [Thu May 26 12:20:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:28.481110 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab47ff17-f403-4aa0-a2b3-8fb5e9bc8038 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:28.493750 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:28.580911 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d81d5a-11cf-4bb1-bc0e-435a623fc8b9 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:28.605326 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab47ff17-f403-4aa0-a2b3-8fb5e9bc8038 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:28.622619 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2bb96b-fdb5-4d32-8481-9039950a36a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:28.623885 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2bb96b-fdb5-4d32-8481-9039950a36a6 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:28.624172 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2bb96b-fdb5-4d32-8481-9039950a36a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:28.624634 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2bb96b-fdb5-4d32-8481-9039950a36a6 None admin] PATH_INFO: `/v3/projects/b7b56cecd1b744e7aa956f6480beb5cf` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:28.626649 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2bb96b-fdb5-4d32-8481-9039950a36a6 None admin] RBAC: Authorizing `identity:get_project(project_id=b7b56cecd1b744e7aa956f6480beb5cf)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:28.628275 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2bb96b-fdb5-4d32-8481-9039950a36a6 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:28.630666 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 131/249] 10.222.0.16 () {56 vars in 1186 bytes} [Thu May 26 12:20:28 2022] GET /identity/v3/projects/b7b56cecd1b744e7aa956f6480beb5cf => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:28.638053 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2bb96b-fdb5-4d32-8481-9039950a36a6 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:28.655053 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1767a2d-5d29-48b8-a969-38238105581e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:28.656374 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1767a2d-5d29-48b8-a969-38238105581e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:28.656896 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1767a2d-5d29-48b8-a969-38238105581e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:28.657404 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1767a2d-5d29-48b8-a969-38238105581e None admin] PATH_INFO: `/v3/users/28f9fb6152884e54b5f6ed365ab0f5d0` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:28.658834 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1767a2d-5d29-48b8-a969-38238105581e None admin] RBAC: Authorizing `identity:get_user(user_id=28f9fb6152884e54b5f6ed365ab0f5d0)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:28.660591 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1767a2d-5d29-48b8-a969-38238105581e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:28.665590 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 119/250] 10.222.0.16 () {56 vars in 1177 bytes} [Thu May 26 12:20:28 2022] GET /identity/v3/users/28f9fb6152884e54b5f6ed365ab0f5d0 => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:28.669429 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1767a2d-5d29-48b8-a969-38238105581e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:28.743870 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:28.770877 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2bb96b-fdb5-4d32-8481-9039950a36a6 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:28.774162 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:28.791186 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1767a2d-5d29-48b8-a969-38238105581e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:28.810396 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b667dbac-790b-459f-9329-a15f50b7cc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:28.811166 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667dbac-790b-459f-9329-a15f50b7cc0a None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:28.811344 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667dbac-790b-459f-9329-a15f50b7cc0a None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:28.811610 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667dbac-790b-459f-9329-a15f50b7cc0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:28.812445 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b667dbac-790b-459f-9329-a15f50b7cc0a None admin] RBAC: Adding query filter params (role.id=c23f3f2e6c7e4a259066d5527cd0ab25, scope.project.id=b7b56cecd1b744e7aa956f6480beb5cf, user.id=7b50af76be32494ba5593df37f418563) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:28.812759 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b667dbac-790b-459f-9329-a15f50b7cc0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:28.814821 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b667dbac-790b-459f-9329-a15f50b7cc0a None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:28.824041 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 132/251] 10.222.0.16 () {56 vars in 1374 bytes} [Thu May 26 12:20:28 2022] GET /identity/v3/role_assignments?user.id=7b50af76be32494ba5593df37f418563&scope.project.id=b7b56cecd1b744e7aa956f6480beb5cf&role.id=c23f3f2e6c7e4a259066d5527cd0ab25 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:20:28.824041 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d4b30-fb64-4065-8765-d85fc6f9abcf None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:28.824041 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d4b30-fb64-4065-8765-d85fc6f9abcf None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:28.824041 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d4b30-fb64-4065-8765-d85fc6f9abcf None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:28.824041 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 133/252] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:20:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:28.829439 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782289ae-25c2-4cca-8454-620c7ec4e416 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:28.829717 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782289ae-25c2-4cca-8454-620c7ec4e416 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:28.830002 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782289ae-25c2-4cca-8454-620c7ec4e416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:28.838147 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8fb7f5-5393-4324-95d4-045cd9c7e659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:28.839266 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8fb7f5-5393-4324-95d4-045cd9c7e659 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:28.839751 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8fb7f5-5393-4324-95d4-045cd9c7e659 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:28.840239 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8fb7f5-5393-4324-95d4-045cd9c7e659 None admin] PATH_INFO: `/v3/projects/b7b56cecd1b744e7aa956f6480beb5cf` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:28.847502 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-782289ae-25c2-4cca-8454-620c7ec4e416 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:28.848188 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8fb7f5-5393-4324-95d4-045cd9c7e659 None admin] RBAC: Authorizing `identity:get_project(project_id=b7b56cecd1b744e7aa956f6480beb5cf)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:28.848823 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-782289ae-25c2-4cca-8454-620c7ec4e416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:28.850206 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8fb7f5-5393-4324-95d4-045cd9c7e659 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:28.853514 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 120/253] 10.222.0.16 () {56 vars in 1186 bytes} [Thu May 26 12:20:28 2022] GET /identity/v3/projects/b7b56cecd1b744e7aa956f6480beb5cf => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:28.858522 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8fb7f5-5393-4324-95d4-045cd9c7e659 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:28.940871 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 134/254] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:20:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:20:28.964871 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782289ae-25c2-4cca-8454-620c7ec4e416 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:29.070628 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782289ae-25c2-4cca-8454-620c7ec4e416 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:29.073209 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:29.078607 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8fb7f5-5393-4324-95d4-045cd9c7e659 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:29.109484 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074129f1-eb67-4124-893b-3f887eb08bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:29.111103 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074129f1-eb67-4124-893b-3f887eb08bf2 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:29.111394 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074129f1-eb67-4124-893b-3f887eb08bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:29.111670 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074129f1-eb67-4124-893b-3f887eb08bf2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:29.124237 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074129f1-eb67-4124-893b-3f887eb08bf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:20:29.126187 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:29.132958 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-074129f1-eb67-4124-893b-3f887eb08bf2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:20:29.132958 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:29.132958 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:29.132958 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:29.132958 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:29.132958 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:29.132958 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:29.132958 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:29.132958 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:29.132958 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:29.132958 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:29.132958 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:29.132958 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:20:29.132958 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:20:29.132958 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:20:29.132958 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:20:29.133903 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:20:29.133903 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:20:29.133903 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:20:29.133903 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:20:29.133903 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:29.133903 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:29.133903 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:29.133903 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:29.133903 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:29.133903 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:29.133903 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:29.133903 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:20:29.133903 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:29.133903 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:29.133903 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:29.133903 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:29.134678 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:29.134678 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:29.134678 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:29.134678 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:29.134678 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:20:29.134678 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:20:29.134678 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:20:29.134678 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:20:29.134678 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:20:29.134678 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:20:29.134678 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:20:29.134678 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:20:29.135819 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 135/255] 10.222.0.16 () {56 vars in 1096 bytes} [Thu May 26 12:20:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:20:29.137792 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b1226-2dec-4f61-bf47-8101d01f276f None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:29.137792 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b1226-2dec-4f61-bf47-8101d01f276f None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:29.141827 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b1226-2dec-4f61-bf47-8101d01f276f None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:29.142848 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 136/256] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:20:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:29.144365 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b1226-2dec-4f61-bf47-8101d01f276f None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:29.149718 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e1d9b4-4442-4a71-b73a-a2f01882b380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:29.150644 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1d9b4-4442-4a71-b73a-a2f01882b380 None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:29.150914 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1d9b4-4442-4a71-b73a-a2f01882b380 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:29.151189 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1d9b4-4442-4a71-b73a-a2f01882b380 None admin] PATH_INFO: `/v3/projects/b7b56cecd1b744e7aa956f6480beb5cf/users/28f9fb6152884e54b5f6ed365ab0f5d0/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:29.161722 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e1d9b4-4442-4a71-b73a-a2f01882b380 None admin] RBAC: Authorizing `identity:create_grant(project_id=b7b56cecd1b744e7aa956f6480beb5cf, user_id=28f9fb6152884e54b5f6ed365ab0f5d0, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:29.163218 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e1d9b4-4442-4a71-b73a-a2f01882b380 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:29.187426 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 121/257] 10.222.0.16 () {58 vars in 1439 bytes} [Thu May 26 12:20:28 2022] PUT /identity/v3/projects/b7b56cecd1b744e7aa956f6480beb5cf/users/28f9fb6152884e54b5f6ed365ab0f5d0/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:20:29.188775 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c793d54-94bc-428b-a021-501c00455c9f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:29.189153 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c793d54-94bc-428b-a021-501c00455c9f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:29.189439 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c793d54-94bc-428b-a021-501c00455c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:29.230016 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-2c793d54-94bc-428b-a021-501c00455c9f None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:29.231249 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2c793d54-94bc-428b-a021-501c00455c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:29.257904 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b1226-2dec-4f61-bf47-8101d01f276f None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:29.294774 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8c0a4-e024-4174-87c1-cf093af622a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:29.295446 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8c0a4-e024-4174-87c1-cf093af622a8 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:29.295730 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8c0a4-e024-4174-87c1-cf093af622a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:29.296008 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8c0a4-e024-4174-87c1-cf093af622a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:29.297121 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b8c0a4-e024-4174-87c1-cf093af622a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:29.298255 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b8c0a4-e024-4174-87c1-cf093af622a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:29.299664 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b8c0a4-e024-4174-87c1-cf093af622a8 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:29.309730 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 137/258] 10.222.0.16 () {56 vars in 1099 bytes} [Thu May 26 12:20:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:29.322252 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8c0a4-e024-4174-87c1-cf093af622a8 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:29.381332 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:29.383728 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 122/259] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:20:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:20:29.426999 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c793d54-94bc-428b-a021-501c00455c9f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:29.549365 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8c0a4-e024-4174-87c1-cf093af622a8 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:29.560427 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c793d54-94bc-428b-a021-501c00455c9f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:29.609178 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:29.638171 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2475d770-7f93-412e-9213-9169b34d88d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:29.638454 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3622bda-fa97-457b-87be-d0b016b9542f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:29.638980 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475d770-7f93-412e-9213-9169b34d88d2 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:29.639251 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3622bda-fa97-457b-87be-d0b016b9542f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:29.639354 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475d770-7f93-412e-9213-9169b34d88d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:29.639529 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475d770-7f93-412e-9213-9169b34d88d2 None admin] PATH_INFO: `/v3/users/c08563e8db794b6ba52239b8754737ae` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:29.639625 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3622bda-fa97-457b-87be-d0b016b9542f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:29.639798 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3622bda-fa97-457b-87be-d0b016b9542f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:29.642699 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2475d770-7f93-412e-9213-9169b34d88d2 None admin] RBAC: Authorizing `identity:get_user(user_id=c08563e8db794b6ba52239b8754737ae)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:29.644156 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2475d770-7f93-412e-9213-9169b34d88d2 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:29.646176 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 138/260] 10.222.0.16 () {56 vars in 1177 bytes} [Thu May 26 12:20:29 2022] GET /identity/v3/users/c08563e8db794b6ba52239b8754737ae => generated 283 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:20:29.654945 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2475d770-7f93-412e-9213-9169b34d88d2 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:29.669810 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3622bda-fa97-457b-87be-d0b016b9542f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:20:29.678037 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-a3622bda-fa97-457b-87be-d0b016b9542f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:20:29.678037 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:29.678037 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:29.678037 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:29.678037 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:29.678037 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:29.678037 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:29.678037 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:29.678037 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:29.678037 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:29.678037 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:29.678037 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:29.678037 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:20:29.678037 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:20:29.678037 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:20:29.678037 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:20:29.678911 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:20:29.678911 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:20:29.678911 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:20:29.678911 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:20:29.678911 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:29.678911 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:29.678911 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:29.678911 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:29.678911 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:29.678911 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:29.678911 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:29.678911 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:20:29.678911 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:29.678911 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:29.678911 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:29.678911 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:29.679705 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:29.679705 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:29.679705 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:29.679705 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:29.679705 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:20:29.679705 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:20:29.679705 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:20:29.679705 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:20:29.679705 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:20:29.679705 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:20:29.679705 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:20:29.679705 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:20:29.685273 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 123/261] 10.222.0.16 () {56 vars in 1114 bytes} [Thu May 26 12:20:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:20:29.692228 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3622bda-fa97-457b-87be-d0b016b9542f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:29.884975 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:29.900725 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3622bda-fa97-457b-87be-d0b016b9542f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:29.918985 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2475d770-7f93-412e-9213-9169b34d88d2 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:29.969226 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b13c972-d344-475d-958d-6ffdd556b11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:29.970475 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13c972-d344-475d-958d-6ffdd556b11e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:29.970767 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13c972-d344-475d-958d-6ffdd556b11e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:29.971473 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13c972-d344-475d-958d-6ffdd556b11e None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:29.972238 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b13c972-d344-475d-958d-6ffdd556b11e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:29.972549 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b13c972-d344-475d-958d-6ffdd556b11e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:29.973979 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b13c972-d344-475d-958d-6ffdd556b11e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:29.990473 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 124/262] 10.222.0.16 () {56 vars in 1111 bytes} [Thu May 26 12:20:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:20:29.997836 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b13c972-d344-475d-958d-6ffdd556b11e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:30.021558 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c2d46-a16e-43f0-bd2c-df951182f2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:30.022230 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c2d46-a16e-43f0-bd2c-df951182f2a8 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:30.022520 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c2d46-a16e-43f0-bd2c-df951182f2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:30.022799 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c2d46-a16e-43f0-bd2c-df951182f2a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:30.070967 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:30.166743 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b13c972-d344-475d-958d-6ffdd556b11e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:30.213687 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703c2d46-a16e-43f0-bd2c-df951182f2a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:30.215184 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703c2d46-a16e-43f0-bd2c-df951182f2a8 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:30.238858 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9671e1f-5f6f-48d7-8760-a7420ce9c751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:30.240057 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9671e1f-5f6f-48d7-8760-a7420ce9c751 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:30.240539 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9671e1f-5f6f-48d7-8760-a7420ce9c751 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:30.241120 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9671e1f-5f6f-48d7-8760-a7420ce9c751 None admin] PATH_INFO: `/v3/users/c08563e8db794b6ba52239b8754737ae` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:30.245543 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9671e1f-5f6f-48d7-8760-a7420ce9c751 None admin] RBAC: Authorizing `identity:get_user(user_id=c08563e8db794b6ba52239b8754737ae)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:30.247246 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9671e1f-5f6f-48d7-8760-a7420ce9c751 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:30.249119 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 125/263] 10.222.0.16 () {56 vars in 1177 bytes} [Thu May 26 12:20:29 2022] GET /identity/v3/users/c08563e8db794b6ba52239b8754737ae => generated 283 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:20:30.256529 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9671e1f-5f6f-48d7-8760-a7420ce9c751 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:30.387897 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:30.407765 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 139/264] 10.222.0.16 () {58 vars in 1282 bytes} [Thu May 26 12:20:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 753 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 12:20:30.413435 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c2d46-a16e-43f0-bd2c-df951182f2a8 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:30.507034 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9671e1f-5f6f-48d7-8760-a7420ce9c751 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:30.537511 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:30.589501 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c2d46-a16e-43f0-bd2c-df951182f2a8 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:30.600055 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5431adfa-bd16-4ae1-a7b1-64646e1e2c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:30.601002 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431adfa-bd16-4ae1-a7b1-64646e1e2c3e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:30.601508 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431adfa-bd16-4ae1-a7b1-64646e1e2c3e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:30.601984 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431adfa-bd16-4ae1-a7b1-64646e1e2c3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:30.668651 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ffcddc-5794-49e5-879b-ff65547c33fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:30.669547 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffcddc-5794-49e5-879b-ff65547c33fa None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:30.669826 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffcddc-5794-49e5-879b-ff65547c33fa None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:30.670111 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffcddc-5794-49e5-879b-ff65547c33fa None admin] PATH_INFO: `/v3/projects/b7b56cecd1b744e7aa956f6480beb5cf` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:30.671278 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ffcddc-5794-49e5-879b-ff65547c33fa None admin] RBAC: Authorizing `identity:get_project(project_id=b7b56cecd1b744e7aa956f6480beb5cf)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:30.673027 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ffcddc-5794-49e5-879b-ff65547c33fa None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:30.674493 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 140/265] 10.222.0.16 () {56 vars in 1186 bytes} [Thu May 26 12:20:30 2022] GET /identity/v3/projects/b7b56cecd1b744e7aa956f6480beb5cf => generated 302 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:30.681552 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ffcddc-5794-49e5-879b-ff65547c33fa None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:30.683526 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5431adfa-bd16-4ae1-a7b1-64646e1e2c3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:30.685261 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5431adfa-bd16-4ae1-a7b1-64646e1e2c3e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:30.790619 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 126/266] 10.222.0.16 () {58 vars in 1282 bytes} [Thu May 26 12:20:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:20:30.795678 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5431adfa-bd16-4ae1-a7b1-64646e1e2c3e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:30.816250 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:30.824868 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:30.918125 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5431adfa-bd16-4ae1-a7b1-64646e1e2c3e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:30.946926 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ffcddc-5794-49e5-879b-ff65547c33fa None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:30.964532 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad7e88-ffe8-4344-8cef-0c3bf6e880f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:30.965984 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad7e88-ffe8-4344-8cef-0c3bf6e880f6 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:30.966495 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad7e88-ffe8-4344-8cef-0c3bf6e880f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:30.966994 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad7e88-ffe8-4344-8cef-0c3bf6e880f6 None admin] PATH_INFO: `/v3/projects/b7b56cecd1b744e7aa956f6480beb5cf` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:30.970496 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fad7e88-ffe8-4344-8cef-0c3bf6e880f6 None admin] RBAC: Authorizing `identity:get_project(project_id=b7b56cecd1b744e7aa956f6480beb5cf)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:30.972176 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fad7e88-ffe8-4344-8cef-0c3bf6e880f6 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:30.979924 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 127/267] 10.222.0.16 () {56 vars in 1186 bytes} [Thu May 26 12:20:30 2022] GET /identity/v3/projects/b7b56cecd1b744e7aa956f6480beb5cf => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:30.985208 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad7e88-ffe8-4344-8cef-0c3bf6e880f6 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:31.027975 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2436ca5-efec-4c69-b41e-4085652dfba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:31.029016 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2436ca5-efec-4c69-b41e-4085652dfba2 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:31.030555 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2436ca5-efec-4c69-b41e-4085652dfba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:31.031036 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2436ca5-efec-4c69-b41e-4085652dfba2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:31.032653 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2436ca5-efec-4c69-b41e-4085652dfba2 None admin] RBAC: Adding query filter params (role.id=1a8e523ecbc84d818c2a9af0fb54da74, scope.project.id=b7b56cecd1b744e7aa956f6480beb5cf, user.id=c08563e8db794b6ba52239b8754737ae) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:31.035283 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2436ca5-efec-4c69-b41e-4085652dfba2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:31.036967 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2436ca5-efec-4c69-b41e-4085652dfba2 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:31.050589 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 141/268] 10.222.0.16 () {56 vars in 1374 bytes} [Thu May 26 12:20:30 2022] GET /identity/v3/role_assignments?user.id=c08563e8db794b6ba52239b8754737ae&scope.project.id=b7b56cecd1b744e7aa956f6480beb5cf&role.id=1a8e523ecbc84d818c2a9af0fb54da74 => generated 608 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:31.108582 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:31.142726 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad7e88-ffe8-4344-8cef-0c3bf6e880f6 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:31.196612 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed19a4-1e72-4d96-8e10-5d31019dc18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:31.197414 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed19a4-1e72-4d96-8e10-5d31019dc18f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:31.197581 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed19a4-1e72-4d96-8e10-5d31019dc18f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:31.197859 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed19a4-1e72-4d96-8e10-5d31019dc18f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:31.198707 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ed19a4-1e72-4d96-8e10-5d31019dc18f None admin] RBAC: Adding query filter params (role.id=e0f421b5486c47aebb20ea10342cb1e3, scope.project.id=b7b56cecd1b744e7aa956f6480beb5cf, user.id=c08563e8db794b6ba52239b8754737ae) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:31.199023 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ed19a4-1e72-4d96-8e10-5d31019dc18f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:31.200612 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ed19a4-1e72-4d96-8e10-5d31019dc18f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:31.210278 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 128/269] 10.222.0.16 () {56 vars in 1374 bytes} [Thu May 26 12:20:30 2022] GET /identity/v3/role_assignments?user.id=c08563e8db794b6ba52239b8754737ae&scope.project.id=b7b56cecd1b744e7aa956f6480beb5cf&role.id=e0f421b5486c47aebb20ea10342cb1e3 => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:20:31.451963 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad94544-7535-4654-b281-52f2d0560675 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:31.452956 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad94544-7535-4654-b281-52f2d0560675 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:31.453437 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad94544-7535-4654-b281-52f2d0560675 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:31.455710 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 142/270] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:20:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:31.461380 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84fc20a-5404-4f61-8cdb-88686c95a5a7 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:31.461675 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84fc20a-5404-4f61-8cdb-88686c95a5a7 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:31.462091 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84fc20a-5404-4f61-8cdb-88686c95a5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:31.486188 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a84fc20a-5404-4f61-8cdb-88686c95a5a7 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:31.487432 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a84fc20a-5404-4f61-8cdb-88686c95a5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:31.570295 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 129/271] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:20:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:20:31.596966 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad94544-7535-4654-b281-52f2d0560675 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:31.717231 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad94544-7535-4654-b281-52f2d0560675 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:31.721137 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b8d94a-de88-425c-9973-4a6eeea25273 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:31.721447 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b8d94a-de88-425c-9973-4a6eeea25273 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:31.721720 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b8d94a-de88-425c-9973-4a6eeea25273 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:31.723248 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 130/272] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:20:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:31.728351 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005465e8-9b83-44b6-9c93-ab5e695301ff None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:31.728642 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005465e8-9b83-44b6-9c93-ab5e695301ff None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:31.728966 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005465e8-9b83-44b6-9c93-ab5e695301ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:31.747357 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:31.759957 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-005465e8-9b83-44b6-9c93-ab5e695301ff None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:31.763179 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-005465e8-9b83-44b6-9c93-ab5e695301ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:31.768141 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1eca6d-c9eb-4107-8b03-065cd99f8aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:31.769227 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1eca6d-c9eb-4107-8b03-065cd99f8aa5 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:31.769752 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1eca6d-c9eb-4107-8b03-065cd99f8aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:31.770215 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1eca6d-c9eb-4107-8b03-065cd99f8aa5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:31.772710 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1eca6d-c9eb-4107-8b03-065cd99f8aa5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:31.774329 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1eca6d-c9eb-4107-8b03-065cd99f8aa5 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:31.776051 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 143/273] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:20:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:31.782858 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1eca6d-c9eb-4107-8b03-065cd99f8aa5 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:31.867105 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 131/274] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:20:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:20:31.894836 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005465e8-9b83-44b6-9c93-ab5e695301ff None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:31.898904 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:31.932542 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1eca6d-c9eb-4107-8b03-065cd99f8aa5 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:31.972033 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c3e776-b860-479e-aadb-94ac3970da0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:31.973073 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3e776-b860-479e-aadb-94ac3970da0a None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:31.973578 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3e776-b860-479e-aadb-94ac3970da0a None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:31.974048 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3e776-b860-479e-aadb-94ac3970da0a None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:31.975049 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c3e776-b860-479e-aadb-94ac3970da0a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:31.976973 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c3e776-b860-479e-aadb-94ac3970da0a None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:32.002794 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 144/275] 10.222.0.16 () {60 vars in 1132 bytes} [Thu May 26 12:20:31 2022] POST /identity/v3/users => generated 293 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:20:32.022598 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005465e8-9b83-44b6-9c93-ab5e695301ff None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:32.046092 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aaa107-a97a-4573-a846-fd0dbb9bd41c None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:32.046434 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aaa107-a97a-4573-a846-fd0dbb9bd41c None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:32.046654 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aaa107-a97a-4573-a846-fd0dbb9bd41c None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:32.048616 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 145/276] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:20:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:20:32.054206 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229913a7-c9a7-40aa-afda-ed20dd075b03 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:32.054522 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229913a7-c9a7-40aa-afda-ed20dd075b03 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:32.054773 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229913a7-c9a7-40aa-afda-ed20dd075b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:32.063209 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f883cd9e-d009-49bd-9b1f-29b02b66313d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:32.064611 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f883cd9e-d009-49bd-9b1f-29b02b66313d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:32.064921 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f883cd9e-d009-49bd-9b1f-29b02b66313d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:32.065195 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f883cd9e-d009-49bd-9b1f-29b02b66313d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:32.074330 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-229913a7-c9a7-40aa-afda-ed20dd075b03 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:32.075578 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-229913a7-c9a7-40aa-afda-ed20dd075b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:32.077542 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f883cd9e-d009-49bd-9b1f-29b02b66313d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:20:32.086196 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-f883cd9e-d009-49bd-9b1f-29b02b66313d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:20:32.086196 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:32.086196 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:32.086196 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:32.086196 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:32.086196 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:32.086196 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:32.086196 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:32.086196 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:32.086196 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:32.086196 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:32.086196 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:32.086196 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:20:32.086196 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:20:32.086196 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:20:32.086196 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:20:32.087203 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:20:32.087203 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:20:32.087203 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:20:32.087203 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:20:32.087203 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:32.087203 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:32.087203 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:32.087203 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:32.087203 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:32.087203 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:32.087203 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:32.087203 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:20:32.087203 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:32.087203 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:32.087203 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:32.087203 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:32.088428 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:32.088428 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:32.088428 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:32.088428 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:32.088428 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:20:32.088428 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:20:32.088428 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:20:32.088428 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:20:32.088428 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:20:32.088428 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:20:32.088428 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:20:32.088428 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:20:32.088428 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 132/277] 10.222.0.16 () {56 vars in 1099 bytes} [Thu May 26 12:20:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:20:32.093737 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f883cd9e-d009-49bd-9b1f-29b02b66313d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:32.130751 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:32.165132 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 146/278] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:20:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:20:32.181272 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:32.188277 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229913a7-c9a7-40aa-afda-ed20dd075b03 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:32.232607 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f883cd9e-d009-49bd-9b1f-29b02b66313d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:32.284289 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca8567-9e15-44f9-828a-fa6587e9f2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:32.285167 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca8567-9e15-44f9-828a-fa6587e9f2b4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:32.285451 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca8567-9e15-44f9-828a-fa6587e9f2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:32.286289 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca8567-9e15-44f9-828a-fa6587e9f2b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:32.287201 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcca8567-9e15-44f9-828a-fa6587e9f2b4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:32.287632 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcca8567-9e15-44f9-828a-fa6587e9f2b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:32.289251 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcca8567-9e15-44f9-828a-fa6587e9f2b4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:32.305043 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 133/279] 10.222.0.16 () {56 vars in 1101 bytes} [Thu May 26 12:20:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:20:32.307030 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca8567-9e15-44f9-828a-fa6587e9f2b4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:32.330857 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229913a7-c9a7-40aa-afda-ed20dd075b03 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:32.383274 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db58301-7b83-4fc8-8ecd-2e7cf3ebc85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:32.384106 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db58301-7b83-4fc8-8ecd-2e7cf3ebc85b None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:32.384389 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db58301-7b83-4fc8-8ecd-2e7cf3ebc85b None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:32.384685 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db58301-7b83-4fc8-8ecd-2e7cf3ebc85b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:32.398647 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db58301-7b83-4fc8-8ecd-2e7cf3ebc85b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:20:32.406508 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-5db58301-7b83-4fc8-8ecd-2e7cf3ebc85b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:20:32.406508 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:32.406508 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:32.406508 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:32.406508 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:32.406508 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:32.406508 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:32.406508 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:32.406508 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:32.406508 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:32.406508 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:32.406508 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:32.406508 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:20:32.406508 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:20:32.406508 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:20:32.406508 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:20:32.407960 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:20:32.407960 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:20:32.407960 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:20:32.407960 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:20:32.407960 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:32.407960 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:32.407960 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:32.407960 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:32.407960 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:32.407960 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:32.407960 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:32.407960 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:20:32.407960 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:32.407960 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:32.407960 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:32.407960 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:32.408789 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:32.408789 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:32.408789 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:32.408789 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:32.408789 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:20:32.408789 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:20:32.408789 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:20:32.408789 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:20:32.408789 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:20:32.408789 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:20:32.408789 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:20:32.408789 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:20:32.408789 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 147/280] 10.222.0.16 () {56 vars in 1099 bytes} [Thu May 26 12:20:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:20:32.414777 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db58301-7b83-4fc8-8ecd-2e7cf3ebc85b None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:32.441719 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca8567-9e15-44f9-828a-fa6587e9f2b4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:32.463485 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:32.476154 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:32.488236 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4026e-4e94-482e-bc0d-10742a47e079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:32.489078 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4026e-4e94-482e-bc0d-10742a47e079 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:32.489371 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4026e-4e94-482e-bc0d-10742a47e079 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:32.489658 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4026e-4e94-482e-bc0d-10742a47e079 None admin] PATH_INFO: `/v3/users/6a2ade92e7e74eb9a595615ddbaf516f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:32.504103 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc4026e-4e94-482e-bc0d-10742a47e079 None admin] RBAC: Authorizing `identity:get_user(user_id=6a2ade92e7e74eb9a595615ddbaf516f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:32.505543 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc4026e-4e94-482e-bc0d-10742a47e079 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:32.507574 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 134/281] 10.222.0.16 () {56 vars in 1177 bytes} [Thu May 26 12:20:32 2022] GET /identity/v3/users/6a2ade92e7e74eb9a595615ddbaf516f => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:32.512860 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a750f-a85a-47d1-b22c-5591565d27c4 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:32.512860 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a750f-a85a-47d1-b22c-5591565d27c4 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:32.512860 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a750f-a85a-47d1-b22c-5591565d27c4 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:32.512860 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 135/282] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:20:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:32.515609 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a750f-a85a-47d1-b22c-5591565d27c4 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:32.555392 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db58301-7b83-4fc8-8ecd-2e7cf3ebc85b None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:32.601465 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced26958-fafb-4188-8f5c-edbe447c7025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:32.602312 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced26958-fafb-4188-8f5c-edbe447c7025 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:32.602696 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced26958-fafb-4188-8f5c-edbe447c7025 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:32.603070 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced26958-fafb-4188-8f5c-edbe447c7025 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:32.604448 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced26958-fafb-4188-8f5c-edbe447c7025 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:32.604871 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced26958-fafb-4188-8f5c-edbe447c7025 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:32.606816 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced26958-fafb-4188-8f5c-edbe447c7025 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:32.618691 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 148/283] 10.222.0.16 () {56 vars in 1101 bytes} [Thu May 26 12:20:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:32.620409 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad3e64-da8c-4951-9b22-fca5c4d95bdf None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:32.621156 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad3e64-da8c-4951-9b22-fca5c4d95bdf None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:32.621435 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad3e64-da8c-4951-9b22-fca5c4d95bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:32.631811 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a750f-a85a-47d1-b22c-5591565d27c4 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:32.643073 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-1cad3e64-da8c-4951-9b22-fca5c4d95bdf None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:32.644722 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-1cad3e64-da8c-4951-9b22-fca5c4d95bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:32.674576 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce512f6-8981-4d9e-84ae-0b80b9849111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:32.675392 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce512f6-8981-4d9e-84ae-0b80b9849111 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:32.675681 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce512f6-8981-4d9e-84ae-0b80b9849111 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:32.676289 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce512f6-8981-4d9e-84ae-0b80b9849111 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:32.677419 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce512f6-8981-4d9e-84ae-0b80b9849111 None admin] RBAC: Adding query filter params (role.id=b0bf2a578f0a4319b93dd3b8a26a96b7, user.id=6a2ade92e7e74eb9a595615ddbaf516f, scope.system=all) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:32.677742 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce512f6-8981-4d9e-84ae-0b80b9849111 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:32.679246 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce512f6-8981-4d9e-84ae-0b80b9849111 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:32.685940 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 136/284] 10.222.0.16 () {56 vars in 1308 bytes} [Thu May 26 12:20:32 2022] GET /identity/v3/role_assignments?user.id=6a2ade92e7e74eb9a595615ddbaf516f&scope.system=all&role.id=b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:32.687663 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce512f6-8981-4d9e-84ae-0b80b9849111 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:32.739011 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 149/285] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:20:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:20:32.764865 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad3e64-da8c-4951-9b22-fca5c4d95bdf None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:32.783263 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:32.820221 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:32.891382 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce512f6-8981-4d9e-84ae-0b80b9849111 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:32.956171 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642bc1ae-fcb3-41fd-9582-bd7f893eb25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:32.957363 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad3e64-da8c-4951-9b22-fca5c4d95bdf None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:32.957740 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642bc1ae-fcb3-41fd-9582-bd7f893eb25d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:32.958224 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642bc1ae-fcb3-41fd-9582-bd7f893eb25d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:32.958695 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642bc1ae-fcb3-41fd-9582-bd7f893eb25d None admin] PATH_INFO: `/v3/users/7b50af76be32494ba5593df37f418563` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:32.961063 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642bc1ae-fcb3-41fd-9582-bd7f893eb25d None admin] RBAC: Authorizing `identity:get_user(user_id=7b50af76be32494ba5593df37f418563)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:32.962777 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642bc1ae-fcb3-41fd-9582-bd7f893eb25d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:32.964639 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 137/286] 10.222.0.16 () {56 vars in 1177 bytes} [Thu May 26 12:20:32 2022] GET /identity/v3/users/7b50af76be32494ba5593df37f418563 => generated 297 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:32.970762 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642bc1ae-fcb3-41fd-9582-bd7f893eb25d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:33.022158 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8aea09-04f9-4a40-90a5-ea96511bd0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:33.022894 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8aea09-04f9-4a40-90a5-ea96511bd0e7 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:33.023181 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8aea09-04f9-4a40-90a5-ea96511bd0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:33.023461 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8aea09-04f9-4a40-90a5-ea96511bd0e7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:33.048099 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8aea09-04f9-4a40-90a5-ea96511bd0e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:20:33.061836 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-1f8aea09-04f9-4a40-90a5-ea96511bd0e7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:20:33.061836 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:33.061836 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:33.061836 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:33.061836 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:33.061836 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:33.061836 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:33.061836 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:33.061836 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:33.061836 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:33.061836 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:33.061836 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:33.061836 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:20:33.061836 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:20:33.061836 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:20:33.061836 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:20:33.062757 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:20:33.062757 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:20:33.062757 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:20:33.062757 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:20:33.062757 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:33.062757 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:33.062757 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:33.062757 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:33.062757 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:33.062757 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:33.062757 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:33.062757 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:20:33.062757 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:33.062757 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:33.062757 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:33.062757 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:33.064092 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:33.064092 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:33.064092 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:33.064092 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:33.064092 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:20:33.064092 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:20:33.064092 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:20:33.064092 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:20:33.064092 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:20:33.064092 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:20:33.064092 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:20:33.064092 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:20:33.064092 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 150/287] 10.222.0.16 () {56 vars in 1099 bytes} [Thu May 26 12:20:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:20:33.069701 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8aea09-04f9-4a40-90a5-ea96511bd0e7 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:33.085738 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642bc1ae-fcb3-41fd-9582-bd7f893eb25d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:33.109440 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:33.130820 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a2330c-2b6c-48cf-8735-0f2a421c6a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:33.131768 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2330c-2b6c-48cf-8735-0f2a421c6a24 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:33.132053 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2330c-2b6c-48cf-8735-0f2a421c6a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:33.132330 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2330c-2b6c-48cf-8735-0f2a421c6a24 None admin] PATH_INFO: `/v3/projects/b7b56cecd1b744e7aa956f6480beb5cf` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:33.133592 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a2330c-2b6c-48cf-8735-0f2a421c6a24 None admin] RBAC: Authorizing `identity:get_project(project_id=b7b56cecd1b744e7aa956f6480beb5cf)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:33.135083 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a2330c-2b6c-48cf-8735-0f2a421c6a24 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:33.137244 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 138/288] 10.222.0.16 () {56 vars in 1186 bytes} [Thu May 26 12:20:32 2022] GET /identity/v3/projects/b7b56cecd1b744e7aa956f6480beb5cf => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:33.142969 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a2330c-2b6c-48cf-8735-0f2a421c6a24 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:33.274025 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:33.284335 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a2330c-2b6c-48cf-8735-0f2a421c6a24 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:33.320325 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31779284-fb1c-4854-a477-4dd4c7b79e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:33.321251 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31779284-fb1c-4854-a477-4dd4c7b79e9b None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:33.321544 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31779284-fb1c-4854-a477-4dd4c7b79e9b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:33.321821 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31779284-fb1c-4854-a477-4dd4c7b79e9b None admin] PATH_INFO: `/v3/projects/b7b56cecd1b744e7aa956f6480beb5cf/users/7b50af76be32494ba5593df37f418563/roles/c23f3f2e6c7e4a259066d5527cd0ab25` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:33.322978 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8aea09-04f9-4a40-90a5-ea96511bd0e7 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:33.323807 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31779284-fb1c-4854-a477-4dd4c7b79e9b None admin] RBAC: Authorizing `identity:create_grant(project_id=b7b56cecd1b744e7aa956f6480beb5cf, user_id=7b50af76be32494ba5593df37f418563, role_id=c23f3f2e6c7e4a259066d5527cd0ab25)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:33.325309 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31779284-fb1c-4854-a477-4dd4c7b79e9b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:33.349045 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 139/289] 10.222.0.16 () {58 vars in 1439 bytes} [Thu May 26 12:20:33 2022] PUT /identity/v3/projects/b7b56cecd1b744e7aa956f6480beb5cf/users/7b50af76be32494ba5593df37f418563/roles/c23f3f2e6c7e4a259066d5527cd0ab25 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:20:33.367093 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2cfcfe-5e15-4d6f-ba63-e78f05c996c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:33.367772 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2cfcfe-5e15-4d6f-ba63-e78f05c996c1 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:33.368056 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2cfcfe-5e15-4d6f-ba63-e78f05c996c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:33.368331 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2cfcfe-5e15-4d6f-ba63-e78f05c996c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:33.369237 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2cfcfe-5e15-4d6f-ba63-e78f05c996c1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:33.369551 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2cfcfe-5e15-4d6f-ba63-e78f05c996c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:33.370987 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2cfcfe-5e15-4d6f-ba63-e78f05c996c1 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:33.381387 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 151/290] 10.222.0.16 () {56 vars in 1101 bytes} [Thu May 26 12:20:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:20:33.386452 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31779284-fb1c-4854-a477-4dd4c7b79e9b None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:33.480096 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:33.562833 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31779284-fb1c-4854-a477-4dd4c7b79e9b None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:33.613233 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7847430-8ab8-4b02-a2c9-799eb0c1f138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:33.614125 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7847430-8ab8-4b02-a2c9-799eb0c1f138 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:33.614405 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7847430-8ab8-4b02-a2c9-799eb0c1f138 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:33.614679 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7847430-8ab8-4b02-a2c9-799eb0c1f138 None admin] PATH_INFO: `/v3/users/28f9fb6152884e54b5f6ed365ab0f5d0` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:33.615917 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7847430-8ab8-4b02-a2c9-799eb0c1f138 None admin] RBAC: Authorizing `identity:get_user(user_id=28f9fb6152884e54b5f6ed365ab0f5d0)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:33.617488 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7847430-8ab8-4b02-a2c9-799eb0c1f138 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:33.619540 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 140/291] 10.222.0.16 () {56 vars in 1177 bytes} [Thu May 26 12:20:33 2022] GET /identity/v3/users/28f9fb6152884e54b5f6ed365ab0f5d0 => generated 297 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:33.624698 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2cfcfe-5e15-4d6f-ba63-e78f05c996c1 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:33.745261 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2cfcfe-5e15-4d6f-ba63-e78f05c996c1 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:33.818530 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7c36e-fc9c-4a8a-91d6-44eecaa08f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:33.819106 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7c36e-fc9c-4a8a-91d6-44eecaa08f0e None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:33.819389 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7c36e-fc9c-4a8a-91d6-44eecaa08f0e None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:33.819829 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7c36e-fc9c-4a8a-91d6-44eecaa08f0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:33.841228 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:33.896082 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c7c36e-fc9c-4a8a-91d6-44eecaa08f0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:33.901943 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c7c36e-fc9c-4a8a-91d6-44eecaa08f0e None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:34.017479 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 152/292] 10.222.0.16 () {58 vars in 1282 bytes} [Thu May 26 12:20:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:20:34.024265 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7847430-8ab8-4b02-a2c9-799eb0c1f138 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:34.163791 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7847430-8ab8-4b02-a2c9-799eb0c1f138 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:34.177421 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:34.199522 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc187c-49db-4534-9b41-31aef1fd6a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:34.200399 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc187c-49db-4534-9b41-31aef1fd6a31 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:34.200680 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc187c-49db-4534-9b41-31aef1fd6a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:34.200993 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc187c-49db-4534-9b41-31aef1fd6a31 None admin] PATH_INFO: `/v3/projects/b7b56cecd1b744e7aa956f6480beb5cf` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:34.202498 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebc187c-49db-4534-9b41-31aef1fd6a31 None admin] RBAC: Authorizing `identity:get_project(project_id=b7b56cecd1b744e7aa956f6480beb5cf)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:34.203965 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebc187c-49db-4534-9b41-31aef1fd6a31 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:34.206256 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 141/293] 10.222.0.16 () {56 vars in 1186 bytes} [Thu May 26 12:20:34 2022] GET /identity/v3/projects/b7b56cecd1b744e7aa956f6480beb5cf => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:34.212497 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7c36e-fc9c-4a8a-91d6-44eecaa08f0e None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:34.274597 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:34.344073 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7c36e-fc9c-4a8a-91d6-44eecaa08f0e None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:34.389712 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df08181-54a6-45a0-bd53-8bf1cca3f41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:34.390373 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df08181-54a6-45a0-bd53-8bf1cca3f41d None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:34.390652 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df08181-54a6-45a0-bd53-8bf1cca3f41d None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:34.390925 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df08181-54a6-45a0-bd53-8bf1cca3f41d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:34.392319 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df08181-54a6-45a0-bd53-8bf1cca3f41d None admin] RBAC: Adding query filter params (role.id=b0bf2a578f0a4319b93dd3b8a26a96b7, scope.project.id=b7b56cecd1b744e7aa956f6480beb5cf, user.id=28f9fb6152884e54b5f6ed365ab0f5d0) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:34.392632 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df08181-54a6-45a0-bd53-8bf1cca3f41d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:34.394095 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df08181-54a6-45a0-bd53-8bf1cca3f41d None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:34.405549 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 153/294] 10.222.0.16 () {56 vars in 1374 bytes} [Thu May 26 12:20:34 2022] GET /identity/v3/role_assignments?user.id=28f9fb6152884e54b5f6ed365ab0f5d0&scope.project.id=b7b56cecd1b744e7aa956f6480beb5cf&role.id=b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:34.842104 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1fc9a-0171-43d1-8e72-24c5a6987860 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:34.842616 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1fc9a-0171-43d1-8e72-24c5a6987860 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:34.842895 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1fc9a-0171-43d1-8e72-24c5a6987860 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:34.845356 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 142/295] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:20:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:34.851735 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e1decb-5e2d-4b9f-a71f-7a7b04042123 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:34.852196 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e1decb-5e2d-4b9f-a71f-7a7b04042123 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:34.852540 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e1decb-5e2d-4b9f-a71f-7a7b04042123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:34.872822 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-83e1decb-5e2d-4b9f-a71f-7a7b04042123 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:34.874040 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-83e1decb-5e2d-4b9f-a71f-7a7b04042123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:34.949794 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 154/296] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:20:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:20:34.965418 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af826be3-e045-45d6-88e9-f08d4aff76e4 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:34.965755 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af826be3-e045-45d6-88e9-f08d4aff76e4 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:34.966227 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af826be3-e045-45d6-88e9-f08d4aff76e4 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:34.967832 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 143/297] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:20:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:34.972962 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d096ae-eb23-4551-a45c-61432eebaee3 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:34.973253 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d096ae-eb23-4551-a45c-61432eebaee3 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:34.973525 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d096ae-eb23-4551-a45c-61432eebaee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:34.977091 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af826be3-e045-45d6-88e9-f08d4aff76e4 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:34.993185 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-78d096ae-eb23-4551-a45c-61432eebaee3 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:34.994682 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-78d096ae-eb23-4551-a45c-61432eebaee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:35.040468 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:35.075807 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 155/298] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:20:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:20:35.099175 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d096ae-eb23-4551-a45c-61432eebaee3 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:35.102750 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af826be3-e045-45d6-88e9-f08d4aff76e4 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:35.139333 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4616e2-a77d-46c3-8063-ec301117d26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:35.140130 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4616e2-a77d-46c3-8063-ec301117d26e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:35.140412 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4616e2-a77d-46c3-8063-ec301117d26e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:35.140687 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4616e2-a77d-46c3-8063-ec301117d26e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:35.142134 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4616e2-a77d-46c3-8063-ec301117d26e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:35.143592 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4616e2-a77d-46c3-8063-ec301117d26e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:35.150194 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 144/299] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:20:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:35.152386 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4616e2-a77d-46c3-8063-ec301117d26e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:35.205967 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:35.216867 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d096ae-eb23-4551-a45c-61432eebaee3 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:35.254305 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50dcd31-5a21-4e9d-a0ba-7fa9773a07cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:35.255489 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50dcd31-5a21-4e9d-a0ba-7fa9773a07cf None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:35.256024 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50dcd31-5a21-4e9d-a0ba-7fa9773a07cf None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:35.256596 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50dcd31-5a21-4e9d-a0ba-7fa9773a07cf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:35.262566 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4616e2-a77d-46c3-8063-ec301117d26e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:35.267667 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50dcd31-5a21-4e9d-a0ba-7fa9773a07cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:20:35.276153 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-b50dcd31-5a21-4e9d-a0ba-7fa9773a07cf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:20:35.276153 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:35.276153 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:35.276153 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:35.276153 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:35.276153 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:35.276153 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:35.276153 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:35.276153 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:35.276153 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:35.276153 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:35.276153 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:35.276153 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:20:35.276153 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:20:35.276153 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:20:35.276153 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:20:35.277048 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:20:35.277048 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:20:35.277048 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:20:35.277048 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:20:35.277048 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:35.277048 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:35.277048 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:35.277048 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:35.277048 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:35.277048 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:35.277048 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:35.277048 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:20:35.277048 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:35.277048 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:35.277048 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:35.277048 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:35.277866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:35.277866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:35.277866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:35.277866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:35.277866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:20:35.277866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:20:35.277866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:20:35.277866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:20:35.277866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:20:35.277866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:20:35.277866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:20:35.277866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:20:35.285694 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 156/300] 10.222.0.16 () {56 vars in 1099 bytes} [Thu May 26 12:20:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:20:35.286854 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50dcd31-5a21-4e9d-a0ba-7fa9773a07cf None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:35.299181 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab1840-c263-4729-b909-4f8dda926eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:35.299840 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab1840-c263-4729-b909-4f8dda926eff None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:35.300121 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab1840-c263-4729-b909-4f8dda926eff None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:35.300395 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab1840-c263-4729-b909-4f8dda926eff None admin] PATH_INFO: `/v3/groups` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:35.301179 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dab1840-c263-4729-b909-4f8dda926eff None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:35.302766 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dab1840-c263-4729-b909-4f8dda926eff None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:35.324865 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 145/301] 10.222.0.16 () {60 vars in 1134 bytes} [Thu May 26 12:20:35 2022] POST /identity/v3/groups => generated 229 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:20:35.332194 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:35.418507 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50dcd31-5a21-4e9d-a0ba-7fa9773a07cf None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:35.457019 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1839334-cd76-4933-aeb4-bde542c19b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:35.457700 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1839334-cd76-4933-aeb4-bde542c19b6b None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:35.457985 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1839334-cd76-4933-aeb4-bde542c19b6b None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:35.458261 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1839334-cd76-4933-aeb4-bde542c19b6b None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:35.459027 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1839334-cd76-4933-aeb4-bde542c19b6b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:35.459333 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1839334-cd76-4933-aeb4-bde542c19b6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:35.460731 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1839334-cd76-4933-aeb4-bde542c19b6b None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:35.472061 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 157/302] 10.222.0.16 () {56 vars in 1101 bytes} [Thu May 26 12:20:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:35.477997 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab1840-c263-4729-b909-4f8dda926eff None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:35.539535 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a9362-bfcd-496c-9a1c-7c93150bd71e None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:35.539825 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a9362-bfcd-496c-9a1c-7c93150bd71e None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:35.540133 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a9362-bfcd-496c-9a1c-7c93150bd71e None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:35.541843 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 158/303] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:20:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:20:35.547032 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af3216-dba6-4796-95c6-fe26c97c0944 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:35.547324 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af3216-dba6-4796-95c6-fe26c97c0944 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:35.547641 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af3216-dba6-4796-95c6-fe26c97c0944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:35.566849 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-a4af3216-dba6-4796-95c6-fe26c97c0944 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:35.567971 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-a4af3216-dba6-4796-95c6-fe26c97c0944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:35.600344 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab1840-c263-4729-b909-4f8dda926eff None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:35.612498 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:35.649093 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71521c34-e3b2-4205-b0e7-eac21d42be2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:35.650132 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71521c34-e3b2-4205-b0e7-eac21d42be2d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:35.650540 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71521c34-e3b2-4205-b0e7-eac21d42be2d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:35.650824 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71521c34-e3b2-4205-b0e7-eac21d42be2d None admin] PATH_INFO: `/v3/users/5ae010e19b674d4fbd1b0c5da7fa5cbd` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:35.652622 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 159/304] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:20:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:20:35.665712 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71521c34-e3b2-4205-b0e7-eac21d42be2d None admin] RBAC: Authorizing `identity:get_user(user_id=5ae010e19b674d4fbd1b0c5da7fa5cbd)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:35.667211 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71521c34-e3b2-4205-b0e7-eac21d42be2d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:35.669070 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 146/305] 10.222.0.16 () {56 vars in 1177 bytes} [Thu May 26 12:20:35 2022] GET /identity/v3/users/5ae010e19b674d4fbd1b0c5da7fa5cbd => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:35.675085 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af3216-dba6-4796-95c6-fe26c97c0944 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:35.678475 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71521c34-e3b2-4205-b0e7-eac21d42be2d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:35.709098 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:35.800423 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af3216-dba6-4796-95c6-fe26c97c0944 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:35.804713 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71521c34-e3b2-4205-b0e7-eac21d42be2d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:35.839554 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270787b4-8905-4ea5-a9af-8264263a7bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:35.840208 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270787b4-8905-4ea5-a9af-8264263a7bb0 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:35.840554 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270787b4-8905-4ea5-a9af-8264263a7bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:35.840828 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270787b4-8905-4ea5-a9af-8264263a7bb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:35.841953 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270787b4-8905-4ea5-a9af-8264263a7bb0 None admin] RBAC: Adding query filter params (role.id=c23f3f2e6c7e4a259066d5527cd0ab25, user.id=5ae010e19b674d4fbd1b0c5da7fa5cbd, scope.system=all) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:35.842260 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270787b4-8905-4ea5-a9af-8264263a7bb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:35.844013 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270787b4-8905-4ea5-a9af-8264263a7bb0 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:35.849360 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a8072-62a1-4764-bf67-31e785c07c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:35.850162 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a8072-62a1-4764-bf67-31e785c07c6f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:35.850484 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 160/306] 10.222.0.16 () {56 vars in 1308 bytes} [Thu May 26 12:20:35 2022] GET /identity/v3/role_assignments?user.id=5ae010e19b674d4fbd1b0c5da7fa5cbd&scope.system=all&role.id=c23f3f2e6c7e4a259066d5527cd0ab25 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:35.852937 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a8072-62a1-4764-bf67-31e785c07c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:35.853271 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a8072-62a1-4764-bf67-31e785c07c6f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:35.869053 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589a8072-62a1-4764-bf67-31e785c07c6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:20:35.877704 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-589a8072-62a1-4764-bf67-31e785c07c6f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:20:35.877704 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:35.877704 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:35.877704 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:35.877704 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:35.877704 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:35.877704 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:35.877704 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:35.877704 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:35.877704 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:35.877704 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:35.877704 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:35.877704 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:20:35.877704 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:20:35.877704 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:20:35.877704 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:20:35.878668 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:20:35.878668 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:20:35.878668 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:20:35.878668 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:20:35.878668 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:35.878668 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:35.878668 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:35.878668 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:35.878668 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:35.878668 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:35.878668 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:35.878668 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:20:35.878668 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:35.878668 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:35.878668 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:35.878668 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:35.879541 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:35.879541 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:35.879541 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:35.879541 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:35.879541 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:20:35.879541 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:20:35.879541 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:20:35.879541 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:20:35.879541 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:20:35.879541 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:20:35.879541 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:20:35.879541 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:20:35.879541 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 147/307] 10.222.0.16 () {56 vars in 1099 bytes} [Thu May 26 12:20:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:20:35.885247 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270787b4-8905-4ea5-a9af-8264263a7bb0 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:35.984461 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:35.984863 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7290d9-5feb-44f6-99b8-0b17b0abef65 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:35.985418 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7290d9-5feb-44f6-99b8-0b17b0abef65 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:35.985826 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7290d9-5feb-44f6-99b8-0b17b0abef65 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:35.987673 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 148/308] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:20:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:35.993315 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011e9a1-feea-4cac-871f-348d130727f8 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:35.993980 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011e9a1-feea-4cac-871f-348d130727f8 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:35.994443 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011e9a1-feea-4cac-871f-348d130727f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:35.999816 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270787b4-8905-4ea5-a9af-8264263a7bb0 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:36.013647 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-e011e9a1-feea-4cac-871f-348d130727f8 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:36.015356 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e011e9a1-feea-4cac-871f-348d130727f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:36.042297 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:36.044421 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e6bcb-a6ee-49f1-9ddd-3c10440ff1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:36.045164 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e6bcb-a6ee-49f1-9ddd-3c10440ff1f8 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:36.045450 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e6bcb-a6ee-49f1-9ddd-3c10440ff1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:36.045957 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e6bcb-a6ee-49f1-9ddd-3c10440ff1f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:36.047449 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274e6bcb-a6ee-49f1-9ddd-3c10440ff1f8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:36.047798 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274e6bcb-a6ee-49f1-9ddd-3c10440ff1f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:36.049595 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274e6bcb-a6ee-49f1-9ddd-3c10440ff1f8 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:36.062119 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 161/309] 10.222.0.16 () {56 vars in 1101 bytes} [Thu May 26 12:20:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:36.067850 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e6bcb-a6ee-49f1-9ddd-3c10440ff1f8 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:36.111671 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 149/310] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:20:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:20:36.139941 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e011e9a1-feea-4cac-871f-348d130727f8 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:36.187202 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e6bcb-a6ee-49f1-9ddd-3c10440ff1f8 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:36.223314 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1297f1c-5640-4b97-897a-e72431707280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:36.224200 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1297f1c-5640-4b97-897a-e72431707280 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:36.224480 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1297f1c-5640-4b97-897a-e72431707280 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:36.224753 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1297f1c-5640-4b97-897a-e72431707280 None admin] PATH_INFO: `/v3/users/6a2ade92e7e74eb9a595615ddbaf516f` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:36.225984 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1297f1c-5640-4b97-897a-e72431707280 None admin] RBAC: Authorizing `identity:get_user(user_id=6a2ade92e7e74eb9a595615ddbaf516f)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:36.227619 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1297f1c-5640-4b97-897a-e72431707280 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:36.229878 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 162/311] 10.222.0.16 () {56 vars in 1177 bytes} [Thu May 26 12:20:36 2022] GET /identity/v3/users/6a2ade92e7e74eb9a595615ddbaf516f => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:20:36.241900 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1297f1c-5640-4b97-897a-e72431707280 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:36.248177 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e011e9a1-feea-4cac-871f-348d130727f8 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:36.263135 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:36.283658 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a09e6-93f9-42c5-a966-7160f9eae0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:36.284462 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a09e6-93f9-42c5-a966-7160f9eae0d3 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:36.284747 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a09e6-93f9-42c5-a966-7160f9eae0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:36.285054 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a09e6-93f9-42c5-a966-7160f9eae0d3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:36.295472 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509a09e6-93f9-42c5-a966-7160f9eae0d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:20:36.303820 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-509a09e6-93f9-42c5-a966-7160f9eae0d3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:20:36.303820 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:36.303820 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:36.303820 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:36.303820 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:36.303820 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:36.303820 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:36.303820 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:36.303820 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:36.303820 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:36.303820 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:36.303820 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:36.303820 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:20:36.303820 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:20:36.303820 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:20:36.303820 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:20:36.304917 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:20:36.304917 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:20:36.304917 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:20:36.304917 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:20:36.304917 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:36.304917 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:36.304917 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:36.304917 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:36.304917 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:36.304917 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:36.304917 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:36.304917 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:20:36.304917 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:36.304917 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:36.304917 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:36.304917 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:36.305907 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:36.305907 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:36.305907 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:36.305907 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:36.305907 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:20:36.305907 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:20:36.305907 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:20:36.305907 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:20:36.305907 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:20:36.305907 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:20:36.305907 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:20:36.305907 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:20:36.309880 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 150/312] 10.222.0.16 () {56 vars in 1099 bytes} [Thu May 26 12:20:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:20:36.310739 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a09e6-93f9-42c5-a966-7160f9eae0d3 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:36.329926 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:36.357107 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1297f1c-5640-4b97-897a-e72431707280 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:36.404122 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db6a2a4-a385-4cbf-8049-926ed449d66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:36.404927 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6a2a4-a385-4cbf-8049-926ed449d66c None admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:36.405209 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6a2a4-a385-4cbf-8049-926ed449d66c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:36.405481 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6a2a4-a385-4cbf-8049-926ed449d66c None admin] PATH_INFO: `/v3/system/users/6a2ade92e7e74eb9a595615ddbaf516f/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:36.406998 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db6a2a4-a385-4cbf-8049-926ed449d66c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=6a2ade92e7e74eb9a595615ddbaf516f, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:36.408387 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db6a2a4-a385-4cbf-8049-926ed449d66c None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:36.419525 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 163/313] 10.222.0.16 () {58 vars in 1334 bytes} [Thu May 26 12:20:36 2022] PUT /identity/v3/system/users/6a2ade92e7e74eb9a595615ddbaf516f/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:20:36.427561 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a09e6-93f9-42c5-a966-7160f9eae0d3 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:36.470357 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5a494-9965-4b26-9f2f-061595eed5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:36.471320 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5a494-9965-4b26-9f2f-061595eed5ed None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:36.471815 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5a494-9965-4b26-9f2f-061595eed5ed None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:36.472295 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5a494-9965-4b26-9f2f-061595eed5ed None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:36.473282 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5a494-9965-4b26-9f2f-061595eed5ed None admin] RBAC: Adding query filter params (name=reader) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:36.473741 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5a494-9965-4b26-9f2f-061595eed5ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:36.475363 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5a494-9965-4b26-9f2f-061595eed5ed None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:36.486442 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 151/314] 10.222.0.16 () {56 vars in 1101 bytes} [Thu May 26 12:20:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:36.498334 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db6a2a4-a385-4cbf-8049-926ed449d66c None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:36.599167 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:36.621006 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db6a2a4-a385-4cbf-8049-926ed449d66c None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:36.655934 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64075546-936e-48ee-b9c2-ea36b6f80b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:36.656739 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64075546-936e-48ee-b9c2-ea36b6f80b3c None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:36.657585 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64075546-936e-48ee-b9c2-ea36b6f80b3c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:36.657865 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64075546-936e-48ee-b9c2-ea36b6f80b3c None admin] PATH_INFO: `/v3/users/7b50af76be32494ba5593df37f418563` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:36.659091 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64075546-936e-48ee-b9c2-ea36b6f80b3c None admin] RBAC: Authorizing `identity:get_user(user_id=7b50af76be32494ba5593df37f418563)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:36.660541 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64075546-936e-48ee-b9c2-ea36b6f80b3c None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:36.662437 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 164/315] 10.222.0.16 () {56 vars in 1177 bytes} [Thu May 26 12:20:36 2022] GET /identity/v3/users/7b50af76be32494ba5593df37f418563 => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:36.667957 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5a494-9965-4b26-9f2f-061595eed5ed None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:36.769407 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:36.775398 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5a494-9965-4b26-9f2f-061595eed5ed None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:36.811014 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3067300-892e-4bf9-8c57-93e0f00bf286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:36.811729 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3067300-892e-4bf9-8c57-93e0f00bf286 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:36.812021 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3067300-892e-4bf9-8c57-93e0f00bf286 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:36.812304 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3067300-892e-4bf9-8c57-93e0f00bf286 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:36.882126 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3067300-892e-4bf9-8c57-93e0f00bf286 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:36.883602 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3067300-892e-4bf9-8c57-93e0f00bf286 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:36.961816 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:36.985049 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 152/316] 10.222.0.16 () {58 vars in 1282 bytes} [Thu May 26 12:20:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:20:36.990664 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64075546-936e-48ee-b9c2-ea36b6f80b3c None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:37.095439 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64075546-936e-48ee-b9c2-ea36b6f80b3c None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:37.129136 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d36e8-78ff-45e1-8cc2-5226558ab3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:37.130004 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d36e8-78ff-45e1-8cc2-5226558ab3c5 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:37.130291 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d36e8-78ff-45e1-8cc2-5226558ab3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:37.130570 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d36e8-78ff-45e1-8cc2-5226558ab3c5 None admin] PATH_INFO: `/v3/projects/b7b56cecd1b744e7aa956f6480beb5cf` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:37.131764 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46d36e8-78ff-45e1-8cc2-5226558ab3c5 None admin] RBAC: Authorizing `identity:get_project(project_id=b7b56cecd1b744e7aa956f6480beb5cf)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:37.133225 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46d36e8-78ff-45e1-8cc2-5226558ab3c5 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:37.135226 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 165/317] 10.222.0.16 () {56 vars in 1186 bytes} [Thu May 26 12:20:36 2022] GET /identity/v3/projects/b7b56cecd1b744e7aa956f6480beb5cf => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:37.141204 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3067300-892e-4bf9-8c57-93e0f00bf286 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:37.245119 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3067300-892e-4bf9-8c57-93e0f00bf286 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:37.281467 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b76227-c311-4c7e-bc52-b381963229f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:37.282696 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b76227-c311-4c7e-bc52-b381963229f8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:37.282982 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b76227-c311-4c7e-bc52-b381963229f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:37.283259 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b76227-c311-4c7e-bc52-b381963229f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:37.284097 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b76227-c311-4c7e-bc52-b381963229f8 None admin] RBAC: Adding query filter params (role.id=c23f3f2e6c7e4a259066d5527cd0ab25, scope.project.id=b7b56cecd1b744e7aa956f6480beb5cf, user.id=7b50af76be32494ba5593df37f418563) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:37.284411 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b76227-c311-4c7e-bc52-b381963229f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:37.285909 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b76227-c311-4c7e-bc52-b381963229f8 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:37.292505 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 153/318] 10.222.0.16 () {56 vars in 1374 bytes} [Thu May 26 12:20:37 2022] GET /identity/v3/role_assignments?user.id=7b50af76be32494ba5593df37f418563&scope.project.id=b7b56cecd1b744e7aa956f6480beb5cf&role.id=c23f3f2e6c7e4a259066d5527cd0ab25 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:37.724557 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ba578-b491-477a-8515-548614a0a514 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:37.724921 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ba578-b491-477a-8515-548614a0a514 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:37.725163 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ba578-b491-477a-8515-548614a0a514 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:37.726681 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 166/319] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:20:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:37.731702 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b378b7-13ea-4c45-a1af-dbff500abee0 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:37.732000 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b378b7-13ea-4c45-a1af-dbff500abee0 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:37.732279 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b378b7-13ea-4c45-a1af-dbff500abee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:37.749310 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-96b378b7-13ea-4c45-a1af-dbff500abee0 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:37.750364 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-96b378b7-13ea-4c45-a1af-dbff500abee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:37.787746 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:37.820133 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 154/320] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:20:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:20:37.842945 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ba578-b491-477a-8515-548614a0a514 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:37.863281 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:37.950073 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ba578-b491-477a-8515-548614a0a514 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:37.988380 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d1871-4f4b-470f-82fb-cba827f2e40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:37.989193 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d1871-4f4b-470f-82fb-cba827f2e40c None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:37.989480 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d1871-4f4b-470f-82fb-cba827f2e40c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:37.989759 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d1871-4f4b-470f-82fb-cba827f2e40c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:37.991305 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2d1871-4f4b-470f-82fb-cba827f2e40c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:37.992381 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2d1871-4f4b-470f-82fb-cba827f2e40c None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:37.994189 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 167/321] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:20:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:37.999704 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b378b7-13ea-4c45-a1af-dbff500abee0 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:38.102020 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b378b7-13ea-4c45-a1af-dbff500abee0 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:38.137114 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ab3f1-d68c-4dfd-80cd-1e58fdb67e0b None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:38.137630 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ab3f1-d68c-4dfd-80cd-1e58fdb67e0b None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:38.137905 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ab3f1-d68c-4dfd-80cd-1e58fdb67e0b None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:38.138688 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b045225c-6fa5-4ac9-bf8f-d3052715d40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:38.139443 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 168/322] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:20:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:20:38.139642 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045225c-6fa5-4ac9-bf8f-d3052715d40d None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:38.139642 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045225c-6fa5-4ac9-bf8f-d3052715d40d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:38.139898 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045225c-6fa5-4ac9-bf8f-d3052715d40d None admin] PATH_INFO: `/v3/groups` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:38.140597 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b045225c-6fa5-4ac9-bf8f-d3052715d40d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:38.142658 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b045225c-6fa5-4ac9-bf8f-d3052715d40d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:38.145004 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38628af6-dc96-4681-9ac6-8f644bece63d None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:38.145329 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38628af6-dc96-4681-9ac6-8f644bece63d None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:38.145609 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38628af6-dc96-4681-9ac6-8f644bece63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:38.157213 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 155/323] 10.222.0.16 () {60 vars in 1134 bytes} [Thu May 26 12:20:37 2022] POST /identity/v3/groups => generated 226 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:20:38.164095 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-38628af6-dc96-4681-9ac6-8f644bece63d None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:38.165344 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-38628af6-dc96-4681-9ac6-8f644bece63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:38.240273 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 169/324] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:20:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:20:38.263280 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b045225c-6fa5-4ac9-bf8f-d3052715d40d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:38.298052 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:38.377387 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b045225c-6fa5-4ac9-bf8f-d3052715d40d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:38.416357 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60701264-0c50-4aa9-b9aa-fdaa32f6f8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:38.417185 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60701264-0c50-4aa9-b9aa-fdaa32f6f8e3 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:38.417465 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60701264-0c50-4aa9-b9aa-fdaa32f6f8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:38.417737 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60701264-0c50-4aa9-b9aa-fdaa32f6f8e3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:38.428723 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60701264-0c50-4aa9-b9aa-fdaa32f6f8e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:20:38.436394 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-60701264-0c50-4aa9-b9aa-fdaa32f6f8e3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:20:38.436394 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:38.436394 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:38.436394 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:38.436394 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:38.436394 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:38.436394 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:38.436394 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:38.436394 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:38.436394 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:38.436394 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:38.436394 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:38.436394 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:20:38.436394 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:20:38.436394 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:20:38.436394 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:20:38.437393 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:20:38.437393 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:20:38.437393 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:20:38.437393 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:20:38.437393 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:38.437393 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:38.437393 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:38.437393 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:38.437393 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:38.437393 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:38.437393 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:38.437393 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:20:38.437393 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:38.437393 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:38.437393 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:38.437393 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:38.438826 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:38.438826 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:38.438826 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:38.438826 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:38.438826 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:20:38.438826 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:20:38.438826 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:20:38.438826 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:20:38.438826 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:20:38.438826 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:20:38.438826 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:20:38.438826 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:20:38.438826 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 156/325] 10.222.0.16 () {56 vars in 1099 bytes} [Thu May 26 12:20:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:20:38.445341 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38628af6-dc96-4681-9ac6-8f644bece63d None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:38.466279 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:38.556186 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38628af6-dc96-4681-9ac6-8f644bece63d None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:38.597061 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9760ef28-7001-4188-9ad1-09ab3e93c73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:38.597735 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760ef28-7001-4188-9ad1-09ab3e93c73f None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:38.598020 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760ef28-7001-4188-9ad1-09ab3e93c73f None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:38.598300 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760ef28-7001-4188-9ad1-09ab3e93c73f None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:38.599118 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9760ef28-7001-4188-9ad1-09ab3e93c73f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:38.599426 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9760ef28-7001-4188-9ad1-09ab3e93c73f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:38.600889 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9760ef28-7001-4188-9ad1-09ab3e93c73f None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:38.610410 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 170/326] 10.222.0.16 () {56 vars in 1101 bytes} [Thu May 26 12:20:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:38.615780 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60701264-0c50-4aa9-b9aa-fdaa32f6f8e3 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:38.715439 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:38.725154 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60701264-0c50-4aa9-b9aa-fdaa32f6f8e3 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:38.752985 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448182c-04d7-4095-bba1-8903b9de2766 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:38.753110 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448182c-04d7-4095-bba1-8903b9de2766 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:38.753361 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448182c-04d7-4095-bba1-8903b9de2766 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:38.760874 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 171/327] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:20:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:20:38.765100 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f483c8-7d1c-40fb-ad4f-59d457762152 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:38.765391 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f483c8-7d1c-40fb-ad4f-59d457762152 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:38.765669 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f483c8-7d1c-40fb-ad4f-59d457762152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:38.768682 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5fb4c5-7d82-44fb-a798-56fbbd1029af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:38.769688 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5fb4c5-7d82-44fb-a798-56fbbd1029af None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:38.769980 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5fb4c5-7d82-44fb-a798-56fbbd1029af None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:38.770258 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5fb4c5-7d82-44fb-a798-56fbbd1029af None admin] PATH_INFO: `/v3/users/5ae010e19b674d4fbd1b0c5da7fa5cbd` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:38.771484 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5fb4c5-7d82-44fb-a798-56fbbd1029af None admin] RBAC: Authorizing `identity:get_user(user_id=5ae010e19b674d4fbd1b0c5da7fa5cbd)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:38.772994 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5fb4c5-7d82-44fb-a798-56fbbd1029af None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:38.775932 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 157/328] 10.222.0.16 () {56 vars in 1177 bytes} [Thu May 26 12:20:38 2022] GET /identity/v3/users/5ae010e19b674d4fbd1b0c5da7fa5cbd => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:38.782890 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5fb4c5-7d82-44fb-a798-56fbbd1029af None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:38.785435 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-13f483c8-7d1c-40fb-ad4f-59d457762152 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:38.786843 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-13f483c8-7d1c-40fb-ad4f-59d457762152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:38.883876 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 172/329] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:20:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:20:38.911272 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f483c8-7d1c-40fb-ad4f-59d457762152 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:38.914178 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5fb4c5-7d82-44fb-a798-56fbbd1029af None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:38.933202 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:38.951761 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee0fc7-a77c-44c2-8412-c087ee5a8ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:38.952639 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee0fc7-a77c-44c2-8412-c087ee5a8ea4 None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:38.952981 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee0fc7-a77c-44c2-8412-c087ee5a8ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:38.953249 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee0fc7-a77c-44c2-8412-c087ee5a8ea4 None admin] PATH_INFO: `/v3/system/users/5ae010e19b674d4fbd1b0c5da7fa5cbd/roles/c23f3f2e6c7e4a259066d5527cd0ab25` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:38.954815 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fee0fc7-a77c-44c2-8412-c087ee5a8ea4 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5ae010e19b674d4fbd1b0c5da7fa5cbd, role_id=c23f3f2e6c7e4a259066d5527cd0ab25)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:38.956232 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fee0fc7-a77c-44c2-8412-c087ee5a8ea4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:38.968516 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 158/330] 10.222.0.16 () {58 vars in 1334 bytes} [Thu May 26 12:20:38 2022] PUT /identity/v3/system/users/5ae010e19b674d4fbd1b0c5da7fa5cbd/roles/c23f3f2e6c7e4a259066d5527cd0ab25 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:20:39.044107 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f483c8-7d1c-40fb-ad4f-59d457762152 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:39.088462 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab81450b-1a93-42b6-82f2-935fc2e18124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:39.089610 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81450b-1a93-42b6-82f2-935fc2e18124 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:39.090080 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81450b-1a93-42b6-82f2-935fc2e18124 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:39.090532 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81450b-1a93-42b6-82f2-935fc2e18124 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:39.104757 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab81450b-1a93-42b6-82f2-935fc2e18124 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:20:39.113245 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-ab81450b-1a93-42b6-82f2-935fc2e18124 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:20:39.113245 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:39.113245 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:39.113245 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:39.113245 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:39.113245 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:39.113245 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:39.113245 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:39.113245 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:39.113245 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:39.113245 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:39.113245 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:39.113245 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:20:39.113245 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:20:39.113245 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:20:39.113245 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:20:39.114217 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:20:39.114217 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:20:39.114217 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:20:39.114217 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:20:39.114217 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:39.114217 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:39.114217 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:39.114217 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:39.114217 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:39.114217 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:39.114217 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:39.114217 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:20:39.114217 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:39.114217 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:39.114217 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:39.114217 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:39.115075 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:39.115075 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:39.115075 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:39.115075 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:39.115075 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:20:39.115075 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:20:39.115075 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:20:39.115075 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:20:39.115075 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:20:39.115075 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:20:39.115075 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:20:39.115075 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:20:39.117616 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 173/331] 10.222.0.16 () {56 vars in 1099 bytes} [Thu May 26 12:20:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:20:39.123339 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee0fc7-a77c-44c2-8412-c087ee5a8ea4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:39.161893 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:39.248258 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee0fc7-a77c-44c2-8412-c087ee5a8ea4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:39.285424 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d91de5c-82cd-4498-9f7e-cfec96e22cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:39.286097 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91de5c-82cd-4498-9f7e-cfec96e22cef None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:39.286382 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91de5c-82cd-4498-9f7e-cfec96e22cef None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:39.286662 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91de5c-82cd-4498-9f7e-cfec96e22cef None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:39.287416 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d91de5c-82cd-4498-9f7e-cfec96e22cef None admin] RBAC: Adding query filter params (name=member) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:39.287726 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d91de5c-82cd-4498-9f7e-cfec96e22cef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:39.289146 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d91de5c-82cd-4498-9f7e-cfec96e22cef None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:39.299919 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 159/332] 10.222.0.16 () {56 vars in 1101 bytes} [Thu May 26 12:20:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:39.304456 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab81450b-1a93-42b6-82f2-935fc2e18124 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:39.388719 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:39.434815 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab81450b-1a93-42b6-82f2-935fc2e18124 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:39.478066 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573b103-237b-4ef0-bb7e-6c41cff62f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:39.478955 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573b103-237b-4ef0-bb7e-6c41cff62f5c None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:39.479240 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573b103-237b-4ef0-bb7e-6c41cff62f5c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:39.479516 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573b103-237b-4ef0-bb7e-6c41cff62f5c None admin] PATH_INFO: `/v3/users/6a2ade92e7e74eb9a595615ddbaf516f` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:39.480737 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c573b103-237b-4ef0-bb7e-6c41cff62f5c None admin] RBAC: Authorizing `identity:get_user(user_id=6a2ade92e7e74eb9a595615ddbaf516f)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:39.482215 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c573b103-237b-4ef0-bb7e-6c41cff62f5c None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:39.483857 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 174/333] 10.222.0.16 () {56 vars in 1177 bytes} [Thu May 26 12:20:39 2022] GET /identity/v3/users/6a2ade92e7e74eb9a595615ddbaf516f => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:39.490432 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d91de5c-82cd-4498-9f7e-cfec96e22cef None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:39.605224 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:39.622840 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d91de5c-82cd-4498-9f7e-cfec96e22cef None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:39.663434 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc800394-74cf-4287-8bde-8b7a8a4cfaed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:39.664098 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc800394-74cf-4287-8bde-8b7a8a4cfaed None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:39.664382 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc800394-74cf-4287-8bde-8b7a8a4cfaed None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:39.664659 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc800394-74cf-4287-8bde-8b7a8a4cfaed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:39.665526 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc800394-74cf-4287-8bde-8b7a8a4cfaed None admin] RBAC: Adding query filter params (role.id=b0bf2a578f0a4319b93dd3b8a26a96b7, user.id=6a2ade92e7e74eb9a595615ddbaf516f, scope.system=all) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:39.665842 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc800394-74cf-4287-8bde-8b7a8a4cfaed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:39.667368 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc800394-74cf-4287-8bde-8b7a8a4cfaed None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:39.685028 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 160/334] 10.222.0.16 () {56 vars in 1308 bytes} [Thu May 26 12:20:39 2022] GET /identity/v3/role_assignments?user.id=6a2ade92e7e74eb9a595615ddbaf516f&scope.system=all&role.id=b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 510 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:41.127860 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1827339b-ede1-4027-8f77-80da207e6a68 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:41.128336 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1827339b-ede1-4027-8f77-80da207e6a68 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:41.128336 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1827339b-ede1-4027-8f77-80da207e6a68 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:41.129736 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 175/335] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:20:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:41.135132 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab54c2f-7e94-4596-9199-76b8831fcea9 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:41.135569 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab54c2f-7e94-4596-9199-76b8831fcea9 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:41.135741 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab54c2f-7e94-4596-9199-76b8831fcea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:41.157882 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-fab54c2f-7e94-4596-9199-76b8831fcea9 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:41.159150 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-fab54c2f-7e94-4596-9199-76b8831fcea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:41.247691 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 161/336] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:20:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:20:41.283625 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1827339b-ede1-4027-8f77-80da207e6a68 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:41.423500 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1827339b-ede1-4027-8f77-80da207e6a68 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:41.465036 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48533c67-3276-4cdc-8cf9-3835cb1430ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:41.466462 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48533c67-3276-4cdc-8cf9-3835cb1430ca None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:41.466940 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48533c67-3276-4cdc-8cf9-3835cb1430ca None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:41.469111 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48533c67-3276-4cdc-8cf9-3835cb1430ca None admin] PATH_INFO: `/v3/roles/member` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:41.470804 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:41.485978 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48533c67-3276-4cdc-8cf9-3835cb1430ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:20:41.493817 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-48533c67-3276-4cdc-8cf9-3835cb1430ca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:20:41.493817 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:41.493817 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:41.493817 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:41.493817 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:41.493817 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:41.493817 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:41.493817 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:41.493817 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:41.493817 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:41.493817 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:41.493817 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:41.493817 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:20:41.493817 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:20:41.493817 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:20:41.493817 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:20:41.494755 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:20:41.494755 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:20:41.494755 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:20:41.494755 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:20:41.494755 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:41.494755 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:41.494755 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:41.494755 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:41.494755 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:41.494755 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:41.494755 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:41.494755 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:20:41.494755 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:41.494755 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:41.494755 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:41.494755 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:41.495547 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:41.495547 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:41.495547 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:41.495547 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:41.495547 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:20:41.495547 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:20:41.495547 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:20:41.495547 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:20:41.495547 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:20:41.495547 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:20:41.495547 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:20:41.495547 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:20:41.495547 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 176/337] 10.222.0.16 () {56 vars in 1099 bytes} [Thu May 26 12:20:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:20:41.501594 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab54c2f-7e94-4596-9199-76b8831fcea9 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:41.599938 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:41.630920 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab54c2f-7e94-4596-9199-76b8831fcea9 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:41.676244 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737d8b71-ffeb-4b9b-b9e7-feb997ecb733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:41.677320 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d8b71-ffeb-4b9b-b9e7-feb997ecb733 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:41.677827 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d8b71-ffeb-4b9b-b9e7-feb997ecb733 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:41.678319 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d8b71-ffeb-4b9b-b9e7-feb997ecb733 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:41.679277 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737d8b71-ffeb-4b9b-b9e7-feb997ecb733 None admin] RBAC: Adding query filter params (name=member) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:41.679950 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737d8b71-ffeb-4b9b-b9e7-feb997ecb733 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:41.681591 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737d8b71-ffeb-4b9b-b9e7-feb997ecb733 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:41.691801 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 162/338] 10.222.0.16 () {56 vars in 1101 bytes} [Thu May 26 12:20:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:41.696948 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48533c67-3276-4cdc-8cf9-3835cb1430ca None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:41.817839 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ab1dc-05e6-4c06-8006-0529ef99d125 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:41.818460 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ab1dc-05e6-4c06-8006-0529ef99d125 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:41.818966 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ab1dc-05e6-4c06-8006-0529ef99d125 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:41.820538 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 163/339] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:20:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:41.826734 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a1691-b0a7-4945-94c5-bbc0c4449538 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:41.827100 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a1691-b0a7-4945-94c5-bbc0c4449538 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:41.827455 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a1691-b0a7-4945-94c5-bbc0c4449538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:41.856061 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-2d6a1691-b0a7-4945-94c5-bbc0c4449538 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:41.857291 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2d6a1691-b0a7-4945-94c5-bbc0c4449538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:41.862622 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48533c67-3276-4cdc-8cf9-3835cb1430ca None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:41.915951 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc428aea-0af5-4aa3-8afe-d4d123195c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:41.916595 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc428aea-0af5-4aa3-8afe-d4d123195c4b None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:41.916894 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc428aea-0af5-4aa3-8afe-d4d123195c4b None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:41.917176 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc428aea-0af5-4aa3-8afe-d4d123195c4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:41.979097 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 164/340] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:20:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:20:42.013654 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a1691-b0a7-4945-94c5-bbc0c4449538 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:42.017322 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:42.035527 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc428aea-0af5-4aa3-8afe-d4d123195c4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:42.037016 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc428aea-0af5-4aa3-8afe-d4d123195c4b None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:42.141512 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:42.215368 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a1691-b0a7-4945-94c5-bbc0c4449538 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:42.229854 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 177/341] 10.222.0.16 () {58 vars in 1282 bytes} [Thu May 26 12:20:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:20:42.231192 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7bdc9-1278-41b0-8823-d8f94434c709 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:42.231413 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7bdc9-1278-41b0-8823-d8f94434c709 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:42.231687 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7bdc9-1278-41b0-8823-d8f94434c709 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:42.233075 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 178/342] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:20:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:42.238476 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b7bdc9-1278-41b0-8823-d8f94434c709 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:42.260263 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e327bf-981b-4c3c-965f-59e500e96670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:42.261123 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e327bf-981b-4c3c-965f-59e500e96670 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:42.261407 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e327bf-981b-4c3c-965f-59e500e96670 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:42.261681 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e327bf-981b-4c3c-965f-59e500e96670 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:42.285593 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e327bf-981b-4c3c-965f-59e500e96670 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:20:42.303264 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-e5e327bf-981b-4c3c-965f-59e500e96670 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:20:42.303264 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:42.303264 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:42.303264 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:42.303264 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:42.303264 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:42.303264 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:42.303264 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:42.303264 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:42.303264 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:42.303264 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:42.303264 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:42.303264 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:20:42.303264 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:20:42.303264 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:20:42.303264 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:20:42.304195 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:20:42.304195 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:20:42.304195 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:20:42.304195 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:20:42.304195 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:42.304195 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:42.304195 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:42.304195 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:42.304195 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:42.304195 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:42.304195 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:42.304195 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:20:42.304195 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:42.304195 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:42.304195 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:42.304195 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:42.305052 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:42.305052 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:42.305052 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:42.305052 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:42.305052 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:20:42.305052 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:20:42.305052 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:20:42.305052 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:20:42.305052 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:20:42.305052 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:20:42.305052 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:20:42.305052 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:20:42.306559 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 165/343] 10.222.0.16 () {56 vars in 1114 bytes} [Thu May 26 12:20:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:20:42.307503 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74598643-eb6e-4ab0-aa29-b0755c535886 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:42.307503 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74598643-eb6e-4ab0-aa29-b0755c535886 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:42.307503 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74598643-eb6e-4ab0-aa29-b0755c535886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:42.345433 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-74598643-eb6e-4ab0-aa29-b0755c535886 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:42.346651 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-74598643-eb6e-4ab0-aa29-b0755c535886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:42.397424 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:42.401555 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b7bdc9-1278-41b0-8823-d8f94434c709 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:42.425386 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 166/344] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:20:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:20:42.427727 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526db8e5-c751-4994-b10e-cf20151a334c None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:42.428110 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526db8e5-c751-4994-b10e-cf20151a334c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:42.428463 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526db8e5-c751-4994-b10e-cf20151a334c None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:42.430838 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 167/345] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:20:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:42.430838 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526db8e5-c751-4994-b10e-cf20151a334c None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:42.450417 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25682d46-6d9c-4a67-9a14-f3bb59ba1d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:42.452256 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25682d46-6d9c-4a67-9a14-f3bb59ba1d4c None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:42.452728 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25682d46-6d9c-4a67-9a14-f3bb59ba1d4c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:42.453728 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25682d46-6d9c-4a67-9a14-f3bb59ba1d4c None admin] PATH_INFO: `/v3/projects/6ae47773ffcf4aad9f7fb9bf16e40752` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:42.457916 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25682d46-6d9c-4a67-9a14-f3bb59ba1d4c None admin] RBAC: Authorizing `identity:get_project(project_id=6ae47773ffcf4aad9f7fb9bf16e40752)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:42.459652 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25682d46-6d9c-4a67-9a14-f3bb59ba1d4c None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:42.462304 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 179/346] 10.222.0.16 () {56 vars in 1186 bytes} [Thu May 26 12:20:42 2022] GET /identity/v3/projects/6ae47773ffcf4aad9f7fb9bf16e40752 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:42.464038 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00799f84-2efb-4f85-9600-7951972d60c7 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:42.464537 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00799f84-2efb-4f85-9600-7951972d60c7 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:42.465143 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00799f84-2efb-4f85-9600-7951972d60c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:42.489010 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-00799f84-2efb-4f85-9600-7951972d60c7 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:42.490993 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-00799f84-2efb-4f85-9600-7951972d60c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:42.510241 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:42.574574 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526db8e5-c751-4994-b10e-cf20151a334c None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:42.590096 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 180/347] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:20:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:20:42.591656 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00799f84-2efb-4f85-9600-7951972d60c7 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:42.618547 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ddb66-9599-4e49-a5fc-5fc427d238c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:42.619408 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ddb66-9599-4e49-a5fc-5fc427d238c7 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:42.619761 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ddb66-9599-4e49-a5fc-5fc427d238c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:42.620110 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ddb66-9599-4e49-a5fc-5fc427d238c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:42.621530 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850ddb66-9599-4e49-a5fc-5fc427d238c7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:42.621962 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850ddb66-9599-4e49-a5fc-5fc427d238c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:42.623473 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850ddb66-9599-4e49-a5fc-5fc427d238c7 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:42.634332 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 168/348] 10.222.0.16 () {56 vars in 1111 bytes} [Thu May 26 12:20:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:42.635277 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ddb66-9599-4e49-a5fc-5fc427d238c7 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:42.705689 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:42.715586 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00799f84-2efb-4f85-9600-7951972d60c7 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:42.751741 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ddb66-9599-4e49-a5fc-5fc427d238c7 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:42.753382 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc917e0-21d7-4c2c-8018-f652ebcb83df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:42.754499 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc917e0-21d7-4c2c-8018-f652ebcb83df None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:42.754994 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc917e0-21d7-4c2c-8018-f652ebcb83df None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:42.755472 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc917e0-21d7-4c2c-8018-f652ebcb83df None admin] PATH_INFO: `/v3/groups/d53417386a894e209fefa8f7e9390dac` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:42.762707 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc917e0-21d7-4c2c-8018-f652ebcb83df None admin] RBAC: Authorizing `identity:get_group(group_id=d53417386a894e209fefa8f7e9390dac)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:42.764426 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc917e0-21d7-4c2c-8018-f652ebcb83df None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:42.767402 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 181/349] 10.222.0.16 () {56 vars in 1180 bytes} [Thu May 26 12:20:42 2022] GET /identity/v3/groups/d53417386a894e209fefa8f7e9390dac => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:42.768503 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc917e0-21d7-4c2c-8018-f652ebcb83df None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:42.770653 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:42.790826 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08194d99-6fb7-4e6d-a1e7-a363d2fa3f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:42.791677 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08194d99-6fb7-4e6d-a1e7-a363d2fa3f4d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:42.791968 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08194d99-6fb7-4e6d-a1e7-a363d2fa3f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:42.792249 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08194d99-6fb7-4e6d-a1e7-a363d2fa3f4d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:42.805514 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08194d99-6fb7-4e6d-a1e7-a363d2fa3f4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:20:42.814225 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-08194d99-6fb7-4e6d-a1e7-a363d2fa3f4d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:20:42.814225 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:42.814225 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:42.814225 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:42.814225 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:42.814225 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:42.814225 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:42.814225 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:42.814225 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:42.814225 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:42.814225 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:42.814225 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:42.814225 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:20:42.814225 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:20:42.814225 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:20:42.814225 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:20:42.815601 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:20:42.815601 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:20:42.815601 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:20:42.815601 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:20:42.815601 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:42.815601 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:42.815601 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:42.815601 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:42.815601 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:42.815601 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:42.815601 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:42.815601 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:20:42.815601 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:42.815601 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:42.815601 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:42.815601 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:42.816720 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:42.816720 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:42.816720 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:42.816720 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:42.816720 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:20:42.816720 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:20:42.816720 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:20:42.816720 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:20:42.816720 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:20:42.816720 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:20:42.816720 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:20:42.816720 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:20:42.816720 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 169/350] 10.222.0.16 () {56 vars in 1099 bytes} [Thu May 26 12:20:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:20:42.816720 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08194d99-6fb7-4e6d-a1e7-a363d2fa3f4d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:42.885909 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc917e0-21d7-4c2c-8018-f652ebcb83df None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:42.921970 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5234cda8-9145-4032-81b0-5666f5c280db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:42.923712 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234cda8-9145-4032-81b0-5666f5c280db None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:42.924215 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234cda8-9145-4032-81b0-5666f5c280db None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:42.924697 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234cda8-9145-4032-81b0-5666f5c280db None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:42.934300 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08194d99-6fb7-4e6d-a1e7-a363d2fa3f4d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:42.936852 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5234cda8-9145-4032-81b0-5666f5c280db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:20:42.945124 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-5234cda8-9145-4032-81b0-5666f5c280db None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:20:42.945124 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:42.945124 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:42.945124 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:42.945124 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:42.945124 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:42.945124 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:42.945124 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:42.945124 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:42.945124 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:42.945124 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:42.945124 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:42.945124 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:20:42.945124 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:20:42.945124 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:20:42.945124 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:20:42.946047 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:20:42.946047 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:20:42.946047 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:20:42.946047 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:20:42.946047 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:42.946047 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:42.946047 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:42.946047 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:42.946047 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:42.946047 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:42.946047 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:42.946047 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:20:42.946047 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:42.946047 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:42.946047 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:42.946047 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:42.946849 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:42.946849 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:42.946849 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:42.946849 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:42.946849 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:20:42.946849 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:20:42.946849 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:20:42.946849 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:20:42.946849 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:20:42.946849 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:20:42.946849 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:20:42.946849 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:20:42.949574 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 182/351] 10.222.0.16 () {56 vars in 1099 bytes} [Thu May 26 12:20:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:20:42.950644 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5234cda8-9145-4032-81b0-5666f5c280db None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:42.970988 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b2d6c8-f92c-41e3-b684-63d957a38bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:42.971648 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2d6c8-f92c-41e3-b684-63d957a38bda None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:42.971937 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2d6c8-f92c-41e3-b684-63d957a38bda None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:42.972215 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2d6c8-f92c-41e3-b684-63d957a38bda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:42.973922 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:43.024139 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:43.050953 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b2d6c8-f92c-41e3-b684-63d957a38bda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:43.052524 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b2d6c8-f92c-41e3-b684-63d957a38bda None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:43.072394 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5234cda8-9145-4032-81b0-5666f5c280db None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:43.122402 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01481a12-628f-4300-b5c7-b350469a8b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:43.123388 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01481a12-628f-4300-b5c7-b350469a8b7e None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:43.123833 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01481a12-628f-4300-b5c7-b350469a8b7e None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:43.124101 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01481a12-628f-4300-b5c7-b350469a8b7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:43.125013 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01481a12-628f-4300-b5c7-b350469a8b7e None admin] RBAC: Adding query filter params (group.id=d53417386a894e209fefa8f7e9390dac, role.id=b0bf2a578f0a4319b93dd3b8a26a96b7, scope.project.id=6ae47773ffcf4aad9f7fb9bf16e40752) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:43.125300 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01481a12-628f-4300-b5c7-b350469a8b7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:43.126802 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01481a12-628f-4300-b5c7-b350469a8b7e None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:43.132698 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 183/352] 10.222.0.16 () {56 vars in 1376 bytes} [Thu May 26 12:20:42 2022] GET /identity/v3/role_assignments?group.id=d53417386a894e209fefa8f7e9390dac&scope.project.id=6ae47773ffcf4aad9f7fb9bf16e40752&role.id=b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:43.133618 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01481a12-628f-4300-b5c7-b350469a8b7e None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:43.199235 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 170/353] 10.222.0.16 () {58 vars in 1282 bytes} [Thu May 26 12:20:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:20:43.200110 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b2d6c8-f92c-41e3-b684-63d957a38bda None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:43.248750 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:43.273949 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01481a12-628f-4300-b5c7-b350469a8b7e None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:43.317284 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:43.322894 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66201199-0e84-4c13-be7b-db12aaa822cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:43.323579 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66201199-0e84-4c13-be7b-db12aaa822cb None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:43.323863 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66201199-0e84-4c13-be7b-db12aaa822cb None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:43.324139 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66201199-0e84-4c13-be7b-db12aaa822cb None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:43.324935 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66201199-0e84-4c13-be7b-db12aaa822cb None admin] RBAC: Adding query filter params (name=member) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:43.325249 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66201199-0e84-4c13-be7b-db12aaa822cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:43.326648 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66201199-0e84-4c13-be7b-db12aaa822cb None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:43.336858 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 184/354] 10.222.0.16 () {56 vars in 1101 bytes} [Thu May 26 12:20:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:43.337642 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefac994-8740-468a-875b-91ea311f72a6 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:43.337933 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefac994-8740-468a-875b-91ea311f72a6 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:43.338232 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefac994-8740-468a-875b-91ea311f72a6 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:43.339792 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 185/355] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:20:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:43.340501 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefac994-8740-468a-875b-91ea311f72a6 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:43.348496 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b2d6c8-f92c-41e3-b684-63d957a38bda None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:43.396528 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aef70b-0977-4613-86c4-fb6ba1cf6edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:43.397243 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aef70b-0977-4613-86c4-fb6ba1cf6edd None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:43.397521 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aef70b-0977-4613-86c4-fb6ba1cf6edd None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:43.397793 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aef70b-0977-4613-86c4-fb6ba1cf6edd None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:43.398540 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aef70b-0977-4613-86c4-fb6ba1cf6edd None admin] RBAC: Adding query filter params (name=reader) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:43.398832 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aef70b-0977-4613-86c4-fb6ba1cf6edd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:43.400211 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aef70b-0977-4613-86c4-fb6ba1cf6edd None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:43.410349 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 171/356] 10.222.0.16 () {56 vars in 1101 bytes} [Thu May 26 12:20:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:43.411627 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42132ed1-cfe5-483e-ac68-335cf56c0f6e None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:43.411910 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42132ed1-cfe5-483e-ac68-335cf56c0f6e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:43.412185 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42132ed1-cfe5-483e-ac68-335cf56c0f6e None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:43.417739 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 172/357] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:20:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:43.418845 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624604b-d4fc-418f-b229-5225fabee0d7 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:43.419142 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624604b-d4fc-418f-b229-5225fabee0d7 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:43.419403 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624604b-d4fc-418f-b229-5225fabee0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:43.437910 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-2624604b-d4fc-418f-b229-5225fabee0d7 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:43.439637 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2624604b-d4fc-418f-b229-5225fabee0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:43.463169 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefac994-8740-468a-875b-91ea311f72a6 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:43.507993 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc514da-d08a-449c-886b-7253ac7b1d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:43.510129 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc514da-d08a-449c-886b-7253ac7b1d3c None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:43.510129 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc514da-d08a-449c-886b-7253ac7b1d3c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:43.510129 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc514da-d08a-449c-886b-7253ac7b1d3c None admin] PATH_INFO: `/v3/projects/6ae47773ffcf4aad9f7fb9bf16e40752` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:43.512187 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc514da-d08a-449c-886b-7253ac7b1d3c None admin] RBAC: Authorizing `identity:get_project(project_id=6ae47773ffcf4aad9f7fb9bf16e40752)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:43.513444 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc514da-d08a-449c-886b-7253ac7b1d3c None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:43.515169 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 186/358] 10.222.0.16 () {56 vars in 1186 bytes} [Thu May 26 12:20:43 2022] GET /identity/v3/projects/6ae47773ffcf4aad9f7fb9bf16e40752 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:43.515933 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc514da-d08a-449c-886b-7253ac7b1d3c None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:43.526205 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 173/359] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:20:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:20:43.526885 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624604b-d4fc-418f-b229-5225fabee0d7 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:43.548420 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:43.608085 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:43.645177 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624604b-d4fc-418f-b229-5225fabee0d7 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:43.646241 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc514da-d08a-449c-886b-7253ac7b1d3c None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:43.689191 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f7cbb9-e617-44b7-b2d2-563524c0f5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:43.689952 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406045a7-38b1-4cbe-8482-fd93fa5eb0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:43.690237 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7cbb9-e617-44b7-b2d2-563524c0f5d3 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:43.690523 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7cbb9-e617-44b7-b2d2-563524c0f5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:43.690802 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7cbb9-e617-44b7-b2d2-563524c0f5d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:43.690894 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406045a7-38b1-4cbe-8482-fd93fa5eb0a7 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:43.691108 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406045a7-38b1-4cbe-8482-fd93fa5eb0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:43.691388 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406045a7-38b1-4cbe-8482-fd93fa5eb0a7 None admin] PATH_INFO: `/v3/users/5ae010e19b674d4fbd1b0c5da7fa5cbd` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:43.692623 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406045a7-38b1-4cbe-8482-fd93fa5eb0a7 None admin] RBAC: Authorizing `identity:get_user(user_id=5ae010e19b674d4fbd1b0c5da7fa5cbd)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:43.694305 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406045a7-38b1-4cbe-8482-fd93fa5eb0a7 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:43.696366 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 174/360] 10.222.0.16 () {56 vars in 1177 bytes} [Thu May 26 12:20:43 2022] GET /identity/v3/users/5ae010e19b674d4fbd1b0c5da7fa5cbd => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:43.697835 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a677d54-a090-4c3c-8cce-d6cd6ecd1c67 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:43.698127 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a677d54-a090-4c3c-8cce-d6cd6ecd1c67 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:43.698404 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a677d54-a090-4c3c-8cce-d6cd6ecd1c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:43.717328 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-1a677d54-a090-4c3c-8cce-d6cd6ecd1c67 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:43.718530 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1a677d54-a090-4c3c-8cce-d6cd6ecd1c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:43.780887 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f7cbb9-e617-44b7-b2d2-563524c0f5d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:43.782436 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f7cbb9-e617-44b7-b2d2-563524c0f5d3 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:43.799546 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:43.815564 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 175/361] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:20:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:20:43.818372 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a677d54-a090-4c3c-8cce-d6cd6ecd1c67 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:43.908170 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:43.923233 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 187/362] 10.222.0.16 () {58 vars in 1282 bytes} [Thu May 26 12:20:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:20:43.923233 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f7cbb9-e617-44b7-b2d2-563524c0f5d3 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:43.968402 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a677d54-a090-4c3c-8cce-d6cd6ecd1c67 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:44.018233 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a5b51-e0af-462a-bc0f-0daf470a31b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:44.019106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a5b51-e0af-462a-bc0f-0daf470a31b4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:44.019389 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a5b51-e0af-462a-bc0f-0daf470a31b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:44.019664 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a5b51-e0af-462a-bc0f-0daf470a31b4 None admin] PATH_INFO: `/v3/groups/d53417386a894e209fefa8f7e9390dac` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:44.021827 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589a5b51-e0af-462a-bc0f-0daf470a31b4 None admin] RBAC: Authorizing `identity:get_group(group_id=d53417386a894e209fefa8f7e9390dac)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:44.022931 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589a5b51-e0af-462a-bc0f-0daf470a31b4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:44.024772 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 176/363] 10.222.0.16 () {56 vars in 1180 bytes} [Thu May 26 12:20:43 2022] GET /identity/v3/groups/d53417386a894e209fefa8f7e9390dac => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:44.026948 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a5b51-e0af-462a-bc0f-0daf470a31b4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:44.061790 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f7cbb9-e617-44b7-b2d2-563524c0f5d3 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:44.078282 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:44.105280 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a07fd19-49da-4ce2-81f0-175c722fd22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:44.106877 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07fd19-49da-4ce2-81f0-175c722fd22f None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:44.106877 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07fd19-49da-4ce2-81f0-175c722fd22f None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:44.107264 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07fd19-49da-4ce2-81f0-175c722fd22f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:44.122959 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a07fd19-49da-4ce2-81f0-175c722fd22f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:20:44.131236 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-1a07fd19-49da-4ce2-81f0-175c722fd22f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:20:44.131236 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:44.131236 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:44.131236 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:44.131236 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:44.131236 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:44.131236 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:44.131236 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:44.131236 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:44.131236 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:44.131236 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:44.131236 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:44.131236 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:20:44.131236 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:20:44.131236 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:20:44.131236 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:20:44.132254 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:20:44.132254 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:20:44.132254 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:20:44.132254 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:20:44.132254 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:44.132254 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:44.132254 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:44.132254 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:44.132254 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:44.132254 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:44.132254 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:44.132254 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:20:44.132254 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:44.132254 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:44.132254 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:44.132254 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:44.133153 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:44.133153 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:44.133153 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:44.133153 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:44.133153 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:20:44.133153 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:20:44.133153 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:20:44.133153 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:20:44.133153 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:20:44.133153 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:20:44.133153 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:20:44.133153 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:20:44.133153 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 188/364] 10.222.0.16 () {56 vars in 1114 bytes} [Thu May 26 12:20:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:20:44.133990 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a07fd19-49da-4ce2-81f0-175c722fd22f None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:44.163657 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a5b51-e0af-462a-bc0f-0daf470a31b4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:44.211056 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b49f09-b8a0-4a4f-837a-bb373835e8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:44.211703 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b49f09-b8a0-4a4f-837a-bb373835e8d1 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:44.211781 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b49f09-b8a0-4a4f-837a-bb373835e8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:44.212073 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b49f09-b8a0-4a4f-837a-bb373835e8d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:44.213904 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b49f09-b8a0-4a4f-837a-bb373835e8d1 None admin] RBAC: Adding query filter params (role.id=c23f3f2e6c7e4a259066d5527cd0ab25, user.id=5ae010e19b674d4fbd1b0c5da7fa5cbd, scope.system=all) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:44.214214 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b49f09-b8a0-4a4f-837a-bb373835e8d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:44.215940 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b49f09-b8a0-4a4f-837a-bb373835e8d1 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:44.220258 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:44.235857 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 177/365] 10.222.0.16 () {56 vars in 1308 bytes} [Thu May 26 12:20:44 2022] GET /identity/v3/role_assignments?user.id=5ae010e19b674d4fbd1b0c5da7fa5cbd&scope.system=all&role.id=c23f3f2e6c7e4a259066d5527cd0ab25 => generated 510 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:44.236546 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b49f09-b8a0-4a4f-837a-bb373835e8d1 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:44.288130 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a07fd19-49da-4ce2-81f0-175c722fd22f None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:44.328952 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f9f68-2eb0-41b2-8651-9df14036bf6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:44.329781 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f9f68-2eb0-41b2-8651-9df14036bf6f None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:44.330065 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f9f68-2eb0-41b2-8651-9df14036bf6f None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:44.330342 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f9f68-2eb0-41b2-8651-9df14036bf6f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:44.343562 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4f9f68-2eb0-41b2-8651-9df14036bf6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:20:44.352157 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-4d4f9f68-2eb0-41b2-8651-9df14036bf6f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:20:44.352157 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:44.352157 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:44.352157 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:44.352157 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:44.352157 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:44.352157 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:44.352157 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:44.352157 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:44.352157 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:44.352157 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:44.352157 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:44.352157 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:20:44.352157 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:20:44.352157 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:20:44.352157 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:20:44.353159 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:20:44.353159 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:20:44.353159 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:20:44.353159 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:20:44.353159 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:44.353159 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:44.353159 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:44.353159 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:44.353159 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:44.353159 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:44.353159 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:44.353159 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:20:44.353159 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:44.353159 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:44.353159 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:44.353159 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:44.353978 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:44.353978 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:44.353978 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:44.353978 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:44.353978 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:20:44.353978 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:20:44.353978 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:20:44.353978 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:20:44.353978 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:20:44.353978 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:20:44.353978 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:20:44.353978 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:20:44.353978 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 189/366] 10.222.0.16 () {56 vars in 1096 bytes} [Thu May 26 12:20:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:20:44.357191 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f9f68-2eb0-41b2-8651-9df14036bf6f None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:44.383226 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b49f09-b8a0-4a4f-837a-bb373835e8d1 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:44.406519 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:44.432314 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf2eb8-d55f-4466-a555-55ad18e21850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:44.433148 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf2eb8-d55f-4466-a555-55ad18e21850 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:44.433434 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf2eb8-d55f-4466-a555-55ad18e21850 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:44.433712 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf2eb8-d55f-4466-a555-55ad18e21850 None admin] PATH_INFO: `/v3/projects/b7b56cecd1b744e7aa956f6480beb5cf` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:44.435131 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daf2eb8-d55f-4466-a555-55ad18e21850 None admin] RBAC: Authorizing `identity:get_project(project_id=b7b56cecd1b744e7aa956f6480beb5cf)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:44.436860 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daf2eb8-d55f-4466-a555-55ad18e21850 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:44.440348 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 178/367] 10.222.0.16 () {56 vars in 1186 bytes} [Thu May 26 12:20:44 2022] GET /identity/v3/projects/b7b56cecd1b744e7aa956f6480beb5cf => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:44.441283 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf2eb8-d55f-4466-a555-55ad18e21850 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:44.515543 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f9f68-2eb0-41b2-8651-9df14036bf6f None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:44.524698 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:44.561973 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de8f7c8-df7f-44d3-aad6-f5a62c8ce34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:44.562637 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8f7c8-df7f-44d3-aad6-f5a62c8ce34a None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:44.563510 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8f7c8-df7f-44d3-aad6-f5a62c8ce34a None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:44.563510 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8f7c8-df7f-44d3-aad6-f5a62c8ce34a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:44.564078 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de8f7c8-df7f-44d3-aad6-f5a62c8ce34a None admin] RBAC: Adding query filter params (group.id=d53417386a894e209fefa8f7e9390dac, role.id=e0f421b5486c47aebb20ea10342cb1e3, scope.project.id=6ae47773ffcf4aad9f7fb9bf16e40752) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:44.564391 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de8f7c8-df7f-44d3-aad6-f5a62c8ce34a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:44.568683 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de8f7c8-df7f-44d3-aad6-f5a62c8ce34a None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:44.572406 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 190/368] 10.222.0.16 () {56 vars in 1376 bytes} [Thu May 26 12:20:44 2022] GET /identity/v3/role_assignments?group.id=d53417386a894e209fefa8f7e9390dac&scope.project.id=6ae47773ffcf4aad9f7fb9bf16e40752&role.id=e0f421b5486c47aebb20ea10342cb1e3 => generated 260 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:44.573478 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de8f7c8-df7f-44d3-aad6-f5a62c8ce34a None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:44.576616 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf2eb8-d55f-4466-a555-55ad18e21850 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:44.629177 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34436738-8b49-49c8-b162-fbe4033cd176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:44.630315 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34436738-8b49-49c8-b162-fbe4033cd176 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:44.630820 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34436738-8b49-49c8-b162-fbe4033cd176 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:44.631444 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34436738-8b49-49c8-b162-fbe4033cd176 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:44.632460 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34436738-8b49-49c8-b162-fbe4033cd176 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:44.633157 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34436738-8b49-49c8-b162-fbe4033cd176 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:44.636179 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34436738-8b49-49c8-b162-fbe4033cd176 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:44.648104 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 179/369] 10.222.0.16 () {56 vars in 1111 bytes} [Thu May 26 12:20:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:44.649345 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34436738-8b49-49c8-b162-fbe4033cd176 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:44.709804 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:44.716955 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de8f7c8-df7f-44d3-aad6-f5a62c8ce34a None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:44.784509 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f7603-8d6e-4327-bcd9-2c0f05ef3890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:44.785253 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f7603-8d6e-4327-bcd9-2c0f05ef3890 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:44.785538 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f7603-8d6e-4327-bcd9-2c0f05ef3890 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:44.785877 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f7603-8d6e-4327-bcd9-2c0f05ef3890 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:44.786573 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55f7603-8d6e-4327-bcd9-2c0f05ef3890 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:44.786882 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55f7603-8d6e-4327-bcd9-2c0f05ef3890 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:44.788277 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55f7603-8d6e-4327-bcd9-2c0f05ef3890 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:44.788716 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34436738-8b49-49c8-b162-fbe4033cd176 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:44.806586 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 191/370] 10.222.0.16 () {56 vars in 1099 bytes} [Thu May 26 12:20:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:44.807590 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f7603-8d6e-4327-bcd9-2c0f05ef3890 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:44.817968 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:44.833306 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6bc5a1-94c1-4a2a-91b8-6a1914f1b548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:44.834596 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6bc5a1-94c1-4a2a-91b8-6a1914f1b548 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:44.835134 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6bc5a1-94c1-4a2a-91b8-6a1914f1b548 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:44.835714 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6bc5a1-94c1-4a2a-91b8-6a1914f1b548 None admin] PATH_INFO: `/v3/groups/d53417386a894e209fefa8f7e9390dac` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:44.837556 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6bc5a1-94c1-4a2a-91b8-6a1914f1b548 None admin] RBAC: Authorizing `identity:get_group(group_id=d53417386a894e209fefa8f7e9390dac)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:44.839658 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6bc5a1-94c1-4a2a-91b8-6a1914f1b548 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:44.841886 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 180/371] 10.222.0.16 () {56 vars in 1180 bytes} [Thu May 26 12:20:44 2022] GET /identity/v3/groups/d53417386a894e209fefa8f7e9390dac => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:44.844333 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6bc5a1-94c1-4a2a-91b8-6a1914f1b548 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:44.964440 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f7603-8d6e-4327-bcd9-2c0f05ef3890 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:44.989412 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6bc5a1-94c1-4a2a-91b8-6a1914f1b548 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:45.019810 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f0e13-de63-4fca-adfe-36c11d38dbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:45.021936 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f0e13-de63-4fca-adfe-36c11d38dbc8 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:45.022490 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f0e13-de63-4fca-adfe-36c11d38dbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:45.023479 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f0e13-de63-4fca-adfe-36c11d38dbc8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:45.057422 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7976fb69-49bf-4429-b141-2af9c8254d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:45.058407 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976fb69-49bf-4429-b141-2af9c8254d35 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:45.058407 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976fb69-49bf-4429-b141-2af9c8254d35 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:45.058604 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976fb69-49bf-4429-b141-2af9c8254d35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:45.085880 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:45.145997 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:45.156759 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7976fb69-49bf-4429-b141-2af9c8254d35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:45.158340 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4f0e13-de63-4fca-adfe-36c11d38dbc8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:45.158478 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7976fb69-49bf-4429-b141-2af9c8254d35 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:45.160265 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4f0e13-de63-4fca-adfe-36c11d38dbc8 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:45.268598 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 181/372] 10.222.0.16 () {58 vars in 1282 bytes} [Thu May 26 12:20:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:20:45.271157 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7976fb69-49bf-4429-b141-2af9c8254d35 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:45.326177 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 192/373] 10.222.0.16 () {58 vars in 1282 bytes} [Thu May 26 12:20:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:20:45.329379 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f0e13-de63-4fca-adfe-36c11d38dbc8 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:45.372259 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:45.382627 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7976fb69-49bf-4429-b141-2af9c8254d35 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:45.422805 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274318d6-9065-4385-868a-bf1e324df367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:45.423476 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274318d6-9065-4385-868a-bf1e324df367 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:45.423756 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274318d6-9065-4385-868a-bf1e324df367 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:45.424030 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274318d6-9065-4385-868a-bf1e324df367 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:45.425011 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274318d6-9065-4385-868a-bf1e324df367 None admin] RBAC: Adding query filter params (group.id=d53417386a894e209fefa8f7e9390dac, role.id=b0bf2a578f0a4319b93dd3b8a26a96b7, scope.project.id=b7b56cecd1b744e7aa956f6480beb5cf) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:45.426345 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274318d6-9065-4385-868a-bf1e324df367 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:45.428004 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274318d6-9065-4385-868a-bf1e324df367 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:45.429314 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:45.446892 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 182/374] 10.222.0.16 () {56 vars in 1376 bytes} [Thu May 26 12:20:45 2022] GET /identity/v3/role_assignments?group.id=d53417386a894e209fefa8f7e9390dac&scope.project.id=b7b56cecd1b744e7aa956f6480beb5cf&role.id=b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 260 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:45.447910 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274318d6-9065-4385-868a-bf1e324df367 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:45.489873 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f0e13-de63-4fca-adfe-36c11d38dbc8 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:45.533487 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3998df-e13c-43e7-ac0a-a2e56332c0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:45.534701 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3998df-e13c-43e7-ac0a-a2e56332c0f0 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:45.535207 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3998df-e13c-43e7-ac0a-a2e56332c0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:45.535715 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3998df-e13c-43e7-ac0a-a2e56332c0f0 None admin] PATH_INFO: `/v3/projects/3c6d7f5ce344426b88b98fb2483df1ff` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:45.537259 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3998df-e13c-43e7-ac0a-a2e56332c0f0 None admin] RBAC: Authorizing `identity:get_project(project_id=3c6d7f5ce344426b88b98fb2483df1ff)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:45.539135 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3998df-e13c-43e7-ac0a-a2e56332c0f0 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:45.541235 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 193/375] 10.222.0.16 () {56 vars in 1186 bytes} [Thu May 26 12:20:45 2022] GET /identity/v3/projects/3c6d7f5ce344426b88b98fb2483df1ff => generated 344 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:45.552242 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3998df-e13c-43e7-ac0a-a2e56332c0f0 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:45.667874 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274318d6-9065-4385-868a-bf1e324df367 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:45.684123 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3998df-e13c-43e7-ac0a-a2e56332c0f0 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:45.714728 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:45.729860 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb3317-bef6-40ec-9347-3c8f97e113e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:45.731507 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb3317-bef6-40ec-9347-3c8f97e113e3 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:45.732358 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb3317-bef6-40ec-9347-3c8f97e113e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:45.733251 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb3317-bef6-40ec-9347-3c8f97e113e3 None admin] PATH_INFO: `/v3/groups/f75eb50af6bc4c1e8d5572335303f8ae` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:45.733991 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be95db3-a86c-42b2-b7dd-9d047ac2f305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:45.735142 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be95db3-a86c-42b2-b7dd-9d047ac2f305 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:45.735959 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be95db3-a86c-42b2-b7dd-9d047ac2f305 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:45.736917 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be95db3-a86c-42b2-b7dd-9d047ac2f305 None admin] PATH_INFO: `/v3/projects/b7b56cecd1b744e7aa956f6480beb5cf` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:45.738627 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be95db3-a86c-42b2-b7dd-9d047ac2f305 None admin] RBAC: Authorizing `identity:get_project(project_id=b7b56cecd1b744e7aa956f6480beb5cf)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:45.738957 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbb3317-bef6-40ec-9347-3c8f97e113e3 None admin] RBAC: Authorizing `identity:get_group(group_id=f75eb50af6bc4c1e8d5572335303f8ae)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:45.740436 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbb3317-bef6-40ec-9347-3c8f97e113e3 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:45.741107 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be95db3-a86c-42b2-b7dd-9d047ac2f305 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:45.742472 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 194/376] 10.222.0.16 () {56 vars in 1180 bytes} [Thu May 26 12:20:45 2022] GET /identity/v3/groups/f75eb50af6bc4c1e8d5572335303f8ae => generated 229 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:45.743531 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 183/377] 10.222.0.16 () {56 vars in 1186 bytes} [Thu May 26 12:20:45 2022] GET /identity/v3/projects/b7b56cecd1b744e7aa956f6480beb5cf => generated 302 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:45.756517 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb3317-bef6-40ec-9347-3c8f97e113e3 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:45.757823 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be95db3-a86c-42b2-b7dd-9d047ac2f305 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:45.806313 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:45.887676 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb3317-bef6-40ec-9347-3c8f97e113e3 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:45.888442 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be95db3-a86c-42b2-b7dd-9d047ac2f305 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:45.925333 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90aff92-7381-4e73-9694-e642f700bef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:45.926191 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90aff92-7381-4e73-9694-e642f700bef7 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:45.926468 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90aff92-7381-4e73-9694-e642f700bef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:45.926741 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90aff92-7381-4e73-9694-e642f700bef7 None admin] PATH_INFO: `/v3/groups/d53417386a894e209fefa8f7e9390dac` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:45.928959 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90aff92-7381-4e73-9694-e642f700bef7 None admin] RBAC: Authorizing `identity:get_group(group_id=d53417386a894e209fefa8f7e9390dac)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:45.930230 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2690462a-a048-47e1-b561-8e7163bd75f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:45.930444 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90aff92-7381-4e73-9694-e642f700bef7 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:45.931309 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690462a-a048-47e1-b561-8e7163bd75f3 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:45.931802 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690462a-a048-47e1-b561-8e7163bd75f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:45.932283 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690462a-a048-47e1-b561-8e7163bd75f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:45.932395 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 184/378] 10.222.0.16 () {56 vars in 1180 bytes} [Thu May 26 12:20:45 2022] GET /identity/v3/groups/d53417386a894e209fefa8f7e9390dac => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:45.933450 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2690462a-a048-47e1-b561-8e7163bd75f3 None admin] RBAC: Adding query filter params (group.id=f75eb50af6bc4c1e8d5572335303f8ae, role.id=1a8e523ecbc84d818c2a9af0fb54da74, scope.project.id=3c6d7f5ce344426b88b98fb2483df1ff) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:45.933574 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84219bd4-d27e-43cf-b909-cfa1b7bd9ff0 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:45.933782 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84219bd4-d27e-43cf-b909-cfa1b7bd9ff0 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:45.934056 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84219bd4-d27e-43cf-b909-cfa1b7bd9ff0 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:45.934466 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2690462a-a048-47e1-b561-8e7163bd75f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:45.936113 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2690462a-a048-47e1-b561-8e7163bd75f3 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:45.944863 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 185/379] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:20:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:45.944863 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84219bd4-d27e-43cf-b909-cfa1b7bd9ff0 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:45.951879 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 195/380] 10.222.0.16 () {56 vars in 1376 bytes} [Thu May 26 12:20:45 2022] GET /identity/v3/role_assignments?group.id=f75eb50af6bc4c1e8d5572335303f8ae&scope.project.id=3c6d7f5ce344426b88b98fb2483df1ff&role.id=1a8e523ecbc84d818c2a9af0fb54da74 => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:45.954885 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e1200-f219-4ce5-a21f-cdec74f6aba4 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:45.955176 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e1200-f219-4ce5-a21f-cdec74f6aba4 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:45.955555 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e1200-f219-4ce5-a21f-cdec74f6aba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:45.983387 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-0d1e1200-f219-4ce5-a21f-cdec74f6aba4 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:45.984588 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-0d1e1200-f219-4ce5-a21f-cdec74f6aba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:46.107036 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:46.125214 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:46.138932 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 196/381] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:20:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:20:46.142991 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84219bd4-d27e-43cf-b909-cfa1b7bd9ff0 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:46.170415 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e1200-f219-4ce5-a21f-cdec74f6aba4 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:46.189262 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35048d-7604-4086-a771-ad5210f7fc87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:46.189923 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35048d-7604-4086-a771-ad5210f7fc87 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:46.190204 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35048d-7604-4086-a771-ad5210f7fc87 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:46.191508 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35048d-7604-4086-a771-ad5210f7fc87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:46.192368 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f35048d-7604-4086-a771-ad5210f7fc87 None admin] RBAC: Adding query filter params (group.id=d53417386a894e209fefa8f7e9390dac, role.id=e0f421b5486c47aebb20ea10342cb1e3, scope.project.id=b7b56cecd1b744e7aa956f6480beb5cf) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:46.192681 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f35048d-7604-4086-a771-ad5210f7fc87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:46.195906 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f35048d-7604-4086-a771-ad5210f7fc87 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:46.211297 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 186/382] 10.222.0.16 () {56 vars in 1376 bytes} [Thu May 26 12:20:45 2022] GET /identity/v3/role_assignments?group.id=d53417386a894e209fefa8f7e9390dac&scope.project.id=b7b56cecd1b744e7aa956f6480beb5cf&role.id=e0f421b5486c47aebb20ea10342cb1e3 => generated 260 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:46.298516 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e1200-f219-4ce5-a21f-cdec74f6aba4 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:46.338657 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e017a9cb-1b64-4d25-8856-791e0ac90379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:46.339460 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017a9cb-1b64-4d25-8856-791e0ac90379 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:46.339743 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017a9cb-1b64-4d25-8856-791e0ac90379 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:46.340013 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017a9cb-1b64-4d25-8856-791e0ac90379 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:46.352730 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e017a9cb-1b64-4d25-8856-791e0ac90379 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:20:46.361005 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-e017a9cb-1b64-4d25-8856-791e0ac90379 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:20:46.361005 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:46.361005 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:46.361005 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:46.361005 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:46.361005 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:46.361005 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:46.361005 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:46.361005 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:46.361005 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:46.361005 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:46.361005 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:46.361005 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:20:46.361005 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:20:46.361005 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:20:46.361005 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:20:46.361911 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:20:46.361911 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:20:46.361911 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:20:46.361911 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:20:46.361911 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:46.361911 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:46.361911 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:46.361911 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:46.361911 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:46.361911 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:46.361911 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:46.361911 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:20:46.361911 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:46.361911 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:46.361911 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:46.361911 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:46.362755 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:46.362755 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:46.362755 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:46.362755 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:46.362755 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:20:46.362755 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:20:46.362755 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:20:46.362755 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:20:46.362755 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:20:46.362755 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:20:46.362755 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:20:46.362755 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:20:46.362755 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 197/383] 10.222.0.16 () {56 vars in 1099 bytes} [Thu May 26 12:20:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:20:46.369486 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35048d-7604-4086-a771-ad5210f7fc87 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:46.512869 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35048d-7604-4086-a771-ad5210f7fc87 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:46.552415 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf5af0-de14-4757-9fec-ae332c2ebdeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:46.553119 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf5af0-de14-4757-9fec-ae332c2ebdeb None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:46.553405 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf5af0-de14-4757-9fec-ae332c2ebdeb None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:46.553686 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf5af0-de14-4757-9fec-ae332c2ebdeb None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:46.554440 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cf5af0-de14-4757-9fec-ae332c2ebdeb None admin] RBAC: Adding query filter params (name=member) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:46.554750 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cf5af0-de14-4757-9fec-ae332c2ebdeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:46.556146 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cf5af0-de14-4757-9fec-ae332c2ebdeb None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:46.565925 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 187/384] 10.222.0.16 () {56 vars in 1101 bytes} [Thu May 26 12:20:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:46.571395 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e017a9cb-1b64-4d25-8856-791e0ac90379 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:46.627694 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:46.700448 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e017a9cb-1b64-4d25-8856-791e0ac90379 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:46.751573 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c365d220-9868-4e92-8b84-33176fd9feb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:46.751573 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365d220-9868-4e92-8b84-33176fd9feb5 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:46.751573 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365d220-9868-4e92-8b84-33176fd9feb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:46.751573 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365d220-9868-4e92-8b84-33176fd9feb5 None admin] PATH_INFO: `/v3/groups/d53417386a894e209fefa8f7e9390dac` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:46.752553 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c365d220-9868-4e92-8b84-33176fd9feb5 None admin] RBAC: Authorizing `identity:get_group(group_id=d53417386a894e209fefa8f7e9390dac)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:46.753670 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c365d220-9868-4e92-8b84-33176fd9feb5 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:46.759753 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 198/385] 10.222.0.16 () {56 vars in 1180 bytes} [Thu May 26 12:20:46 2022] GET /identity/v3/groups/d53417386a894e209fefa8f7e9390dac => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:46.761951 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf5af0-de14-4757-9fec-ae332c2ebdeb None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:46.789564 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:46.893280 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf5af0-de14-4757-9fec-ae332c2ebdeb None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:46.932647 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8ada0-a72e-4fc2-8868-06547fc48e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:46.933543 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8ada0-a72e-4fc2-8868-06547fc48e6b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:46.933827 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8ada0-a72e-4fc2-8868-06547fc48e6b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:46.934101 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8ada0-a72e-4fc2-8868-06547fc48e6b None admin] PATH_INFO: `/v3/projects/6ae47773ffcf4aad9f7fb9bf16e40752` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:46.937556 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e8ada0-a72e-4fc2-8868-06547fc48e6b None admin] RBAC: Authorizing `identity:get_project(project_id=6ae47773ffcf4aad9f7fb9bf16e40752)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:46.939561 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e8ada0-a72e-4fc2-8868-06547fc48e6b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:46.941660 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 188/386] 10.222.0.16 () {56 vars in 1186 bytes} [Thu May 26 12:20:46 2022] GET /identity/v3/projects/6ae47773ffcf4aad9f7fb9bf16e40752 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:46.947489 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c365d220-9868-4e92-8b84-33176fd9feb5 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:47.092416 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c365d220-9868-4e92-8b84-33176fd9feb5 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:47.112020 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:47.144342 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe4ac5a-164a-4a08-a7b9-3e459b4bc520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:47.145223 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4ac5a-164a-4a08-a7b9-3e459b4bc520 None admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:47.145504 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4ac5a-164a-4a08-a7b9-3e459b4bc520 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:47.145776 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4ac5a-164a-4a08-a7b9-3e459b4bc520 None admin] PATH_INFO: `/v3/projects/6ae47773ffcf4aad9f7fb9bf16e40752/groups/d53417386a894e209fefa8f7e9390dac/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:47.153623 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe4ac5a-164a-4a08-a7b9-3e459b4bc520 None admin] RBAC: Authorizing `identity:create_grant(project_id=6ae47773ffcf4aad9f7fb9bf16e40752, group_id=d53417386a894e209fefa8f7e9390dac, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:47.155073 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe4ac5a-164a-4a08-a7b9-3e459b4bc520 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:47.168761 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 199/387] 10.222.0.16 () {58 vars in 1442 bytes} [Thu May 26 12:20:46 2022] PUT /identity/v3/projects/6ae47773ffcf4aad9f7fb9bf16e40752/groups/d53417386a894e209fefa8f7e9390dac/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:20:47.264852 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6ae5f-78da-46ec-87d4-40dae9dc2059 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:47.265206 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6ae5f-78da-46ec-87d4-40dae9dc2059 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:47.265429 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6ae5f-78da-46ec-87d4-40dae9dc2059 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:47.267148 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 189/388] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:20:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:47.272673 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549eb8cf-2728-4600-863e-c9aa34cc1f3b None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:47.273012 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549eb8cf-2728-4600-863e-c9aa34cc1f3b None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:47.273298 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549eb8cf-2728-4600-863e-c9aa34cc1f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:47.291273 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-549eb8cf-2728-4600-863e-c9aa34cc1f3b None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:47.292499 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-549eb8cf-2728-4600-863e-c9aa34cc1f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:47.390762 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 200/389] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:20:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:20:47.425244 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c6ae5f-78da-46ec-87d4-40dae9dc2059 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:47.520367 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:47.536982 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c6ae5f-78da-46ec-87d4-40dae9dc2059 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:47.571770 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf649916-ac39-44e8-8119-665b2df1ec39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:47.572632 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf649916-ac39-44e8-8119-665b2df1ec39 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:47.572951 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf649916-ac39-44e8-8119-665b2df1ec39 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:47.573233 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf649916-ac39-44e8-8119-665b2df1ec39 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:47.584665 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf649916-ac39-44e8-8119-665b2df1ec39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:20:47.593302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-cf649916-ac39-44e8-8119-665b2df1ec39 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:20:47.593302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:47.593302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:47.593302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:47.593302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:47.593302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:47.593302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:47.593302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:47.593302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:47.593302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:47.593302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:47.593302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:47.593302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:20:47.593302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:20:47.593302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:20:47.593302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:20:47.594262 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:20:47.594262 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:20:47.594262 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:20:47.594262 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:20:47.594262 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:47.594262 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:47.594262 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:47.594262 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:47.594262 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:47.594262 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:47.594262 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:47.594262 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:20:47.594262 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:47.594262 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:47.594262 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:47.594262 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:47.595643 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:47.595643 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:47.595643 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:47.595643 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:47.595643 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:20:47.595643 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:20:47.595643 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:20:47.595643 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:20:47.595643 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:20:47.595643 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:20:47.595643 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:20:47.595643 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:20:47.595643 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 190/390] 10.222.0.16 () {56 vars in 1114 bytes} [Thu May 26 12:20:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:20:47.601211 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549eb8cf-2728-4600-863e-c9aa34cc1f3b None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:47.708594 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549eb8cf-2728-4600-863e-c9aa34cc1f3b None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:47.710158 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:47.765560 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d4bd6-5b72-4d37-95ea-b43429ba043a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:47.766269 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d4bd6-5b72-4d37-95ea-b43429ba043a None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:47.766564 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d4bd6-5b72-4d37-95ea-b43429ba043a None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:47.766831 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d4bd6-5b72-4d37-95ea-b43429ba043a None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:47.767598 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384d4bd6-5b72-4d37-95ea-b43429ba043a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:47.767907 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384d4bd6-5b72-4d37-95ea-b43429ba043a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:47.769348 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384d4bd6-5b72-4d37-95ea-b43429ba043a None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:47.778499 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 201/391] 10.222.0.16 () {56 vars in 1111 bytes} [Thu May 26 12:20:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:47.783953 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf649916-ac39-44e8-8119-665b2df1ec39 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:47.899194 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf649916-ac39-44e8-8119-665b2df1ec39 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:47.935252 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecacbcf-8208-4c53-866e-57eca67bfc32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:47.936111 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecacbcf-8208-4c53-866e-57eca67bfc32 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:47.936398 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecacbcf-8208-4c53-866e-57eca67bfc32 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:47.936674 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecacbcf-8208-4c53-866e-57eca67bfc32 None admin] PATH_INFO: `/v3/groups/d53417386a894e209fefa8f7e9390dac` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:47.937941 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecacbcf-8208-4c53-866e-57eca67bfc32 None admin] RBAC: Authorizing `identity:get_group(group_id=d53417386a894e209fefa8f7e9390dac)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:47.939981 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecacbcf-8208-4c53-866e-57eca67bfc32 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:47.941943 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 191/392] 10.222.0.16 () {56 vars in 1180 bytes} [Thu May 26 12:20:47 2022] GET /identity/v3/groups/d53417386a894e209fefa8f7e9390dac => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:47.947367 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d4bd6-5b72-4d37-95ea-b43429ba043a None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:48.067372 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e25ad-04ef-4523-8f8f-cbe8385c1839 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:48.067699 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e25ad-04ef-4523-8f8f-cbe8385c1839 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:48.067932 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e25ad-04ef-4523-8f8f-cbe8385c1839 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:48.069511 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 192/393] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:20:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:48.074140 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370eeb9-e076-4e28-95aa-402106dc1b98 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:48.074430 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370eeb9-e076-4e28-95aa-402106dc1b98 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:48.074707 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370eeb9-e076-4e28-95aa-402106dc1b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:48.100940 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d4bd6-5b72-4d37-95ea-b43429ba043a None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:48.103252 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-0370eeb9-e076-4e28-95aa-402106dc1b98 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:48.104430 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0370eeb9-e076-4e28-95aa-402106dc1b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:48.124800 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:48.162265 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e6fe2e-77f6-4cfc-84a4-be86dd2b1ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:48.163131 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6fe2e-77f6-4cfc-84a4-be86dd2b1ea3 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:48.163415 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6fe2e-77f6-4cfc-84a4-be86dd2b1ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:48.163688 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6fe2e-77f6-4cfc-84a4-be86dd2b1ea3 None admin] PATH_INFO: `/v3/projects/6ae47773ffcf4aad9f7fb9bf16e40752` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:48.165023 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e6fe2e-77f6-4cfc-84a4-be86dd2b1ea3 None admin] RBAC: Authorizing `identity:get_project(project_id=6ae47773ffcf4aad9f7fb9bf16e40752)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:48.166450 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e6fe2e-77f6-4cfc-84a4-be86dd2b1ea3 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:48.170377 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 202/394] 10.222.0.16 () {56 vars in 1186 bytes} [Thu May 26 12:20:47 2022] GET /identity/v3/projects/6ae47773ffcf4aad9f7fb9bf16e40752 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:48.175065 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e6fe2e-77f6-4cfc-84a4-be86dd2b1ea3 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:48.232244 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:48.255287 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 193/395] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:20:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:20:48.283895 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0370eeb9-e076-4e28-95aa-402106dc1b98 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:48.376264 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e6fe2e-77f6-4cfc-84a4-be86dd2b1ea3 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:48.442964 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d1437-d34a-4f65-8c86-a35137ab8275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:48.444741 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d1437-d34a-4f65-8c86-a35137ab8275 None admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:48.445272 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d1437-d34a-4f65-8c86-a35137ab8275 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:48.445762 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d1437-d34a-4f65-8c86-a35137ab8275 None admin] PATH_INFO: `/v3/projects/6ae47773ffcf4aad9f7fb9bf16e40752/groups/d53417386a894e209fefa8f7e9390dac/roles/e0f421b5486c47aebb20ea10342cb1e3` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:48.450465 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195d1437-d34a-4f65-8c86-a35137ab8275 None admin] RBAC: Authorizing `identity:create_grant(project_id=6ae47773ffcf4aad9f7fb9bf16e40752, group_id=d53417386a894e209fefa8f7e9390dac, role_id=e0f421b5486c47aebb20ea10342cb1e3)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:48.452890 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195d1437-d34a-4f65-8c86-a35137ab8275 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:48.467117 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0370eeb9-e076-4e28-95aa-402106dc1b98 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:48.472783 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 203/396] 10.222.0.16 () {58 vars in 1442 bytes} [Thu May 26 12:20:48 2022] PUT /identity/v3/projects/6ae47773ffcf4aad9f7fb9bf16e40752/groups/d53417386a894e209fefa8f7e9390dac/roles/e0f421b5486c47aebb20ea10342cb1e3 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:20:48.527465 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e1f4f-a1c5-479f-a270-ad1342c827cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:48.528273 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e1f4f-a1c5-479f-a270-ad1342c827cf None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:48.528554 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e1f4f-a1c5-479f-a270-ad1342c827cf None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:48.528827 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e1f4f-a1c5-479f-a270-ad1342c827cf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:48.554088 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e1f4f-a1c5-479f-a270-ad1342c827cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:20:48.561977 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-211e1f4f-a1c5-479f-a270-ad1342c827cf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:20:48.561977 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:48.561977 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:48.561977 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:48.561977 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:48.561977 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:48.561977 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:48.561977 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:48.561977 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:48.561977 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:48.561977 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:48.561977 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:48.561977 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:20:48.561977 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:20:48.561977 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:20:48.561977 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:20:48.562951 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:20:48.562951 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:20:48.562951 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:20:48.562951 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:20:48.562951 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:48.562951 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:48.562951 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:48.562951 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:48.562951 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:48.562951 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:48.562951 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:48.562951 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:20:48.562951 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:48.562951 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:48.562951 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:48.562951 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:48.564333 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:48.564333 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:48.564333 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:48.564333 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:48.564333 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:20:48.564333 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:20:48.564333 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:20:48.564333 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:20:48.564333 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:20:48.564333 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:20:48.564333 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:20:48.564333 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:20:48.564333 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 194/397] 10.222.0.16 () {56 vars in 1099 bytes} [Thu May 26 12:20:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:20:48.570021 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d1437-d34a-4f65-8c86-a35137ab8275 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:48.760864 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d1437-d34a-4f65-8c86-a35137ab8275 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:48.763358 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:48.796045 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea04aa3-6168-4225-9b0b-39c587719ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:48.796985 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea04aa3-6168-4225-9b0b-39c587719ff1 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:48.797273 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea04aa3-6168-4225-9b0b-39c587719ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:48.797610 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea04aa3-6168-4225-9b0b-39c587719ff1 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:48.798396 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea04aa3-6168-4225-9b0b-39c587719ff1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:48.798705 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea04aa3-6168-4225-9b0b-39c587719ff1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:48.800108 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea04aa3-6168-4225-9b0b-39c587719ff1 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:48.810873 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 204/398] 10.222.0.16 () {56 vars in 1101 bytes} [Thu May 26 12:20:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:48.816637 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e1f4f-a1c5-479f-a270-ad1342c827cf None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:48.822128 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:48.949419 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e1f4f-a1c5-479f-a270-ad1342c827cf None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:48.975406 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d67f5-b374-4244-8280-b5997bc1aee8 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:48.975687 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d67f5-b374-4244-8280-b5997bc1aee8 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:48.975976 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d67f5-b374-4244-8280-b5997bc1aee8 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:48.977657 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 205/399] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:20:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:48.984325 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639e3bf-0483-4d6b-a398-fdb4e6092c8b None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:48.985850 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639e3bf-0483-4d6b-a398-fdb4e6092c8b None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:48.986478 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639e3bf-0483-4d6b-a398-fdb4e6092c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:49.012027 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25481591-fb46-404c-969d-c8ea9633d4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:49.013212 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25481591-fb46-404c-969d-c8ea9633d4dd None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:49.013726 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25481591-fb46-404c-969d-c8ea9633d4dd None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:49.014192 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25481591-fb46-404c-969d-c8ea9633d4dd None admin] PATH_INFO: `/v3/groups/d53417386a894e209fefa8f7e9390dac` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:49.015784 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-a639e3bf-0483-4d6b-a398-fdb4e6092c8b None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:49.017137 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25481591-fb46-404c-969d-c8ea9633d4dd None admin] RBAC: Authorizing `identity:get_group(group_id=d53417386a894e209fefa8f7e9390dac)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:49.018794 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25481591-fb46-404c-969d-c8ea9633d4dd None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:49.021728 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-a639e3bf-0483-4d6b-a398-fdb4e6092c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:49.024243 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 195/400] 10.222.0.16 () {56 vars in 1180 bytes} [Thu May 26 12:20:48 2022] GET /identity/v3/groups/d53417386a894e209fefa8f7e9390dac => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:49.030525 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25481591-fb46-404c-969d-c8ea9633d4dd None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:49.146182 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:49.155562 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 206/401] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:20:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:20:49.178420 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a639e3bf-0483-4d6b-a398-fdb4e6092c8b None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:49.213290 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25481591-fb46-404c-969d-c8ea9633d4dd None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:49.278961 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c4cb46-c27f-4541-b236-1943e231f369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:49.279749 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4cb46-c27f-4541-b236-1943e231f369 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:49.280028 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4cb46-c27f-4541-b236-1943e231f369 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:49.280300 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4cb46-c27f-4541-b236-1943e231f369 None admin] PATH_INFO: `/v3/projects/b7b56cecd1b744e7aa956f6480beb5cf` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:49.282375 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c4cb46-c27f-4541-b236-1943e231f369 None admin] RBAC: Authorizing `identity:get_project(project_id=b7b56cecd1b744e7aa956f6480beb5cf)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:49.283829 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c4cb46-c27f-4541-b236-1943e231f369 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:49.292418 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 196/402] 10.222.0.16 () {56 vars in 1186 bytes} [Thu May 26 12:20:49 2022] GET /identity/v3/projects/b7b56cecd1b744e7aa956f6480beb5cf => generated 302 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:49.296497 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c4cb46-c27f-4541-b236-1943e231f369 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:49.329553 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:49.358109 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a639e3bf-0483-4d6b-a398-fdb4e6092c8b None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:49.422156 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda704e3-b9ec-4fdc-a2cc-238f8d8e40b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:49.423043 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda704e3-b9ec-4fdc-a2cc-238f8d8e40b3 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:49.423320 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda704e3-b9ec-4fdc-a2cc-238f8d8e40b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:49.423590 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda704e3-b9ec-4fdc-a2cc-238f8d8e40b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:49.445817 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda704e3-b9ec-4fdc-a2cc-238f8d8e40b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:20:49.454919 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-dda704e3-b9ec-4fdc-a2cc-238f8d8e40b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:20:49.454919 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:49.454919 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:49.454919 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:49.454919 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:49.454919 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:49.454919 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:49.454919 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:49.454919 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:49.454919 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:49.454919 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:49.454919 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:49.454919 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:20:49.454919 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:20:49.454919 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:20:49.454919 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:20:49.455798 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:20:49.455798 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:20:49.455798 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:20:49.455798 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:20:49.455798 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:49.455798 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:49.455798 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:49.455798 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:49.455798 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:49.455798 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:49.455798 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:49.455798 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:20:49.455798 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:49.455798 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:49.455798 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:49.455798 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:49.457047 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:49.457047 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:49.457047 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:49.457047 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:49.457047 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:20:49.457047 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:20:49.457047 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:20:49.457047 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:20:49.457047 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:20:49.457047 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:20:49.457047 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:20:49.457047 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:20:49.457047 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 207/403] 10.222.0.16 () {56 vars in 1096 bytes} [Thu May 26 12:20:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:20:49.457712 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9df5f2-31de-4bfc-9eb0-8ab9a208b155 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:49.457995 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9df5f2-31de-4bfc-9eb0-8ab9a208b155 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:49.459094 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9df5f2-31de-4bfc-9eb0-8ab9a208b155 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:49.462954 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 208/404] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:20:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:49.464356 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9df5f2-31de-4bfc-9eb0-8ab9a208b155 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:49.480627 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c4cb46-c27f-4541-b236-1943e231f369 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:49.526057 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73365b1-619b-43c1-accb-54f326c630e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:49.527009 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73365b1-619b-43c1-accb-54f326c630e1 None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:49.527295 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73365b1-619b-43c1-accb-54f326c630e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:49.527573 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73365b1-619b-43c1-accb-54f326c630e1 None admin] PATH_INFO: `/v3/projects/b7b56cecd1b744e7aa956f6480beb5cf/groups/d53417386a894e209fefa8f7e9390dac/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:49.530444 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73365b1-619b-43c1-accb-54f326c630e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=b7b56cecd1b744e7aa956f6480beb5cf, group_id=d53417386a894e209fefa8f7e9390dac, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:49.532585 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73365b1-619b-43c1-accb-54f326c630e1 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:49.544536 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:49.551519 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 197/405] 10.222.0.16 () {58 vars in 1442 bytes} [Thu May 26 12:20:49 2022] PUT /identity/v3/projects/b7b56cecd1b744e7aa956f6480beb5cf/groups/d53417386a894e209fefa8f7e9390dac/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:20:49.554149 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542f9dc-6f24-47ed-bc59-028693a53eed None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:49.554872 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542f9dc-6f24-47ed-bc59-028693a53eed None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:49.555165 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542f9dc-6f24-47ed-bc59-028693a53eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:49.576902 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-9542f9dc-6f24-47ed-bc59-028693a53eed None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:49.577515 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9542f9dc-6f24-47ed-bc59-028693a53eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:49.622920 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9df5f2-31de-4bfc-9eb0-8ab9a208b155 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:49.663628 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 198/406] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:20:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:20:49.691816 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542f9dc-6f24-47ed-bc59-028693a53eed None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:49.694883 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e9663e-903f-44f4-8def-c4f7041cc393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:49.695952 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9663e-903f-44f4-8def-c4f7041cc393 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:49.696491 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9663e-903f-44f4-8def-c4f7041cc393 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:49.696994 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9663e-903f-44f4-8def-c4f7041cc393 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:49.698046 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e9663e-903f-44f4-8def-c4f7041cc393 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:49.698597 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e9663e-903f-44f4-8def-c4f7041cc393 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:49.700344 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e9663e-903f-44f4-8def-c4f7041cc393 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:49.721902 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 209/407] 10.222.0.16 () {56 vars in 1099 bytes} [Thu May 26 12:20:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:49.728229 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e9663e-903f-44f4-8def-c4f7041cc393 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:49.749253 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:49.838276 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542f9dc-6f24-47ed-bc59-028693a53eed None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:49.898094 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e9663e-903f-44f4-8def-c4f7041cc393 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:49.898672 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:49.901072 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407fdbd-2926-440e-8851-786f4631062b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:49.901925 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407fdbd-2926-440e-8851-786f4631062b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:49.902212 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407fdbd-2926-440e-8851-786f4631062b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:49.902493 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407fdbd-2926-440e-8851-786f4631062b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:49.926392 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0407fdbd-2926-440e-8851-786f4631062b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:20:49.943414 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-0407fdbd-2926-440e-8851-786f4631062b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:20:49.943414 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:49.943414 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:49.943414 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:49.943414 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:49.943414 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:49.943414 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:49.943414 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:49.943414 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:49.943414 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:49.943414 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:49.943414 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:49.943414 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:20:49.943414 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:20:49.943414 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:20:49.943414 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:20:49.944347 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:20:49.944347 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:20:49.944347 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:20:49.944347 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:20:49.944347 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:49.944347 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:49.944347 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:49.944347 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:49.944347 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:49.944347 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:49.944347 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:49.944347 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:20:49.944347 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:49.944347 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:49.944347 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:49.944347 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:49.945203 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:49.945203 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:49.945203 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:49.945203 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:49.945203 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:20:49.945203 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:20:49.945203 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:20:49.945203 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:20:49.945203 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:20:49.945203 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:20:49.945203 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:20:49.945203 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:20:49.946327 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 199/408] 10.222.0.16 () {56 vars in 1114 bytes} [Thu May 26 12:20:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:20:49.946902 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f149a5d-abdc-4953-90e6-49365bd87399 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:49.947188 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f149a5d-abdc-4953-90e6-49365bd87399 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:49.947467 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f149a5d-abdc-4953-90e6-49365bd87399 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:49.948905 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 200/409] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:20:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:49.955500 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97fdd7f-00ef-45a9-840f-4d8a012cf7cb None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:49.955782 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97fdd7f-00ef-45a9-840f-4d8a012cf7cb None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:49.956056 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97fdd7f-00ef-45a9-840f-4d8a012cf7cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:49.964212 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa0e63-04d0-47c6-82fe-5e57205e7b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:49.965202 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa0e63-04d0-47c6-82fe-5e57205e7b89 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:49.965558 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa0e63-04d0-47c6-82fe-5e57205e7b89 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:49.965910 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa0e63-04d0-47c6-82fe-5e57205e7b89 None admin] PATH_INFO: `/v3/groups/f75eb50af6bc4c1e8d5572335303f8ae` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:49.967446 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aa0e63-04d0-47c6-82fe-5e57205e7b89 None admin] RBAC: Authorizing `identity:get_group(group_id=f75eb50af6bc4c1e8d5572335303f8ae)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:49.968979 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aa0e63-04d0-47c6-82fe-5e57205e7b89 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:49.971057 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 210/410] 10.222.0.16 () {56 vars in 1180 bytes} [Thu May 26 12:20:49 2022] GET /identity/v3/groups/f75eb50af6bc4c1e8d5572335303f8ae => generated 229 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:20:49.971899 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa0e63-04d0-47c6-82fe-5e57205e7b89 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:49.976805 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d97fdd7f-00ef-45a9-840f-4d8a012cf7cb None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:49.978030 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d97fdd7f-00ef-45a9-840f-4d8a012cf7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:50.056972 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:50.078198 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 201/411] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:20:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:20:50.079851 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97fdd7f-00ef-45a9-840f-4d8a012cf7cb None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:50.111502 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa0e63-04d0-47c6-82fe-5e57205e7b89 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:50.150149 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c8f36-ddd3-4e25-937a-669a8359ffab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:50.151043 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c8f36-ddd3-4e25-937a-669a8359ffab None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:50.151190 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c8f36-ddd3-4e25-937a-669a8359ffab None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:50.151467 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c8f36-ddd3-4e25-937a-669a8359ffab None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:50.152217 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c8f36-ddd3-4e25-937a-669a8359ffab None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:50.152541 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c8f36-ddd3-4e25-937a-669a8359ffab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:50.154046 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c8f36-ddd3-4e25-937a-669a8359ffab None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:50.163304 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 211/412] 10.222.0.16 () {56 vars in 1111 bytes} [Thu May 26 12:20:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:50.168061 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c8f36-ddd3-4e25-937a-669a8359ffab None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:50.216707 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97fdd7f-00ef-45a9-840f-4d8a012cf7cb None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:50.242080 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:50.257784 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd059b2-c8f1-4179-a8b2-601e07779c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:50.259104 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd059b2-c8f1-4179-a8b2-601e07779c7c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:50.259104 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd059b2-c8f1-4179-a8b2-601e07779c7c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:50.259316 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd059b2-c8f1-4179-a8b2-601e07779c7c None admin] PATH_INFO: `/v3/projects/3c6d7f5ce344426b88b98fb2483df1ff` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:50.260445 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd059b2-c8f1-4179-a8b2-601e07779c7c None admin] RBAC: Authorizing `identity:get_project(project_id=3c6d7f5ce344426b88b98fb2483df1ff)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:50.261937 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd059b2-c8f1-4179-a8b2-601e07779c7c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:50.263604 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 202/413] 10.222.0.16 () {56 vars in 1186 bytes} [Thu May 26 12:20:50 2022] GET /identity/v3/projects/3c6d7f5ce344426b88b98fb2483df1ff => generated 344 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:50.264349 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd059b2-c8f1-4179-a8b2-601e07779c7c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:50.293443 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c8f36-ddd3-4e25-937a-669a8359ffab None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:50.331574 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe816a-1154-423e-9ae4-a9667ce2287b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:50.332365 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe816a-1154-423e-9ae4-a9667ce2287b None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:50.332812 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe816a-1154-423e-9ae4-a9667ce2287b None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:50.332955 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe816a-1154-423e-9ae4-a9667ce2287b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:50.336265 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:50.346260 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebe816a-1154-423e-9ae4-a9667ce2287b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:20:50.353989 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-eebe816a-1154-423e-9ae4-a9667ce2287b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:20:50.353989 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:50.353989 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:50.353989 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:50.353989 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:50.353989 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:50.353989 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:50.353989 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:50.353989 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:50.353989 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:50.353989 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:50.353989 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:50.353989 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:20:50.353989 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:20:50.353989 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:20:50.353989 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:20:50.355088 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:20:50.355088 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:20:50.355088 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:20:50.355088 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:20:50.355088 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:50.355088 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:50.355088 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:50.355088 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:50.355088 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:50.355088 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:50.355088 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:50.355088 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:20:50.355088 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:50.355088 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:50.355088 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:50.355088 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:50.356027 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:50.356027 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:50.356027 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:50.356027 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:50.356027 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:20:50.356027 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:20:50.356027 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:20:50.356027 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:20:50.356027 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:20:50.356027 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:20:50.356027 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:20:50.356027 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:20:50.356027 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 212/414] 10.222.0.16 () {56 vars in 1099 bytes} [Thu May 26 12:20:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:20:50.356800 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe816a-1154-423e-9ae4-a9667ce2287b None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:50.389398 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd059b2-c8f1-4179-a8b2-601e07779c7c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:50.437541 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea7b87c-5058-4b35-be86-aa65bac73d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:50.438678 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7b87c-5058-4b35-be86-aa65bac73d50 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:50.439148 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7b87c-5058-4b35-be86-aa65bac73d50 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:50.439577 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7b87c-5058-4b35-be86-aa65bac73d50 None admin] PATH_INFO: `/v3/groups/d53417386a894e209fefa8f7e9390dac` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:50.440954 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea7b87c-5058-4b35-be86-aa65bac73d50 None admin] RBAC: Authorizing `identity:get_group(group_id=d53417386a894e209fefa8f7e9390dac)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:50.443097 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea7b87c-5058-4b35-be86-aa65bac73d50 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:50.445828 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 203/415] 10.222.0.16 () {56 vars in 1180 bytes} [Thu May 26 12:20:50 2022] GET /identity/v3/groups/d53417386a894e209fefa8f7e9390dac => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:50.446762 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea7b87c-5058-4b35-be86-aa65bac73d50 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:50.475743 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe816a-1154-423e-9ae4-a9667ce2287b None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:50.522095 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ed2c0-ae7a-4087-9af3-46dafbb9dc83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:50.522878 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:50.524991 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ed2c0-ae7a-4087-9af3-46dafbb9dc83 None admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:50.525522 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ed2c0-ae7a-4087-9af3-46dafbb9dc83 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:50.526241 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ed2c0-ae7a-4087-9af3-46dafbb9dc83 None admin] PATH_INFO: `/v3/projects/3c6d7f5ce344426b88b98fb2483df1ff/groups/f75eb50af6bc4c1e8d5572335303f8ae/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:50.530014 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6ed2c0-ae7a-4087-9af3-46dafbb9dc83 None admin] RBAC: Authorizing `identity:create_grant(project_id=3c6d7f5ce344426b88b98fb2483df1ff, group_id=f75eb50af6bc4c1e8d5572335303f8ae, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:50.532408 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6ed2c0-ae7a-4087-9af3-46dafbb9dc83 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:50.548088 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 213/416] 10.222.0.16 () {58 vars in 1442 bytes} [Thu May 26 12:20:50 2022] PUT /identity/v3/projects/3c6d7f5ce344426b88b98fb2483df1ff/groups/f75eb50af6bc4c1e8d5572335303f8ae/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:20:50.549618 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ed2c0-ae7a-4087-9af3-46dafbb9dc83 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:50.580142 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea7b87c-5058-4b35-be86-aa65bac73d50 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:50.647345 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:50.689602 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c2ad0-0fab-4741-b732-be8a242492e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:50.690294 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c2ad0-0fab-4741-b732-be8a242492e4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:50.690582 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c2ad0-0fab-4741-b732-be8a242492e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:50.690858 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c2ad0-0fab-4741-b732-be8a242492e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:50.691629 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5c2ad0-0fab-4741-b732-be8a242492e4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:50.691937 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5c2ad0-0fab-4741-b732-be8a242492e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:50.693439 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5c2ad0-0fab-4741-b732-be8a242492e4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:50.702421 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ed2c0-ae7a-4087-9af3-46dafbb9dc83 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:50.712318 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 204/417] 10.222.0.16 () {56 vars in 1101 bytes} [Thu May 26 12:20:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:50.718210 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c2ad0-0fab-4741-b732-be8a242492e4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:50.745155 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f5759d-8d86-4ca0-999e-f41ed284539a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:50.751623 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5759d-8d86-4ca0-999e-f41ed284539a None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:50.751911 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5759d-8d86-4ca0-999e-f41ed284539a None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:50.752193 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5759d-8d86-4ca0-999e-f41ed284539a None admin] PATH_INFO: `/v3/projects/b7b56cecd1b744e7aa956f6480beb5cf` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:50.753574 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f5759d-8d86-4ca0-999e-f41ed284539a None admin] RBAC: Authorizing `identity:get_project(project_id=b7b56cecd1b744e7aa956f6480beb5cf)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:50.755028 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f5759d-8d86-4ca0-999e-f41ed284539a None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:50.756765 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 214/418] 10.222.0.16 () {56 vars in 1186 bytes} [Thu May 26 12:20:50 2022] GET /identity/v3/projects/b7b56cecd1b744e7aa956f6480beb5cf => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:50.765358 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f5759d-8d86-4ca0-999e-f41ed284539a None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:50.882827 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c2ad0-0fab-4741-b732-be8a242492e4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:50.901344 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:50.913657 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f5759d-8d86-4ca0-999e-f41ed284539a None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:50.939616 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d168bc1-3f70-49bb-af41-e3de6c6f3158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:50.940275 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d168bc1-3f70-49bb-af41-e3de6c6f3158 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:50.940558 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d168bc1-3f70-49bb-af41-e3de6c6f3158 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:50.940856 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d168bc1-3f70-49bb-af41-e3de6c6f3158 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:50.945187 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:50.965868 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d86e61d-4267-4189-93a8-9f3335876c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:50.967028 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d86e61d-4267-4189-93a8-9f3335876c56 None admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:50.967310 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d86e61d-4267-4189-93a8-9f3335876c56 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:50.967586 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d86e61d-4267-4189-93a8-9f3335876c56 None admin] PATH_INFO: `/v3/projects/b7b56cecd1b744e7aa956f6480beb5cf/groups/d53417386a894e209fefa8f7e9390dac/roles/e0f421b5486c47aebb20ea10342cb1e3` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:50.972260 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d86e61d-4267-4189-93a8-9f3335876c56 None admin] RBAC: Authorizing `identity:create_grant(project_id=b7b56cecd1b744e7aa956f6480beb5cf, group_id=d53417386a894e209fefa8f7e9390dac, role_id=e0f421b5486c47aebb20ea10342cb1e3)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:50.973738 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d86e61d-4267-4189-93a8-9f3335876c56 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:50.995385 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 215/419] 10.222.0.16 () {58 vars in 1442 bytes} [Thu May 26 12:20:50 2022] PUT /identity/v3/projects/b7b56cecd1b744e7aa956f6480beb5cf/groups/d53417386a894e209fefa8f7e9390dac/roles/e0f421b5486c47aebb20ea10342cb1e3 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:20:51.043037 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d168bc1-3f70-49bb-af41-e3de6c6f3158 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:51.044722 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d168bc1-3f70-49bb-af41-e3de6c6f3158 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:51.186692 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 205/420] 10.222.0.16 () {58 vars in 1282 bytes} [Thu May 26 12:20:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 12:20:51.192813 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d86e61d-4267-4189-93a8-9f3335876c56 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:51.267009 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc566cd-d820-4fc4-b000-0d3dd22e1d57 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:51.267651 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc566cd-d820-4fc4-b000-0d3dd22e1d57 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:51.268147 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc566cd-d820-4fc4-b000-0d3dd22e1d57 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:51.270267 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 206/421] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:20:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:51.276358 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13df3c-3ebc-4095-941f-5c4eda36c079 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:51.277085 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13df3c-3ebc-4095-941f-5c4eda36c079 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:51.277908 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13df3c-3ebc-4095-941f-5c4eda36c079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:51.298538 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-9b13df3c-3ebc-4095-941f-5c4eda36c079 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:51.299731 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9b13df3c-3ebc-4095-941f-5c4eda36c079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:51.315150 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:51.325953 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d86e61d-4267-4189-93a8-9f3335876c56 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:51.365131 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8162d47-4331-4039-9feb-47e31aec7343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:51.366493 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8162d47-4331-4039-9feb-47e31aec7343 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:51.366981 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8162d47-4331-4039-9feb-47e31aec7343 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:51.367468 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8162d47-4331-4039-9feb-47e31aec7343 None admin] PATH_INFO: `/v3/projects/6ae47773ffcf4aad9f7fb9bf16e40752` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:51.369743 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8162d47-4331-4039-9feb-47e31aec7343 None admin] RBAC: Authorizing `identity:get_project(project_id=6ae47773ffcf4aad9f7fb9bf16e40752)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:51.370534 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8162d47-4331-4039-9feb-47e31aec7343 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:51.372742 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 216/422] 10.222.0.16 () {56 vars in 1186 bytes} [Thu May 26 12:20:51 2022] GET /identity/v3/projects/6ae47773ffcf4aad9f7fb9bf16e40752 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:51.381782 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8162d47-4331-4039-9feb-47e31aec7343 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:51.388515 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 207/423] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:20:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:20:51.417050 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b13df3c-3ebc-4095-941f-5c4eda36c079 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:51.476412 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:51.558808 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8162d47-4331-4039-9feb-47e31aec7343 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:51.571022 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b13df3c-3ebc-4095-941f-5c4eda36c079 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:51.597586 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bfeaa2-edf4-4265-aea1-ad0833b851be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:51.598719 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bfeaa2-edf4-4265-aea1-ad0833b851be None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:51.599932 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bfeaa2-edf4-4265-aea1-ad0833b851be None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:51.600380 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bfeaa2-edf4-4265-aea1-ad0833b851be None admin] PATH_INFO: `/v3/groups/d53417386a894e209fefa8f7e9390dac` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:51.602491 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bfeaa2-edf4-4265-aea1-ad0833b851be None admin] RBAC: Authorizing `identity:get_group(group_id=d53417386a894e209fefa8f7e9390dac)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:51.605526 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bfeaa2-edf4-4265-aea1-ad0833b851be None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:51.611760 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 217/424] 10.222.0.16 () {56 vars in 1180 bytes} [Thu May 26 12:20:51 2022] GET /identity/v3/groups/d53417386a894e209fefa8f7e9390dac => generated 226 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:51.614149 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bfeaa2-edf4-4265-aea1-ad0833b851be None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:51.641621 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcd6d08-17fd-4338-a123-c8f580da6448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:51.642744 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd6d08-17fd-4338-a123-c8f580da6448 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:51.644257 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd6d08-17fd-4338-a123-c8f580da6448 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:51.646288 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd6d08-17fd-4338-a123-c8f580da6448 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:51.674044 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcd6d08-17fd-4338-a123-c8f580da6448 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:20:51.682246 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-2dcd6d08-17fd-4338-a123-c8f580da6448 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:20:51.682246 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:51.682246 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:51.682246 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:51.682246 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:51.682246 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:51.682246 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:51.682246 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:51.682246 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:51.682246 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:51.682246 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:51.682246 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:51.682246 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:20:51.682246 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:20:51.682246 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:20:51.682246 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:20:51.683318 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:20:51.683318 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:20:51.683318 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:20:51.683318 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:20:51.683318 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:51.683318 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:51.683318 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:51.683318 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:51.683318 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:51.683318 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:51.683318 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:51.683318 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:20:51.683318 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:51.683318 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:51.683318 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:51.683318 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:51.684301 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:51.684301 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:51.684301 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:51.684301 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:51.684301 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:20:51.684301 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:20:51.684301 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:20:51.684301 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:20:51.684301 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:20:51.684301 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:20:51.684301 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:20:51.684301 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:20:51.693273 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 208/425] 10.222.0.16 () {56 vars in 1114 bytes} [Thu May 26 12:20:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:20:51.698605 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcd6d08-17fd-4338-a123-c8f580da6448 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:51.728607 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:51.747044 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bfeaa2-edf4-4265-aea1-ad0833b851be None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:51.782527 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e924350b-cb53-4ba6-9f2e-71dbff6febf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:51.783555 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924350b-cb53-4ba6-9f2e-71dbff6febf5 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:51.784038 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924350b-cb53-4ba6-9f2e-71dbff6febf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:51.784533 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924350b-cb53-4ba6-9f2e-71dbff6febf5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:51.785621 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e924350b-cb53-4ba6-9f2e-71dbff6febf5 None admin] RBAC: Adding query filter params (group.id=d53417386a894e209fefa8f7e9390dac, role.id=b0bf2a578f0a4319b93dd3b8a26a96b7, scope.project.id=6ae47773ffcf4aad9f7fb9bf16e40752) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:51.786153 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e924350b-cb53-4ba6-9f2e-71dbff6febf5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:51.787771 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e924350b-cb53-4ba6-9f2e-71dbff6febf5 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:51.794570 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 218/426] 10.222.0.16 () {56 vars in 1376 bytes} [Thu May 26 12:20:51 2022] GET /identity/v3/role_assignments?group.id=d53417386a894e209fefa8f7e9390dac&scope.project.id=6ae47773ffcf4aad9f7fb9bf16e40752&role.id=b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 611 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:20:51.797237 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:51.898005 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcd6d08-17fd-4338-a123-c8f580da6448 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:51.962537 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd772a1-e254-4f0f-9573-00a0783f725f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:51.963232 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd772a1-e254-4f0f-9573-00a0783f725f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:51.963513 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd772a1-e254-4f0f-9573-00a0783f725f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:51.963786 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd772a1-e254-4f0f-9573-00a0783f725f None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:51.964550 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd772a1-e254-4f0f-9573-00a0783f725f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:51.964874 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd772a1-e254-4f0f-9573-00a0783f725f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:51.966304 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd772a1-e254-4f0f-9573-00a0783f725f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:51.980971 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 209/427] 10.222.0.16 () {56 vars in 1111 bytes} [Thu May 26 12:20:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:20:51.986750 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e924350b-cb53-4ba6-9f2e-71dbff6febf5 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:52.106867 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e924350b-cb53-4ba6-9f2e-71dbff6febf5 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:52.141202 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef31f1-5bd2-48d4-973f-b729541a1624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:52.142406 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef31f1-5bd2-48d4-973f-b729541a1624 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:52.142702 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef31f1-5bd2-48d4-973f-b729541a1624 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:52.142979 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef31f1-5bd2-48d4-973f-b729541a1624 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:52.199844 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:52.220318 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef31f1-5bd2-48d4-973f-b729541a1624 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:52.222107 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef31f1-5bd2-48d4-973f-b729541a1624 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:52.228766 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd69b72-6381-43b9-85b8-16ac57938526 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:52.229088 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd69b72-6381-43b9-85b8-16ac57938526 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:52.229370 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd69b72-6381-43b9-85b8-16ac57938526 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:52.231048 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 210/428] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:20:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:20:52.236617 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63980e-b69d-4c9b-bd43-0d6aef48c5e1 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:52.236863 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63980e-b69d-4c9b-bd43-0d6aef48c5e1 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:52.237205 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63980e-b69d-4c9b-bd43-0d6aef48c5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:52.257194 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-0d63980e-b69d-4c9b-bd43-0d6aef48c5e1 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:52.258384 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0d63980e-b69d-4c9b-bd43-0d6aef48c5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:52.342995 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:52.350760 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 211/429] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:20:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:20:52.351628 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 219/430] 10.222.0.16 () {58 vars in 1282 bytes} [Thu May 26 12:20:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:20:52.361884 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d63980e-b69d-4c9b-bd43-0d6aef48c5e1 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:52.384049 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef31f1-5bd2-48d4-973f-b729541a1624 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:52.480113 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d63980e-b69d-4c9b-bd43-0d6aef48c5e1 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:52.487648 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:52.504550 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef31f1-5bd2-48d4-973f-b729541a1624 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:52.521118 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aacd414-79e1-4b2f-91a0-268aab349629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:52.521992 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aacd414-79e1-4b2f-91a0-268aab349629 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:52.522376 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aacd414-79e1-4b2f-91a0-268aab349629 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:52.522657 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aacd414-79e1-4b2f-91a0-268aab349629 None admin] PATH_INFO: `/v3/projects/6ae47773ffcf4aad9f7fb9bf16e40752` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:52.523985 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aacd414-79e1-4b2f-91a0-268aab349629 None admin] RBAC: Authorizing `identity:get_project(project_id=6ae47773ffcf4aad9f7fb9bf16e40752)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:52.525482 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aacd414-79e1-4b2f-91a0-268aab349629 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:52.527601 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 212/431] 10.222.0.16 () {56 vars in 1186 bytes} [Thu May 26 12:20:52 2022] GET /identity/v3/projects/6ae47773ffcf4aad9f7fb9bf16e40752 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:52.533034 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aacd414-79e1-4b2f-91a0-268aab349629 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:52.541452 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e764d-26e1-4e84-985f-a943aaa6ad4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:52.542252 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e764d-26e1-4e84-985f-a943aaa6ad4d None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:52.542534 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e764d-26e1-4e84-985f-a943aaa6ad4d None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:52.542810 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e764d-26e1-4e84-985f-a943aaa6ad4d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:52.554064 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6e764d-26e1-4e84-985f-a943aaa6ad4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:20:52.561852 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-ea6e764d-26e1-4e84-985f-a943aaa6ad4d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:20:52.561852 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:52.561852 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:52.561852 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:52.561852 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:52.561852 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:52.561852 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:52.561852 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:52.561852 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:52.561852 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:52.561852 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:52.561852 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:52.561852 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:20:52.561852 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:20:52.561852 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:20:52.561852 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:20:52.562734 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:20:52.562734 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:20:52.562734 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:20:52.562734 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:20:52.562734 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:52.562734 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:52.562734 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:52.562734 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:52.562734 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:52.562734 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:52.562734 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:52.562734 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:20:52.562734 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:52.562734 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:52.562734 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:52.562734 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:52.564749 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:52.564749 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:52.564749 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:52.564749 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:52.564749 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:20:52.564749 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:20:52.564749 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:20:52.564749 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:20:52.564749 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:20:52.564749 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:20:52.564749 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:20:52.564749 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:20:52.564749 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 220/432] 10.222.0.16 () {56 vars in 1099 bytes} [Thu May 26 12:20:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:20:52.573111 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e764d-26e1-4e84-985f-a943aaa6ad4d None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:52.608743 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:52.652730 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aacd414-79e1-4b2f-91a0-268aab349629 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:52.697301 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8092b4d-976a-48ec-a0f7-1f52191bdc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:52.698167 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8092b4d-976a-48ec-a0f7-1f52191bdc24 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:52.698450 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8092b4d-976a-48ec-a0f7-1f52191bdc24 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:52.698726 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8092b4d-976a-48ec-a0f7-1f52191bdc24 None admin] PATH_INFO: `/v3/groups/d53417386a894e209fefa8f7e9390dac` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:52.700132 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8092b4d-976a-48ec-a0f7-1f52191bdc24 None admin] RBAC: Authorizing `identity:get_group(group_id=d53417386a894e209fefa8f7e9390dac)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:52.701645 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8092b4d-976a-48ec-a0f7-1f52191bdc24 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:52.704312 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 213/433] 10.222.0.16 () {56 vars in 1180 bytes} [Thu May 26 12:20:52 2022] GET /identity/v3/groups/d53417386a894e209fefa8f7e9390dac => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:20:52.709663 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e764d-26e1-4e84-985f-a943aaa6ad4d None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:52.710886 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8092b4d-976a-48ec-a0f7-1f52191bdc24 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:52.764861 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d52db3-ed65-41e5-b5f1-cdb3296d6504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:52.764861 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d52db3-ed65-41e5-b5f1-cdb3296d6504 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:52.764861 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d52db3-ed65-41e5-b5f1-cdb3296d6504 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:52.764861 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d52db3-ed65-41e5-b5f1-cdb3296d6504 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:52.765205 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d52db3-ed65-41e5-b5f1-cdb3296d6504 None admin] RBAC: Adding query filter params (name=member) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:52.765205 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d52db3-ed65-41e5-b5f1-cdb3296d6504 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:52.765205 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d52db3-ed65-41e5-b5f1-cdb3296d6504 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:52.776766 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 221/434] 10.222.0.16 () {56 vars in 1101 bytes} [Thu May 26 12:20:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:52.783091 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d52db3-ed65-41e5-b5f1-cdb3296d6504 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:52.795808 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:52.831414 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8092b4d-976a-48ec-a0f7-1f52191bdc24 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:52.870470 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5322f71a-75cb-456f-8292-2989f5f29ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:52.871131 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5322f71a-75cb-456f-8292-2989f5f29ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:52.871521 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5322f71a-75cb-456f-8292-2989f5f29ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:52.871801 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5322f71a-75cb-456f-8292-2989f5f29ca6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:52.872751 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5322f71a-75cb-456f-8292-2989f5f29ca6 None admin] RBAC: Adding query filter params (group.id=d53417386a894e209fefa8f7e9390dac, role.id=e0f421b5486c47aebb20ea10342cb1e3, scope.project.id=6ae47773ffcf4aad9f7fb9bf16e40752) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:52.873099 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5322f71a-75cb-456f-8292-2989f5f29ca6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:52.874545 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5322f71a-75cb-456f-8292-2989f5f29ca6 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:52.877867 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:52.882851 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 214/435] 10.222.0.16 () {56 vars in 1376 bytes} [Thu May 26 12:20:52 2022] GET /identity/v3/role_assignments?group.id=d53417386a894e209fefa8f7e9390dac&scope.project.id=6ae47773ffcf4aad9f7fb9bf16e40752&role.id=e0f421b5486c47aebb20ea10342cb1e3 => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:52.912813 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d52db3-ed65-41e5-b5f1-cdb3296d6504 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:52.951865 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d6f68-2354-49f3-893e-1577aeb62d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:52.952532 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d6f68-2354-49f3-893e-1577aeb62d04 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:52.952818 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d6f68-2354-49f3-893e-1577aeb62d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:52.953132 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d6f68-2354-49f3-893e-1577aeb62d04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:53.033694 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377d6f68-2354-49f3-893e-1577aeb62d04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:53.035171 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377d6f68-2354-49f3-893e-1577aeb62d04 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:53.045223 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:53.145460 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 222/436] 10.222.0.16 () {58 vars in 1282 bytes} [Thu May 26 12:20:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 12:20:53.150704 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5322f71a-75cb-456f-8292-2989f5f29ca6 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:53.220301 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05bb34-7a6a-4203-b771-9a943eac1c25 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:53.221041 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05bb34-7a6a-4203-b771-9a943eac1c25 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:53.221402 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05bb34-7a6a-4203-b771-9a943eac1c25 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:53.223591 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 223/437] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:20:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:20:53.228650 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da1ff7-5850-4fcc-801a-d8b00b3fb287 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:53.229096 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da1ff7-5850-4fcc-801a-d8b00b3fb287 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:53.229376 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da1ff7-5850-4fcc-801a-d8b00b3fb287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:53.250430 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-92da1ff7-5850-4fcc-801a-d8b00b3fb287 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:53.251701 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-92da1ff7-5850-4fcc-801a-d8b00b3fb287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:53.277705 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5322f71a-75cb-456f-8292-2989f5f29ca6 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:53.326584 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c4ae1-f62c-4a41-9e91-b5bd262c7ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:53.326763 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c4ae1-f62c-4a41-9e91-b5bd262c7ebc None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:53.326979 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c4ae1-f62c-4a41-9e91-b5bd262c7ebc None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:53.327197 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c4ae1-f62c-4a41-9e91-b5bd262c7ebc None admin] PATH_INFO: `/v3/projects/b7b56cecd1b744e7aa956f6480beb5cf` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:53.330117 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641c4ae1-f62c-4a41-9e91-b5bd262c7ebc None admin] RBAC: Authorizing `identity:get_project(project_id=b7b56cecd1b744e7aa956f6480beb5cf)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:53.331837 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641c4ae1-f62c-4a41-9e91-b5bd262c7ebc None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:53.333760 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 215/438] 10.222.0.16 () {56 vars in 1186 bytes} [Thu May 26 12:20:53 2022] GET /identity/v3/projects/b7b56cecd1b744e7aa956f6480beb5cf => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:53.338883 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c4ae1-f62c-4a41-9e91-b5bd262c7ebc None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:53.344899 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 224/439] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:20:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:20:53.368048 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da1ff7-5850-4fcc-801a-d8b00b3fb287 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:53.411900 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:53.415532 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:53.453141 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c4ae1-f62c-4a41-9e91-b5bd262c7ebc None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:53.489455 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da1ff7-5850-4fcc-801a-d8b00b3fb287 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:53.492576 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81fd2aa-39fc-4c48-a5fe-29a75fb2a7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:53.493466 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81fd2aa-39fc-4c48-a5fe-29a75fb2a7d4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:53.493754 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81fd2aa-39fc-4c48-a5fe-29a75fb2a7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:53.494033 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81fd2aa-39fc-4c48-a5fe-29a75fb2a7d4 None admin] PATH_INFO: `/v3/groups/d53417386a894e209fefa8f7e9390dac` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:53.495232 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81fd2aa-39fc-4c48-a5fe-29a75fb2a7d4 None admin] RBAC: Authorizing `identity:get_group(group_id=d53417386a894e209fefa8f7e9390dac)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:53.496801 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81fd2aa-39fc-4c48-a5fe-29a75fb2a7d4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:53.503743 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 216/440] 10.222.0.16 () {56 vars in 1180 bytes} [Thu May 26 12:20:53 2022] GET /identity/v3/groups/d53417386a894e209fefa8f7e9390dac => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:20:53.504710 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81fd2aa-39fc-4c48-a5fe-29a75fb2a7d4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:53.528725 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e8bfb-8ae8-49a6-b6e4-2e8ebc107746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:53.529545 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e8bfb-8ae8-49a6-b6e4-2e8ebc107746 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:53.529828 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e8bfb-8ae8-49a6-b6e4-2e8ebc107746 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:53.530100 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e8bfb-8ae8-49a6-b6e4-2e8ebc107746 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:53.540166 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e8bfb-8ae8-49a6-b6e4-2e8ebc107746 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:20:53.548284 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-637e8bfb-8ae8-49a6-b6e4-2e8ebc107746 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:20:53.548284 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:53.548284 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:53.548284 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:53.548284 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:53.548284 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:53.548284 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:53.548284 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:53.548284 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:53.548284 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:53.548284 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:53.548284 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:53.548284 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:20:53.548284 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:20:53.548284 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:20:53.548284 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:20:53.549252 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:20:53.549252 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:20:53.549252 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:20:53.549252 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:20:53.549252 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:53.549252 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:53.549252 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:53.549252 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:53.549252 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:53.549252 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:53.549252 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:53.549252 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:20:53.549252 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:53.549252 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:53.549252 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:53.549252 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:53.550031 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:53.550031 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:53.550031 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:53.550031 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:53.550031 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:20:53.550031 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:20:53.550031 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:20:53.550031 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:20:53.550031 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:20:53.550031 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:20:53.550031 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:20:53.550031 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:20:53.550031 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 225/441] 10.222.0.16 () {56 vars in 1096 bytes} [Thu May 26 12:20:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:20:53.556329 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e8bfb-8ae8-49a6-b6e4-2e8ebc107746 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:53.613365 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81fd2aa-39fc-4c48-a5fe-29a75fb2a7d4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:53.651349 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7050bb3e-e2af-4fd7-a1c4-94222942debf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:53.652030 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7050bb3e-e2af-4fd7-a1c4-94222942debf None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:53.652315 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7050bb3e-e2af-4fd7-a1c4-94222942debf None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:53.652595 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7050bb3e-e2af-4fd7-a1c4-94222942debf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:53.653455 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7050bb3e-e2af-4fd7-a1c4-94222942debf None admin] RBAC: Adding query filter params (group.id=d53417386a894e209fefa8f7e9390dac, role.id=b0bf2a578f0a4319b93dd3b8a26a96b7, scope.project.id=b7b56cecd1b744e7aa956f6480beb5cf) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:53.653776 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7050bb3e-e2af-4fd7-a1c4-94222942debf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:53.654590 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:53.655217 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7050bb3e-e2af-4fd7-a1c4-94222942debf None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:53.658217 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:53.661451 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e8bfb-8ae8-49a6-b6e4-2e8ebc107746 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:53.661618 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 217/442] 10.222.0.16 () {56 vars in 1376 bytes} [Thu May 26 12:20:53 2022] GET /identity/v3/role_assignments?group.id=d53417386a894e209fefa8f7e9390dac&scope.project.id=b7b56cecd1b744e7aa956f6480beb5cf&role.id=b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:20:53.662881 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d58ea-8e85-4593-ae6a-211602599147 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:53.663328 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d58ea-8e85-4593-ae6a-211602599147 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:53.663770 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d58ea-8e85-4593-ae6a-211602599147 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:53.665429 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 218/443] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:20:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:53.671523 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bd200-9785-4af9-ac65-78f01d6d0c71 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:53.672223 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bd200-9785-4af9-ac65-78f01d6d0c71 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:53.673069 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bd200-9785-4af9-ac65-78f01d6d0c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:53.690778 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-230bd200-9785-4af9-ac65-78f01d6d0c71 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:53.692021 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-230bd200-9785-4af9-ac65-78f01d6d0c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:53.701755 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471922d6-52f5-45ba-8b68-8ce7998bbcc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:53.702543 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471922d6-52f5-45ba-8b68-8ce7998bbcc5 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:53.702825 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471922d6-52f5-45ba-8b68-8ce7998bbcc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:53.703155 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471922d6-52f5-45ba-8b68-8ce7998bbcc5 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:53.704609 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471922d6-52f5-45ba-8b68-8ce7998bbcc5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:53.704945 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471922d6-52f5-45ba-8b68-8ce7998bbcc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:53.706413 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471922d6-52f5-45ba-8b68-8ce7998bbcc5 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:53.716824 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 226/444] 10.222.0.16 () {56 vars in 1099 bytes} [Thu May 26 12:20:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:20:53.722447 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471922d6-52f5-45ba-8b68-8ce7998bbcc5 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:53.789248 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 219/445] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:20:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:20:53.806075 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230bd200-9785-4af9-ac65-78f01d6d0c71 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:53.838181 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471922d6-52f5-45ba-8b68-8ce7998bbcc5 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:53.881542 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2536986d-62dc-4929-b833-3940329bdf84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:53.881737 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536986d-62dc-4929-b833-3940329bdf84 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:53.882004 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536986d-62dc-4929-b833-3940329bdf84 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:53.882283 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536986d-62dc-4929-b833-3940329bdf84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:53.914014 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:53.920334 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230bd200-9785-4af9-ac65-78f01d6d0c71 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:53.954255 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:53.961579 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4558a27c-a76a-4056-98d0-c90ec566b19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:53.962397 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558a27c-a76a-4056-98d0-c90ec566b19c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:53.962686 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558a27c-a76a-4056-98d0-c90ec566b19c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:53.962959 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558a27c-a76a-4056-98d0-c90ec566b19c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:53.964380 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2536986d-62dc-4929-b833-3940329bdf84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:53.965868 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2536986d-62dc-4929-b833-3940329bdf84 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:53.975950 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4558a27c-a76a-4056-98d0-c90ec566b19c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:20:53.984133 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-4558a27c-a76a-4056-98d0-c90ec566b19c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:20:53.984133 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:53.984133 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:53.984133 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:53.984133 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:53.984133 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:53.984133 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:53.984133 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:53.984133 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:53.984133 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:53.984133 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:53.984133 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:53.984133 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:20:53.984133 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:20:53.984133 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:20:53.984133 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:20:53.985821 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:20:53.985821 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:20:53.985821 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:20:53.985821 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:20:53.985821 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:53.985821 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:53.985821 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:53.985821 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:53.985821 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:53.985821 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:53.985821 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:53.985821 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:20:53.985821 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:53.985821 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:53.985821 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:53.985821 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:53.986764 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:53.986764 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:53.986764 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:53.986764 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:53.986764 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:20:53.986764 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:20:53.986764 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:20:53.986764 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:20:53.986764 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:20:53.986764 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:20:53.986764 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:20:53.986764 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:20:53.986764 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 220/446] 10.222.0.16 () {56 vars in 1114 bytes} [Thu May 26 12:20:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:20:53.994633 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4558a27c-a76a-4056-98d0-c90ec566b19c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:54.080869 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 227/447] 10.222.0.16 () {58 vars in 1282 bytes} [Thu May 26 12:20:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 12:20:54.086424 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2536986d-62dc-4929-b833-3940329bdf84 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:54.109463 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4558a27c-a76a-4056-98d0-c90ec566b19c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:54.142448 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:54.142609 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d634de99-e724-4dba-8fa4-4414dfe108f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:54.143128 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634de99-e724-4dba-8fa4-4414dfe108f4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:54.143414 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634de99-e724-4dba-8fa4-4414dfe108f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:54.143688 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634de99-e724-4dba-8fa4-4414dfe108f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:54.144438 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d634de99-e724-4dba-8fa4-4414dfe108f4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:54.144740 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d634de99-e724-4dba-8fa4-4414dfe108f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:54.146159 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d634de99-e724-4dba-8fa4-4414dfe108f4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:54.153907 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 221/448] 10.222.0.16 () {56 vars in 1111 bytes} [Thu May 26 12:20:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:20:54.159951 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d634de99-e724-4dba-8fa4-4414dfe108f4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:54.183874 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2536986d-62dc-4929-b833-3940329bdf84 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:54.211147 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:54.218334 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a612c41-0a29-4e9c-8216-3afbfe4e8cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:54.219181 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a612c41-0a29-4e9c-8216-3afbfe4e8cb1 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:54.219998 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a612c41-0a29-4e9c-8216-3afbfe4e8cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:54.220271 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a612c41-0a29-4e9c-8216-3afbfe4e8cb1 None admin] PATH_INFO: `/v3/projects/3c6d7f5ce344426b88b98fb2483df1ff` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:54.221463 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a612c41-0a29-4e9c-8216-3afbfe4e8cb1 None admin] RBAC: Authorizing `identity:get_project(project_id=3c6d7f5ce344426b88b98fb2483df1ff)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:54.222881 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a612c41-0a29-4e9c-8216-3afbfe4e8cb1 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:54.224540 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 228/449] 10.222.0.16 () {56 vars in 1186 bytes} [Thu May 26 12:20:54 2022] GET /identity/v3/projects/3c6d7f5ce344426b88b98fb2483df1ff => generated 344 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:20:54.229782 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a612c41-0a29-4e9c-8216-3afbfe4e8cb1 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:54.261548 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d634de99-e724-4dba-8fa4-4414dfe108f4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:54.294436 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97395437-56e9-4ff4-b31e-353b42de6985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:54.295078 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97395437-56e9-4ff4-b31e-353b42de6985 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:54.295364 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97395437-56e9-4ff4-b31e-353b42de6985 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:54.295640 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97395437-56e9-4ff4-b31e-353b42de6985 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:54.324620 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a612c41-0a29-4e9c-8216-3afbfe4e8cb1 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:54.351050 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:54.360175 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117cfa2c-1292-49fa-9c51-f8f847e3d00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:54.361064 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117cfa2c-1292-49fa-9c51-f8f847e3d00c None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:54.361351 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117cfa2c-1292-49fa-9c51-f8f847e3d00c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:54.361630 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117cfa2c-1292-49fa-9c51-f8f847e3d00c None admin] PATH_INFO: `/v3/groups/f75eb50af6bc4c1e8d5572335303f8ae` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:54.362734 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97395437-56e9-4ff4-b31e-353b42de6985 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:54.362844 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117cfa2c-1292-49fa-9c51-f8f847e3d00c None admin] RBAC: Authorizing `identity:get_group(group_id=f75eb50af6bc4c1e8d5572335303f8ae)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:54.364191 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97395437-56e9-4ff4-b31e-353b42de6985 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:54.364289 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117cfa2c-1292-49fa-9c51-f8f847e3d00c None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:54.365867 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 229/450] 10.222.0.16 () {56 vars in 1180 bytes} [Thu May 26 12:20:54 2022] GET /identity/v3/groups/f75eb50af6bc4c1e8d5572335303f8ae => generated 229 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:20:54.371470 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117cfa2c-1292-49fa-9c51-f8f847e3d00c None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:54.414235 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:54.461554 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 222/451] 10.222.0.16 () {58 vars in 1282 bytes} [Thu May 26 12:20:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 12:20:54.467259 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97395437-56e9-4ff4-b31e-353b42de6985 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:54.467834 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117cfa2c-1292-49fa-9c51-f8f847e3d00c None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:54.501335 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313ee92-ba21-420a-906a-091b092a7f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:54.501976 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313ee92-ba21-420a-906a-091b092a7f51 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:54.502250 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313ee92-ba21-420a-906a-091b092a7f51 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:54.502525 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313ee92-ba21-420a-906a-091b092a7f51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:54.503355 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e313ee92-ba21-420a-906a-091b092a7f51 None admin] RBAC: Adding query filter params (group.id=f75eb50af6bc4c1e8d5572335303f8ae, role.id=1a8e523ecbc84d818c2a9af0fb54da74, scope.project.id=3c6d7f5ce344426b88b98fb2483df1ff) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:54.503668 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e313ee92-ba21-420a-906a-091b092a7f51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:54.505123 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e313ee92-ba21-420a-906a-091b092a7f51 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:54.510883 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 230/452] 10.222.0.16 () {56 vars in 1376 bytes} [Thu May 26 12:20:54 2022] GET /identity/v3/role_assignments?group.id=f75eb50af6bc4c1e8d5572335303f8ae&scope.project.id=3c6d7f5ce344426b88b98fb2483df1ff&role.id=1a8e523ecbc84d818c2a9af0fb54da74 => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:20:54.567757 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97395437-56e9-4ff4-b31e-353b42de6985 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:54.603905 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec129735-f7ab-4727-bffb-2344209ee8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:54.605049 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec129735-f7ab-4727-bffb-2344209ee8f2 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:54.605334 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec129735-f7ab-4727-bffb-2344209ee8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:54.605609 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec129735-f7ab-4727-bffb-2344209ee8f2 None admin] PATH_INFO: `/v3/projects/b7b56cecd1b744e7aa956f6480beb5cf` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:54.606893 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec129735-f7ab-4727-bffb-2344209ee8f2 None admin] RBAC: Authorizing `identity:get_project(project_id=b7b56cecd1b744e7aa956f6480beb5cf)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:54.608376 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec129735-f7ab-4727-bffb-2344209ee8f2 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:54.610178 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 223/453] 10.222.0.16 () {56 vars in 1186 bytes} [Thu May 26 12:20:54 2022] GET /identity/v3/projects/b7b56cecd1b744e7aa956f6480beb5cf => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:20:54.615829 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313ee92-ba21-420a-906a-091b092a7f51 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:54.675915 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:54.719073 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313ee92-ba21-420a-906a-091b092a7f51 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:54.753031 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d4f96-6126-438e-a331-3de42c8125f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:54.753889 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d4f96-6126-438e-a331-3de42c8125f9 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:54.754172 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d4f96-6126-438e-a331-3de42c8125f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:54.754449 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d4f96-6126-438e-a331-3de42c8125f9 None admin] PATH_INFO: `/v3/groups/d53417386a894e209fefa8f7e9390dac` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:54.755608 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28d4f96-6126-438e-a331-3de42c8125f9 None admin] RBAC: Authorizing `identity:get_group(group_id=d53417386a894e209fefa8f7e9390dac)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:54.757080 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28d4f96-6126-438e-a331-3de42c8125f9 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:54.758695 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 231/454] 10.222.0.16 () {56 vars in 1180 bytes} [Thu May 26 12:20:54 2022] GET /identity/v3/groups/d53417386a894e209fefa8f7e9390dac => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:20:54.764394 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec129735-f7ab-4727-bffb-2344209ee8f2 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:54.786059 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:54.860040 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec129735-f7ab-4727-bffb-2344209ee8f2 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:54.892273 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bfc336-bcf7-4bc5-a8d7-e767c89a463b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:54.892937 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfc336-bcf7-4bc5-a8d7-e767c89a463b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:54.893220 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfc336-bcf7-4bc5-a8d7-e767c89a463b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:54.893494 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfc336-bcf7-4bc5-a8d7-e767c89a463b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:54.894308 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bfc336-bcf7-4bc5-a8d7-e767c89a463b None admin] RBAC: Adding query filter params (group.id=d53417386a894e209fefa8f7e9390dac, role.id=e0f421b5486c47aebb20ea10342cb1e3, scope.project.id=b7b56cecd1b744e7aa956f6480beb5cf) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:54.894618 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bfc336-bcf7-4bc5-a8d7-e767c89a463b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:54.896035 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bfc336-bcf7-4bc5-a8d7-e767c89a463b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:54.901638 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 224/455] 10.222.0.16 () {56 vars in 1376 bytes} [Thu May 26 12:20:54 2022] GET /identity/v3/role_assignments?group.id=d53417386a894e209fefa8f7e9390dac&scope.project.id=b7b56cecd1b744e7aa956f6480beb5cf&role.id=e0f421b5486c47aebb20ea10342cb1e3 => generated 611 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:57.563903 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc55d3-cbff-4d04-9de6-13b3977c065f None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:57.564427 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc55d3-cbff-4d04-9de6-13b3977c065f None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:57.564634 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc55d3-cbff-4d04-9de6-13b3977c065f None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:57.566521 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 232/456] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:20:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:57.571804 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f4bc8a-d243-4902-a2c2-b40a0a41e181 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:57.572660 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f4bc8a-d243-4902-a2c2-b40a0a41e181 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:57.573177 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f4bc8a-d243-4902-a2c2-b40a0a41e181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:57.590884 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c0f4bc8a-d243-4902-a2c2-b40a0a41e181 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:57.592652 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c0f4bc8a-d243-4902-a2c2-b40a0a41e181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:57.662611 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 225/457] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:20:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:20:57.699708 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc55d3-cbff-4d04-9de6-13b3977c065f None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:57.803246 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ceaca-5a5c-4231-a2be-4f55e892fb15 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:57.803904 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ceaca-5a5c-4231-a2be-4f55e892fb15 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:57.804385 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ceaca-5a5c-4231-a2be-4f55e892fb15 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:57.806257 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 226/458] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:20:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:20:57.811567 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87dc2d-321e-4cc5-8f24-0ddcb1ae6396 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:57.812037 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87dc2d-321e-4cc5-8f24-0ddcb1ae6396 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:57.812462 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87dc2d-321e-4cc5-8f24-0ddcb1ae6396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:57.842797 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-6b87dc2d-321e-4cc5-8f24-0ddcb1ae6396 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:57.844297 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6b87dc2d-321e-4cc5-8f24-0ddcb1ae6396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:57.849611 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc55d3-cbff-4d04-9de6-13b3977c065f None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:57.861182 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:57.910440 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:57.925926 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 227/459] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:20:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:20:57.926824 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6483841f-5da9-44fa-aefb-d21206656030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:57.927927 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483841f-5da9-44fa-aefb-d21206656030 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:57.928426 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483841f-5da9-44fa-aefb-d21206656030 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:57.928914 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483841f-5da9-44fa-aefb-d21206656030 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:57.940612 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6483841f-5da9-44fa-aefb-d21206656030 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:57.942355 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6483841f-5da9-44fa-aefb-d21206656030 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:57.961058 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-6483841f-5da9-44fa-aefb-d21206656030 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:20:57.961058 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:57.961058 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:57.961058 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:57.961058 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:57.961058 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:57.961058 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:57.961058 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:57.961058 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:57.961058 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:57.961058 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:57.961058 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:57.961058 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:20:57.961058 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:20:57.961058 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:20:57.961923 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:20:57.961923 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:57.961923 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:57.961923 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:57.961923 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:57.961923 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:57.961923 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:57.961923 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:57.961923 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:20:57.961923 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:57.961923 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:57.961923 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:57.961923 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:57.961923 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:57.961923 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:57.961923 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:57.961923 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:57.962758 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:20:57.962758 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:20:57.962758 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:20:57.962758 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:20:57.970538 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87dc2d-321e-4cc5-8f24-0ddcb1ae6396 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:57.972890 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 233/460] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:20:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:20:57.979979 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6483841f-5da9-44fa-aefb-d21206656030 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:58.152892 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87dc2d-321e-4cc5-8f24-0ddcb1ae6396 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:58.180951 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6483841f-5da9-44fa-aefb-d21206656030 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:58.188934 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bbd699-6144-467e-b80f-dd33249cfcca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:58.190034 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbd699-6144-467e-b80f-dd33249cfcca None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:58.190531 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbd699-6144-467e-b80f-dd33249cfcca None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:58.191003 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbd699-6144-467e-b80f-dd33249cfcca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:58.210070 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bbd699-6144-467e-b80f-dd33249cfcca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:58.211974 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bbd699-6144-467e-b80f-dd33249cfcca None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:58.221172 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:58.237973 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-51bbd699-6144-467e-b80f-dd33249cfcca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:20:58.237973 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:58.237973 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:58.237973 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:58.237973 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:58.237973 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:58.237973 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:58.237973 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:58.237973 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:58.237973 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:58.237973 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:58.237973 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:58.237973 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:20:58.237973 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:20:58.237973 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:20:58.238897 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:20:58.238897 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:58.238897 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:58.238897 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:58.238897 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:58.238897 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:58.238897 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:58.238897 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:58.238897 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:20:58.238897 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:58.238897 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:58.238897 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:58.238897 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:58.238897 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:58.238897 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:58.238897 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:58.238897 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:58.239809 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:20:58.239809 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:20:58.239809 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:20:58.239809 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:20:58.240016 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08534c67-fbb0-4933-8b22-e6a021b5eb65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:58.240016 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08534c67-fbb0-4933-8b22-e6a021b5eb65 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:58.240016 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08534c67-fbb0-4933-8b22-e6a021b5eb65 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:58.240217 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08534c67-fbb0-4933-8b22-e6a021b5eb65 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:58.241303 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08534c67-fbb0-4933-8b22-e6a021b5eb65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:58.241707 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08534c67-fbb0-4933-8b22-e6a021b5eb65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:58.242052 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 228/461] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:20:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:20:58.245726 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08534c67-fbb0-4933-8b22-e6a021b5eb65 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:58.248197 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bbd699-6144-467e-b80f-dd33249cfcca None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:58.265854 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 234/462] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:20:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:58.269900 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08534c67-fbb0-4933-8b22-e6a021b5eb65 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:58.310892 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:58.379921 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08534c67-fbb0-4933-8b22-e6a021b5eb65 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:58.393387 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bbd699-6144-467e-b80f-dd33249cfcca None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:58.417010 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88168ea4-45a0-45f0-aa81-b5e79dbddb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:58.417852 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88168ea4-45a0-45f0-aa81-b5e79dbddb6d None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:58.418134 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88168ea4-45a0-45f0-aa81-b5e79dbddb6d None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:58.418808 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88168ea4-45a0-45f0-aa81-b5e79dbddb6d None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:58.419777 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88168ea4-45a0-45f0-aa81-b5e79dbddb6d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:58.421851 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88168ea4-45a0-45f0-aa81-b5e79dbddb6d None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:58.429516 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e6e5dd-eb95-4006-9bd2-7259b26666d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:58.430174 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e6e5dd-eb95-4006-9bd2-7259b26666d8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:58.430459 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e6e5dd-eb95-4006-9bd2-7259b26666d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:58.430736 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e6e5dd-eb95-4006-9bd2-7259b26666d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:58.431457 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e6e5dd-eb95-4006-9bd2-7259b26666d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:58.431763 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e6e5dd-eb95-4006-9bd2-7259b26666d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:58.433268 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e6e5dd-eb95-4006-9bd2-7259b26666d8 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:58.445089 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 235/463] 10.222.0.16 () {60 vars in 1132 bytes} [Thu May 26 12:20:58 2022] POST /identity/v3/users => generated 246 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:20:58.446213 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b48bba2-0b7a-4a1d-9c9e-3a109f2e461f None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:58.446505 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b48bba2-0b7a-4a1d-9c9e-3a109f2e461f None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:58.446782 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b48bba2-0b7a-4a1d-9c9e-3a109f2e461f None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:58.452563 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 236/464] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:20:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:58.452563 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaab29f-282f-45a6-8ba4-88a7d4425ce0 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:58.452563 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaab29f-282f-45a6-8ba4-88a7d4425ce0 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:58.452563 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaab29f-282f-45a6-8ba4-88a7d4425ce0 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:58.455751 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 237/465] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:20:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:58.457242 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9de9f7-ed61-4821-84bc-6bf47564bb11 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:58.457534 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9de9f7-ed61-4821-84bc-6bf47564bb11 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:58.457818 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9de9f7-ed61-4821-84bc-6bf47564bb11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:58.462859 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 229/466] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:20:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:20:58.464736 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4dce4-1e3c-4e67-b6f0-a066207d1b5a None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:58.465250 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4dce4-1e3c-4e67-b6f0-a066207d1b5a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:58.465725 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4dce4-1e3c-4e67-b6f0-a066207d1b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:58.480412 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-6a9de9f7-ed61-4821-84bc-6bf47564bb11 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:58.482374 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-6a9de9f7-ed61-4821-84bc-6bf47564bb11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:58.488325 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-9ef4dce4-1e3c-4e67-b6f0-a066207d1b5a None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:58.489926 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9ef4dce4-1e3c-4e67-b6f0-a066207d1b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:58.543811 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:58.568867 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 238/467] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:20:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:20:58.568867 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9de9f7-ed61-4821-84bc-6bf47564bb11 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:58.579266 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 230/468] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:20:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:20:58.593915 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4dce4-1e3c-4e67-b6f0-a066207d1b5a None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:58.616541 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:58.712946 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9de9f7-ed61-4821-84bc-6bf47564bb11 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:58.729205 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4dce4-1e3c-4e67-b6f0-a066207d1b5a None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:58.767457 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce3dfe-90f9-4e1f-b98c-574e14bc0a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:58.768422 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce3dfe-90f9-4e1f-b98c-574e14bc0a5c None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:58.768929 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce3dfe-90f9-4e1f-b98c-574e14bc0a5c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:58.769399 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce3dfe-90f9-4e1f-b98c-574e14bc0a5c None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:58.770278 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfce3dfe-90f9-4e1f-b98c-574e14bc0a5c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:58.771900 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfce3dfe-90f9-4e1f-b98c-574e14bc0a5c None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:58.776435 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee9998-319e-401e-a65e-bed1e7c8c89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:58.777256 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee9998-319e-401e-a65e-bed1e7c8c89b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:58.777537 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee9998-319e-401e-a65e-bed1e7c8c89b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:58.777808 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee9998-319e-401e-a65e-bed1e7c8c89b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:58.789520 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fee9998-319e-401e-a65e-bed1e7c8c89b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:58.791131 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fee9998-319e-401e-a65e-bed1e7c8c89b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:58.795728 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 239/469] 10.222.0.16 () {60 vars in 1132 bytes} [Thu May 26 12:20:58 2022] POST /identity/v3/users => generated 248 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:20:58.797127 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce3dfe-90f9-4e1f-b98c-574e14bc0a5c None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:58.810051 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-8fee9998-319e-401e-a65e-bed1e7c8c89b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:20:58.810051 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:58.810051 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:58.810051 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:58.810051 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:58.810051 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:58.810051 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:58.810051 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:58.810051 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:58.810051 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:58.810051 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:58.810051 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:58.810051 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:20:58.810051 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:20:58.810051 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:20:58.811033 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:20:58.811033 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:58.811033 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:58.811033 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:58.811033 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:58.811033 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:58.811033 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:58.811033 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:58.811033 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:20:58.811033 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:58.811033 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:58.811033 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:58.811033 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:58.811033 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:58.811033 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:58.811033 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:58.811033 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:58.812172 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:20:58.812172 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:20:58.812172 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:20:58.812172 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:20:58.812172 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 231/470] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:20:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:20:58.818093 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee9998-319e-401e-a65e-bed1e7c8c89b None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:58.873456 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:58.929505 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:58.944225 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee9998-319e-401e-a65e-bed1e7c8c89b None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:58.959916 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce3dfe-90f9-4e1f-b98c-574e14bc0a5c None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:58.983682 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39570c52-0d63-4f52-a337-4603c2e5aa1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:58.984866 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39570c52-0d63-4f52-a337-4603c2e5aa1b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:58.985888 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39570c52-0d63-4f52-a337-4603c2e5aa1b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:58.986348 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39570c52-0d63-4f52-a337-4603c2e5aa1b None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:58.987264 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39570c52-0d63-4f52-a337-4603c2e5aa1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:58.987745 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39570c52-0d63-4f52-a337-4603c2e5aa1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:58.989537 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39570c52-0d63-4f52-a337-4603c2e5aa1b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:59.003718 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 232/471] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:20:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:59.009577 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39570c52-0d63-4f52-a337-4603c2e5aa1b None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:59.016567 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75580599-4c3b-4a75-b720-da1e9b7da424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:59.017400 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75580599-4c3b-4a75-b720-da1e9b7da424 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:59.017682 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75580599-4c3b-4a75-b720-da1e9b7da424 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:59.017957 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75580599-4c3b-4a75-b720-da1e9b7da424 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:59.032864 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75580599-4c3b-4a75-b720-da1e9b7da424 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:59.034382 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75580599-4c3b-4a75-b720-da1e9b7da424 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:59.074767 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-75580599-4c3b-4a75-b720-da1e9b7da424 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:20:59.074767 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:59.074767 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:59.074767 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:59.074767 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:59.074767 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:59.074767 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:59.074767 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:59.074767 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:59.074767 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:59.074767 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:59.074767 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:59.074767 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:20:59.074767 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:20:59.074767 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:20:59.075747 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:20:59.075747 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:59.075747 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:59.075747 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:59.075747 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:59.075747 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:59.075747 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:59.075747 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:59.075747 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:20:59.075747 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:59.075747 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:59.075747 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:59.075747 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:59.075747 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:59.075747 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:59.075747 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:59.075747 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:59.076587 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:20:59.076587 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:20:59.076587 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:20:59.076587 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:20:59.079558 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 240/472] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:20:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:20:59.087218 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75580599-4c3b-4a75-b720-da1e9b7da424 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:59.171194 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:59.176871 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39570c52-0d63-4f52-a337-4603c2e5aa1b None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:59.212081 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75580599-4c3b-4a75-b720-da1e9b7da424 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:59.218898 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2596bad-f26b-4287-83d4-da50282a739f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:59.220114 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2596bad-f26b-4287-83d4-da50282a739f None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:59.220399 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2596bad-f26b-4287-83d4-da50282a739f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:59.220676 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2596bad-f26b-4287-83d4-da50282a739f None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:59.222143 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2596bad-f26b-4287-83d4-da50282a739f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:59.224118 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2596bad-f26b-4287-83d4-da50282a739f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:59.252073 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 233/473] 10.222.0.16 () {60 vars in 1132 bytes} [Thu May 26 12:20:59 2022] POST /identity/v3/users => generated 249 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:20:59.269229 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:59.271893 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f921fe1-a4fd-4f4c-a76b-00fba7438a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:59.272594 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f921fe1-a4fd-4f4c-a76b-00fba7438a15 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:59.272962 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f921fe1-a4fd-4f4c-a76b-00fba7438a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:59.273294 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f921fe1-a4fd-4f4c-a76b-00fba7438a15 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:59.274057 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f921fe1-a4fd-4f4c-a76b-00fba7438a15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:59.274414 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f921fe1-a4fd-4f4c-a76b-00fba7438a15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:59.275927 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f921fe1-a4fd-4f4c-a76b-00fba7438a15 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:59.295475 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 241/474] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:20:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:59.297056 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2596bad-f26b-4287-83d4-da50282a739f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:59.308631 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4211d1-78e8-40db-b1d1-6490a179031f None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:59.308949 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4211d1-78e8-40db-b1d1-6490a179031f None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:59.309228 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4211d1-78e8-40db-b1d1-6490a179031f None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:59.310978 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 242/475] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:20:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:59.319414 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e329e85-d75c-4733-90bd-3c3303f103bc None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:59.319942 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e329e85-d75c-4733-90bd-3c3303f103bc None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:59.320322 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e329e85-d75c-4733-90bd-3c3303f103bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:59.339311 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-5e329e85-d75c-4733-90bd-3c3303f103bc None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:59.340644 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-5e329e85-d75c-4733-90bd-3c3303f103bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:59.425347 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 243/476] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:20:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:20:59.433177 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2596bad-f26b-4287-83d4-da50282a739f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:59.449213 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e329e85-d75c-4733-90bd-3c3303f103bc None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:59.474262 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d55aa8-6830-427f-8708-e8545f6de95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:59.474262 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d55aa8-6830-427f-8708-e8545f6de95c None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:59.474262 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d55aa8-6830-427f-8708-e8545f6de95c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:59.474262 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d55aa8-6830-427f-8708-e8545f6de95c None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:59.474932 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d55aa8-6830-427f-8708-e8545f6de95c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:59.476992 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d55aa8-6830-427f-8708-e8545f6de95c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:59.509139 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 234/477] 10.222.0.16 () {60 vars in 1132 bytes} [Thu May 26 12:20:59 2022] POST /identity/v3/users => generated 248 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:20:59.565022 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e329e85-d75c-4733-90bd-3c3303f103bc None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:59.593014 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:59.607160 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92efce14-eb59-427b-a7da-370e8f85f884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:59.607892 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92efce14-eb59-427b-a7da-370e8f85f884 None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:59.608175 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92efce14-eb59-427b-a7da-370e8f85f884 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:59.608503 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92efce14-eb59-427b-a7da-370e8f85f884 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:59.609297 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92efce14-eb59-427b-a7da-370e8f85f884 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:59.611268 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92efce14-eb59-427b-a7da-370e8f85f884 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:59.617934 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.sql.core [None req-92efce14-eb59-427b-a7da-370e8f85f884 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 26 12:20:59.617934 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 26 12:20:59.617934 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [parameters: {'id': '571ead97c09042aab5573ba43756823a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 26 12:20:59.617934 dv-cinder-815146-11-smb devstack@keystone.service[80180]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80180) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 26 12:20:59.635393 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-92efce14-eb59-427b-a7da-370e8f85f884 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 26 12:20:59.635393 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:59.635393 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 12:20:59.635393 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 12:20:59.635393 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 12:20:59.635393 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 12:20:59.635393 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 12:20:59.635393 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application result = self._query(query) May 26 12:20:59.635393 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 12:20:59.635393 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application conn.query(q) May 26 12:20:59.635393 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 12:20:59.635393 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 12:20:59.635393 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 12:20:59.635393 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application result.read() May 26 12:20:59.635393 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 12:20:59.637424 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 12:20:59.637424 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 12:20:59.637424 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 12:20:59.637424 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 12:20:59.637424 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 12:20:59.637424 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 12:20:59.637424 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 12:20:59.637424 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 26 12:20:59.637424 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:20:59.637424 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 26 12:20:59.637424 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:20:59.637424 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:59.637424 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 26 12:20:59.637424 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 26 12:20:59.637424 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 26 12:20:59.637424 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return ref.to_dict() May 26 12:20:59.637424 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 12:20:59.637424 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application next(self.gen) May 26 12:20:59.639565 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 26 12:20:59.639565 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application yield resource May 26 12:20:59.639565 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 12:20:59.639565 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application next(self.gen) May 26 12:20:59.639565 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 26 12:20:59.639565 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self.session.rollback() May 26 12:20:59.639565 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 26 12:20:59.639565 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self.force_reraise() May 26 12:20:59.639565 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 26 12:20:59.639565 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise self.value May 26 12:20:59.639565 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 26 12:20:59.639565 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 26 12:20:59.639565 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 26 12:20:59.639565 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application session.commit() May 26 12:20:59.639565 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 26 12:20:59.639565 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 26 12:20:59.639565 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 26 12:20:59.641686 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._prepare_impl() May 26 12:20:59.641686 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 26 12:20:59.641686 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self.session.flush() May 26 12:20:59.641686 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 26 12:20:59.641686 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._flush(objects) May 26 12:20:59.641686 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 26 12:20:59.641686 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 26 12:20:59.641686 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 26 12:20:59.641686 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application compat.raise_( May 26 12:20:59.641686 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 12:20:59.641686 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception May 26 12:20:59.641686 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 26 12:20:59.641686 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application flush_context.execute() May 26 12:20:59.641686 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 26 12:20:59.641686 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rec.execute(self) May 26 12:20:59.641686 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 26 12:20:59.641686 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 26 12:20:59.643684 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 26 12:20:59.643684 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application _emit_insert_statements( May 26 12:20:59.643684 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 26 12:20:59.643684 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application c = connection._execute_20( May 26 12:20:59.643684 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 26 12:20:59.643684 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 26 12:20:59.643684 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 26 12:20:59.643684 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 26 12:20:59.643684 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 26 12:20:59.643684 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ret = self._execute_context( May 26 12:20:59.643684 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 26 12:20:59.643684 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 26 12:20:59.643684 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 26 12:20:59.643684 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 26 12:20:59.643684 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 12:20:59.643684 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception May 26 12:20:59.645644 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 12:20:59.645644 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 12:20:59.645644 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 12:20:59.645644 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 12:20:59.645644 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 12:20:59.645644 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application result = self._query(query) May 26 12:20:59.645644 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 12:20:59.645644 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application conn.query(q) May 26 12:20:59.645644 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 12:20:59.645644 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 12:20:59.645644 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 12:20:59.645644 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application result.read() May 26 12:20:59.645644 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 12:20:59.645644 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 12:20:59.645644 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 12:20:59.645644 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 12:20:59.655175 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 12:20:59.655175 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 12:20:59.655175 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 12:20:59.655175 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 12:20:59.655175 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 26 12:20:59.655175 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 26 12:20:59.655175 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [parameters: {'id': '571ead97c09042aab5573ba43756823a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 26 12:20:59.655175 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 26 12:20:59.655175 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:20:59.655175 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:20:59.655175 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:20:59.655175 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:59.655175 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:59.655175 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:59.655175 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:59.655175 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:59.657199 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:59.657199 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:59.657199 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:59.657199 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:59.657199 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:59.657199 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:59.657199 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 26 12:20:59.657199 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 26 12:20:59.657199 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:59.657199 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:59.657199 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 26 12:20:59.657199 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 26 12:20:59.657199 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 26 12:20:59.657199 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 26 12:20:59.657199 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 26 12:20:59.657199 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:20:59.659113 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 244/478] 10.222.0.16 () {60 vars in 1131 bytes} [Thu May 26 12:20:59 2022] POST /identity/v3/roles => generated 144 bytes in 188 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 26 12:20:59.659246 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d55aa8-6830-427f-8708-e8545f6de95c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:59.661736 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:59.765079 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d55aa8-6830-427f-8708-e8545f6de95c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:59.803115 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919565fe-c09a-4f58-88ab-61914221da98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:59.803929 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919565fe-c09a-4f58-88ab-61914221da98 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:59.804214 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919565fe-c09a-4f58-88ab-61914221da98 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:59.804490 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919565fe-c09a-4f58-88ab-61914221da98 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:59.816061 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919565fe-c09a-4f58-88ab-61914221da98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:20:59.824172 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-919565fe-c09a-4f58-88ab-61914221da98 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:20:59.824172 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:59.824172 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:59.824172 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:59.824172 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:59.824172 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:59.824172 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:59.824172 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:59.824172 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:59.824172 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:59.824172 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:59.824172 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:59.824172 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:20:59.824172 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:20:59.824172 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:20:59.824172 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:20:59.825114 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:20:59.825114 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:20:59.825114 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:20:59.825114 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:20:59.825114 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:59.825114 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:59.825114 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:59.825114 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:59.825114 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:59.825114 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:59.825114 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:59.825114 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:20:59.825114 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:59.825114 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:59.825114 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:59.825114 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:59.825924 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:59.825924 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:59.825924 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:59.825924 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:59.825924 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:20:59.825924 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:20:59.825924 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:20:59.825924 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:20:59.825924 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:20:59.825924 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:20:59.825924 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:20:59.825924 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:20:59.825924 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 235/479] 10.222.0.16 () {56 vars in 1114 bytes} [Thu May 26 12:20:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:20:59.832696 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92efce14-eb59-427b-a7da-370e8f85f884 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:59.947499 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92efce14-eb59-427b-a7da-370e8f85f884 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:59.987404 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6e0db-bd3e-40eb-9cff-7e49c973a535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:59.988072 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6e0db-bd3e-40eb-9cff-7e49c973a535 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:59.988352 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6e0db-bd3e-40eb-9cff-7e49c973a535 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:59.988625 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6e0db-bd3e-40eb-9cff-7e49c973a535 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:59.989410 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee6e0db-bd3e-40eb-9cff-7e49c973a535 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:59.989716 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee6e0db-bd3e-40eb-9cff-7e49c973a535 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:59.991088 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee6e0db-bd3e-40eb-9cff-7e49c973a535 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:00.003234 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 245/480] 10.222.0.16 () {56 vars in 1111 bytes} [Thu May 26 12:20:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:21:01.181375 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a458f-569f-4456-8d1e-71d8d90ef8c5 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:01.181854 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a458f-569f-4456-8d1e-71d8d90ef8c5 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:01.181854 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a458f-569f-4456-8d1e-71d8d90ef8c5 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:01.183495 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 236/481] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:21:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:21:01.188653 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c5aa4-3b51-4c23-8b09-5e530f570280 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:01.189099 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c5aa4-3b51-4c23-8b09-5e530f570280 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:01.189406 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c5aa4-3b51-4c23-8b09-5e530f570280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:01.210187 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-947c5aa4-3b51-4c23-8b09-5e530f570280 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:21:01.211378 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-947c5aa4-3b51-4c23-8b09-5e530f570280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:21:01.268500 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:01.300776 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 246/482] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:21:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:21:01.335473 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a458f-569f-4456-8d1e-71d8d90ef8c5 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:01.425996 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:01.471990 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a458f-569f-4456-8d1e-71d8d90ef8c5 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:01.517986 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3efc71-d4d6-48fa-b64e-6473664e6a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:01.518784 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3efc71-d4d6-48fa-b64e-6473664e6a92 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:01.519071 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3efc71-d4d6-48fa-b64e-6473664e6a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:01.519349 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3efc71-d4d6-48fa-b64e-6473664e6a92 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:01.537672 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3efc71-d4d6-48fa-b64e-6473664e6a92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:21:01.545430 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-cd3efc71-d4d6-48fa-b64e-6473664e6a92 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:21:01.545430 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:01.545430 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:01.545430 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:01.545430 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:01.545430 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:01.545430 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:01.545430 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:01.545430 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:01.545430 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:01.545430 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:01.545430 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:01.545430 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:21:01.545430 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:21:01.545430 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:21:01.545430 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:21:01.546314 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:21:01.546314 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:21:01.546314 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:21:01.546314 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:21:01.546314 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:01.546314 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:01.546314 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:01.546314 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:01.546314 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:01.546314 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:01.546314 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:01.546314 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:01.546314 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:01.546314 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:01.546314 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:01.546314 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:01.547106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:01.547106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:01.547106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:01.547106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:01.547106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:21:01.547106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:21:01.547106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:21:01.547106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:21:01.547106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:21:01.547106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:21:01.547106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:21:01.547106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:01.547106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 237/483] 10.222.0.16 () {56 vars in 1102 bytes} [Thu May 26 12:21:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:01.552518 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c5aa4-3b51-4c23-8b09-5e530f570280 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:01.716741 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c5aa4-3b51-4c23-8b09-5e530f570280 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:01.760955 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cb4986-e486-449d-9211-d3a01ee5a68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:01.760955 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb4986-e486-449d-9211-d3a01ee5a68a None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:01.760955 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb4986-e486-449d-9211-d3a01ee5a68a None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:01.760955 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb4986-e486-449d-9211-d3a01ee5a68a None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:01.761338 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cb4986-e486-449d-9211-d3a01ee5a68a None admin] RBAC: Adding query filter params (name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:01.761338 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cb4986-e486-449d-9211-d3a01ee5a68a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:01.761338 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cb4986-e486-449d-9211-d3a01ee5a68a None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:01.766459 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 247/484] 10.222.0.16 () {56 vars in 1103 bytes} [Thu May 26 12:21:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:01.771500 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3efc71-d4d6-48fa-b64e-6473664e6a92 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:01.886299 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d965dbe-d13f-40d3-ad3a-001efb2fc2ac None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:01.886639 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d965dbe-d13f-40d3-ad3a-001efb2fc2ac None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:01.886864 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d965dbe-d13f-40d3-ad3a-001efb2fc2ac None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:01.888493 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 248/485] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:21:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:21:01.888791 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3efc71-d4d6-48fa-b64e-6473664e6a92 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:01.893734 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef4c85-f280-43eb-9124-4cbe39295177 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:01.894025 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef4c85-f280-43eb-9124-4cbe39295177 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:01.894303 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef4c85-f280-43eb-9124-4cbe39295177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:01.911451 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-35ef4c85-f280-43eb-9124-4cbe39295177 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:21:01.912656 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-35ef4c85-f280-43eb-9124-4cbe39295177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:21:01.943224 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:01.949545 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:01.954174 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eaae6a-4f40-460c-ae4a-830b661283ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:01.954969 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eaae6a-4f40-460c-ae4a-830b661283ae None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:01.955251 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eaae6a-4f40-460c-ae4a-830b661283ae None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:01.955525 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eaae6a-4f40-460c-ae4a-830b661283ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:01.974905 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eaae6a-4f40-460c-ae4a-830b661283ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:01.976389 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eaae6a-4f40-460c-ae4a-830b661283ae None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:01.988283 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 249/486] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:21:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:21:02.009571 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-23eaae6a-4f40-460c-ae4a-830b661283ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:02.009571 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:02.009571 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:02.009571 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:02.009571 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:02.009571 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:02.009571 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:02.009571 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:02.009571 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:02.009571 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:02.009571 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:02.009571 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:02.009571 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:21:02.009571 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:21:02.009571 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:21:02.010474 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:21:02.010474 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:02.010474 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:02.010474 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:02.010474 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:02.010474 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:02.010474 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:02.010474 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:02.010474 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:02.010474 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:02.010474 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:02.010474 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:02.010474 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:02.010474 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:02.010474 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:02.010474 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:02.010474 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:02.012104 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:21:02.012104 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:21:02.012104 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:02.012104 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:02.012104 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 238/487] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:21:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:02.013129 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ef4c85-f280-43eb-9124-4cbe39295177 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:02.015970 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eaae6a-4f40-460c-ae4a-830b661283ae None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:02.116030 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eaae6a-4f40-460c-ae4a-830b661283ae None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:02.119552 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ef4c85-f280-43eb-9124-4cbe39295177 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:02.148956 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38145a98-d382-4e24-a976-34d63130fe05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:02.149683 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38145a98-d382-4e24-a976-34d63130fe05 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:02.149976 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38145a98-d382-4e24-a976-34d63130fe05 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:02.150250 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38145a98-d382-4e24-a976-34d63130fe05 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:02.150969 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38145a98-d382-4e24-a976-34d63130fe05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:02.151269 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38145a98-d382-4e24-a976-34d63130fe05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:02.152755 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38145a98-d382-4e24-a976-34d63130fe05 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:02.155997 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a69f4-85de-420f-95f4-d7609ca80aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:02.157508 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a69f4-85de-420f-95f4-d7609ca80aae None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:02.157896 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a69f4-85de-420f-95f4-d7609ca80aae None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:02.158268 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a69f4-85de-420f-95f4-d7609ca80aae None admin] PATH_INFO: `/v3/roles/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:02.166334 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 239/488] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:21:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:21:02.169785 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4a69f4-85de-420f-95f4-d7609ca80aae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:21:02.171581 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38145a98-d382-4e24-a976-34d63130fe05 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:02.178557 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-6a4a69f4-85de-420f-95f4-d7609ca80aae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:21:02.178557 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:02.178557 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:02.178557 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:02.178557 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:02.178557 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:02.178557 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:02.178557 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:02.178557 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:02.178557 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:02.178557 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:02.178557 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:02.178557 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:21:02.178557 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:21:02.178557 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:21:02.178557 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:21:02.180319 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:21:02.180319 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:21:02.180319 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:21:02.180319 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:21:02.180319 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:02.180319 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:02.180319 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:02.180319 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:02.180319 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:02.180319 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:02.180319 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:02.180319 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:02.180319 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:02.180319 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:02.180319 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:02.180319 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:02.181714 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:02.181714 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:02.181714 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:02.181714 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:02.181714 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:21:02.181714 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:21:02.181714 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:21:02.181714 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:21:02.181714 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:21:02.181714 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:21:02.181714 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:21:02.181714 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:02.181714 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 250/489] 10.222.0.16 () {56 vars in 1102 bytes} [Thu May 26 12:21:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:02.186907 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a69f4-85de-420f-95f4-d7609ca80aae None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:02.217482 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:02.220781 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:02.274225 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38145a98-d382-4e24-a976-34d63130fe05 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:02.296918 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a69f4-85de-420f-95f4-d7609ca80aae None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:02.309281 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f2268-a739-402b-9574-731032a6b193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:02.310197 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f2268-a739-402b-9574-731032a6b193 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:02.310577 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f2268-a739-402b-9574-731032a6b193 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:02.310947 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f2268-a739-402b-9574-731032a6b193 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:02.318558 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5f2268-a739-402b-9574-731032a6b193 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:02.320133 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5f2268-a739-402b-9574-731032a6b193 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:02.338308 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-6b5f2268-a739-402b-9574-731032a6b193 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 12:21:02.338308 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:02.338308 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:02.338308 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:02.338308 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:02.338308 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:02.338308 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:02.338308 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:02.338308 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:02.338308 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:02.338308 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:02.338308 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:02.338308 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:21:02.338308 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:21:02.338308 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:21:02.338308 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:21:02.340483 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:02.340483 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:02.340483 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:21:02.340483 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:21:02.340483 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:21:02.340483 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:21:02.340483 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:02.340483 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:02.340483 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:02.340483 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:02.340483 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:02.340483 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:02.340483 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:02.340483 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:02.340483 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:02.340483 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:02.340483 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:02.340483 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:02.343086 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:02.343086 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:02.343086 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:21:02.343086 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:21:02.343086 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:21:02.343086 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:21:02.343086 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:21:02.343086 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:21:02.343086 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 12:21:02.343086 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:02.343086 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 240/490] 10.222.0.16 () {56 vars in 1093 bytes} [Thu May 26 12:21:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:02.352946 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f2268-a739-402b-9574-731032a6b193 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:02.353213 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc05f96-3be4-4221-b699-00edb85a0501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:02.353213 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc05f96-3be4-4221-b699-00edb85a0501 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:02.353213 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc05f96-3be4-4221-b699-00edb85a0501 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:02.353213 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc05f96-3be4-4221-b699-00edb85a0501 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:02.353795 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc05f96-3be4-4221-b699-00edb85a0501 None admin] RBAC: Adding query filter params (name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:02.353795 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc05f96-3be4-4221-b699-00edb85a0501 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:02.354658 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc05f96-3be4-4221-b699-00edb85a0501 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:02.375192 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 251/491] 10.222.0.16 () {56 vars in 1103 bytes} [Thu May 26 12:21:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:02.379973 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc05f96-3be4-4221-b699-00edb85a0501 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:02.532115 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:02.550563 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc05f96-3be4-4221-b699-00edb85a0501 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:02.571500 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f2268-a739-402b-9574-731032a6b193 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:02.573060 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:02.593954 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c728c6-336d-4faa-a75a-5b1eb34c985d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:02.595118 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c728c6-336d-4faa-a75a-5b1eb34c985d None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:02.595601 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c728c6-336d-4faa-a75a-5b1eb34c985d None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:02.596126 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c728c6-336d-4faa-a75a-5b1eb34c985d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:02.608043 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c728c6-336d-4faa-a75a-5b1eb34c985d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:02.609534 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c728c6-336d-4faa-a75a-5b1eb34c985d None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:02.611429 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f878d2ff-97a0-41c3-8617-9d2d3b86890d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:02.612101 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878d2ff-97a0-41c3-8617-9d2d3b86890d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:02.612386 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878d2ff-97a0-41c3-8617-9d2d3b86890d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:02.612818 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878d2ff-97a0-41c3-8617-9d2d3b86890d None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:02.613595 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f878d2ff-97a0-41c3-8617-9d2d3b86890d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:02.613908 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f878d2ff-97a0-41c3-8617-9d2d3b86890d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:02.615408 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f878d2ff-97a0-41c3-8617-9d2d3b86890d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:02.627965 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-35c728c6-336d-4faa-a75a-5b1eb34c985d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:02.627965 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:02.627965 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:02.627965 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:02.627965 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:02.627965 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:02.627965 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:02.627965 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:02.627965 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:02.627965 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:02.627965 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:02.627965 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:02.627965 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:21:02.627965 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:21:02.627965 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:21:02.628816 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:21:02.628816 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:02.628816 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:02.628816 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:02.628816 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:02.628816 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:02.628816 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:02.628816 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:02.628816 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:02.628816 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:02.628816 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:02.628816 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:02.628816 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:02.628816 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:02.628816 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:02.628816 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:02.628816 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:02.629920 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:21:02.629920 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:21:02.629920 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:02.629920 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:02.629920 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 252/492] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:21:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:02.630822 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a8247-f22d-443e-8d3a-6952cbffad8d None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:02.631108 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a8247-f22d-443e-8d3a-6952cbffad8d None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:02.631382 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a8247-f22d-443e-8d3a-6952cbffad8d None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:02.634004 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 253/493] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:21:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:21:02.635460 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348edb23-3e16-4859-9de4-d714fa5cef55 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:02.635743 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348edb23-3e16-4859-9de4-d714fa5cef55 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:02.636013 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348edb23-3e16-4859-9de4-d714fa5cef55 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:02.637281 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 254/494] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:21:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:21:02.641766 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348edb23-3e16-4859-9de4-d714fa5cef55 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:02.662768 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 241/495] 10.222.0.16 () {56 vars in 1133 bytes} [Thu May 26 12:21:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:02.662768 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8823585-df0e-4f7d-9f57-785b4d783cf1 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:02.662768 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8823585-df0e-4f7d-9f57-785b4d783cf1 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:02.662768 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8823585-df0e-4f7d-9f57-785b4d783cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:02.680471 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d8823585-df0e-4f7d-9f57-785b4d783cf1 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:21:02.681712 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d8823585-df0e-4f7d-9f57-785b4d783cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:21:02.756275 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348edb23-3e16-4859-9de4-d714fa5cef55 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:02.762591 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 242/496] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:21:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:21:02.764072 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8623048-e938-4718-bbd6-b16925bc1b23 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:02.764544 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8623048-e938-4718-bbd6-b16925bc1b23 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:02.765033 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8623048-e938-4718-bbd6-b16925bc1b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:02.784473 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-e8623048-e938-4718-bbd6-b16925bc1b23 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:21:02.786540 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e8623048-e938-4718-bbd6-b16925bc1b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:21:02.804452 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127ab0fa-5118-4a2d-a478-0696a6b0f3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:02.805406 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ab0fa-5118-4a2d-a478-0696a6b0f3c6 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:02.805872 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ab0fa-5118-4a2d-a478-0696a6b0f3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:02.806357 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ab0fa-5118-4a2d-a478-0696a6b0f3c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:02.807256 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127ab0fa-5118-4a2d-a478-0696a6b0f3c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:02.807741 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127ab0fa-5118-4a2d-a478-0696a6b0f3c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:02.809351 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127ab0fa-5118-4a2d-a478-0696a6b0f3c6 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:02.826798 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 255/497] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:21:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:02.827895 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127ab0fa-5118-4a2d-a478-0696a6b0f3c6 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:02.833232 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:02.857202 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 243/498] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:21:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:21:02.857955 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8623048-e938-4718-bbd6-b16925bc1b23 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:02.887304 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:02.937020 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127ab0fa-5118-4a2d-a478-0696a6b0f3c6 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:02.966316 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8623048-e938-4718-bbd6-b16925bc1b23 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:02.972217 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5964ee4-4e54-4cb4-8f6e-4be3d71add84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:02.972889 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5964ee4-4e54-4cb4-8f6e-4be3d71add84 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:02.973178 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5964ee4-4e54-4cb4-8f6e-4be3d71add84 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:02.973834 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5964ee4-4e54-4cb4-8f6e-4be3d71add84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:02.998514 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b72d4-e501-4f84-a469-6b7da3cced1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:02.999296 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b72d4-e501-4f84-a469-6b7da3cced1c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:02.999577 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b72d4-e501-4f84-a469-6b7da3cced1c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:02.999842 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b72d4-e501-4f84-a469-6b7da3cced1c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:03.010304 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2b72d4-e501-4f84-a469-6b7da3cced1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:21:03.018401 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-cd2b72d4-e501-4f84-a469-6b7da3cced1c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:21:03.018401 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:03.018401 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:03.018401 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:03.018401 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:03.018401 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:03.018401 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:03.018401 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:03.018401 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:03.018401 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:03.018401 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:03.018401 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:03.018401 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:21:03.018401 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:21:03.018401 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:21:03.018401 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:21:03.019400 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:21:03.019400 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:21:03.019400 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:21:03.019400 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:21:03.019400 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:03.019400 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:03.019400 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:03.019400 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:03.019400 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:03.019400 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:03.019400 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:03.019400 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:03.019400 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:03.019400 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:03.019400 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:03.019400 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:03.020222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:03.020222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:03.020222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:03.020222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:03.020222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:21:03.020222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:21:03.020222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:21:03.020222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:21:03.020222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:21:03.020222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:21:03.020222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:21:03.020222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:03.020222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 244/499] 10.222.0.16 () {56 vars in 1102 bytes} [Thu May 26 12:21:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:03.020910 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b72d4-e501-4f84-a469-6b7da3cced1c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:03.046775 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5964ee4-4e54-4cb4-8f6e-4be3d71add84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:03.048208 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5964ee4-4e54-4cb4-8f6e-4be3d71add84 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:03.050861 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:03.099918 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:03.119360 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b72d4-e501-4f84-a469-6b7da3cced1c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:03.145193 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 256/500] 10.222.0.16 () {58 vars in 1282 bytes} [Thu May 26 12:21:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:21:03.146029 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5964ee4-4e54-4cb4-8f6e-4be3d71add84 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:03.155934 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d58431-f6f1-4c14-8c52-8a160a571ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:03.156730 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d58431-f6f1-4c14-8c52-8a160a571ac4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:03.157729 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d58431-f6f1-4c14-8c52-8a160a571ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:03.158026 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d58431-f6f1-4c14-8c52-8a160a571ac4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:03.165465 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d58431-f6f1-4c14-8c52-8a160a571ac4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:03.166940 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d58431-f6f1-4c14-8c52-8a160a571ac4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:03.181095 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-c6d58431-f6f1-4c14-8c52-8a160a571ac4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 26 12:21:03.181095 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:03.181095 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:03.181095 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:03.181095 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:03.181095 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:03.181095 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:03.181095 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:03.181095 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:03.181095 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:03.181095 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:03.181095 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:03.181095 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:21:03.181095 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:21:03.181095 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:21:03.181095 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:21:03.182111 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:03.182111 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:03.182111 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:21:03.182111 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:21:03.182111 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:21:03.182111 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:21:03.182111 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:03.182111 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:03.182111 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:03.182111 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:03.182111 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:03.182111 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:03.182111 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:03.182111 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:03.182111 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:03.182111 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:03.182111 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:03.182111 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:03.183015 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:03.183015 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:03.183015 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:21:03.183015 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:21:03.183015 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:21:03.183015 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:21:03.183015 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:21:03.183015 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:21:03.183015 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 26 12:21:03.183015 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:03.183015 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 245/501] 10.222.0.16 () {56 vars in 1099 bytes} [Thu May 26 12:21:03 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:03.183862 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd4f14-0728-4603-a0cb-8df7081f2e17 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:03.183862 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd4f14-0728-4603-a0cb-8df7081f2e17 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:03.183989 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd4f14-0728-4603-a0cb-8df7081f2e17 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:03.185387 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 246/502] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:21:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:21:03.185853 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd4f14-0728-4603-a0cb-8df7081f2e17 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:03.244579 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5964ee4-4e54-4cb4-8f6e-4be3d71add84 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:03.247005 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:03.280638 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e1850-7c0f-4bdb-a374-16226c20b660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:03.281447 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e1850-7c0f-4bdb-a374-16226c20b660 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:03.281726 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e1850-7c0f-4bdb-a374-16226c20b660 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:03.282604 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e1850-7c0f-4bdb-a374-16226c20b660 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:03.290007 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd4f14-0728-4603-a0cb-8df7081f2e17 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:03.294068 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178e1850-7c0f-4bdb-a374-16226c20b660 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:21:03.301830 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-178e1850-7c0f-4bdb-a374-16226c20b660 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:21:03.301830 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:03.301830 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:03.301830 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:03.301830 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:03.301830 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:03.301830 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:03.301830 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:03.301830 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:03.301830 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:03.301830 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:03.301830 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:03.301830 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:21:03.301830 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:21:03.301830 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:21:03.301830 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:21:03.302746 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:21:03.302746 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:21:03.302746 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:21:03.302746 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:21:03.302746 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:03.302746 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:03.302746 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:03.302746 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:03.302746 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:03.302746 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:03.302746 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:03.302746 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:03.302746 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:03.302746 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:03.302746 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:03.302746 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:03.303532 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:03.303532 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:03.303532 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:03.303532 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:03.303532 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:21:03.303532 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:21:03.303532 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:21:03.303532 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:21:03.303532 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:21:03.303532 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:21:03.303532 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:21:03.303532 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:03.304995 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 257/503] 10.222.0.16 () {56 vars in 1102 bytes} [Thu May 26 12:21:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:03.306081 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e1850-7c0f-4bdb-a374-16226c20b660 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:03.324313 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd058dd-b5d0-43fb-8546-426e8dfee04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:03.325006 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd058dd-b5d0-43fb-8546-426e8dfee04d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:03.325284 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd058dd-b5d0-43fb-8546-426e8dfee04d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:03.325554 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd058dd-b5d0-43fb-8546-426e8dfee04d None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:03.326290 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd058dd-b5d0-43fb-8546-426e8dfee04d None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:03.326594 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd058dd-b5d0-43fb-8546-426e8dfee04d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:03.327984 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd058dd-b5d0-43fb-8546-426e8dfee04d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:03.336228 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 247/504] 10.222.0.16 () {56 vars in 1103 bytes} [Thu May 26 12:21:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:03.337014 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd058dd-b5d0-43fb-8546-426e8dfee04d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:03.339614 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:03.406245 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e1850-7c0f-4bdb-a374-16226c20b660 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:03.440252 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd058dd-b5d0-43fb-8546-426e8dfee04d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:03.441836 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d9b143-8916-4fb5-b2ac-e471c1b5f71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:03.442642 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d9b143-8916-4fb5-b2ac-e471c1b5f71e None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:03.442933 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d9b143-8916-4fb5-b2ac-e471c1b5f71e None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:03.443199 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d9b143-8916-4fb5-b2ac-e471c1b5f71e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:03.459625 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d9b143-8916-4fb5-b2ac-e471c1b5f71e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:03.461489 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d9b143-8916-4fb5-b2ac-e471c1b5f71e None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:03.491007 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e688e6c2-b84f-479c-9cd8-874224140726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:03.491581 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-b1d9b143-8916-4fb5-b2ac-e471c1b5f71e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:03.491581 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:03.491581 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:03.491581 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:03.491581 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:03.491581 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:03.491581 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:03.491581 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:03.491581 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:03.491581 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:03.491581 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:03.491581 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:03.491581 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:21:03.491581 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:21:03.491581 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:21:03.492540 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:21:03.492540 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:03.492540 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:03.492540 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:03.492540 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:03.492540 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:03.492540 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:03.492540 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:03.492540 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:03.492540 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:03.492540 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:03.492540 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:03.492540 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:03.492540 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:03.492540 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:03.492540 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:03.492540 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:03.493610 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:21:03.493610 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:21:03.493610 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:03.493610 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:03.493893 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688e6c2-b84f-479c-9cd8-874224140726 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:03.493893 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688e6c2-b84f-479c-9cd8-874224140726 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:03.493893 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688e6c2-b84f-479c-9cd8-874224140726 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:03.494249 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 258/505] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:21:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:03.495722 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbbbc79-7ae0-402f-952a-cf4d0941ee78 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:03.496202 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbbbc79-7ae0-402f-952a-cf4d0941ee78 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:03.496686 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbbbc79-7ae0-402f-952a-cf4d0941ee78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:03.501988 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e688e6c2-b84f-479c-9cd8-874224140726 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:03.502319 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e688e6c2-b84f-479c-9cd8-874224140726 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:03.503864 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e688e6c2-b84f-479c-9cd8-874224140726 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:03.516514 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-8cbbbc79-7ae0-402f-952a-cf4d0941ee78 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:21:03.517770 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-8cbbbc79-7ae0-402f-952a-cf4d0941ee78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:21:03.526430 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 248/506] 10.222.0.16 () {56 vars in 1137 bytes} [Thu May 26 12:21:03 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:03.527282 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e688e6c2-b84f-479c-9cd8-874224140726 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:03.532877 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:03.585409 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:03.589418 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 259/507] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:21:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:21:03.590248 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbbbc79-7ae0-402f-952a-cf4d0941ee78 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:03.640281 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e688e6c2-b84f-479c-9cd8-874224140726 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:03.677781 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919be52c-f1ac-40c6-acef-28eebc0a1128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:03.678453 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919be52c-f1ac-40c6-acef-28eebc0a1128 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:03.678735 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919be52c-f1ac-40c6-acef-28eebc0a1128 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:03.679113 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919be52c-f1ac-40c6-acef-28eebc0a1128 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:03.679753 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919be52c-f1ac-40c6-acef-28eebc0a1128 None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:03.680059 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919be52c-f1ac-40c6-acef-28eebc0a1128 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:03.681484 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919be52c-f1ac-40c6-acef-28eebc0a1128 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:03.689710 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 249/508] 10.222.0.16 () {56 vars in 1103 bytes} [Thu May 26 12:21:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:03.690531 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919be52c-f1ac-40c6-acef-28eebc0a1128 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:03.704985 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbbbc79-7ae0-402f-952a-cf4d0941ee78 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:03.744073 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc006a-3360-499a-bfe3-a5d6d8c2337a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:03.744888 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc006a-3360-499a-bfe3-a5d6d8c2337a None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:03.745161 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc006a-3360-499a-bfe3-a5d6d8c2337a None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:03.745512 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc006a-3360-499a-bfe3-a5d6d8c2337a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:03.758862 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc006a-3360-499a-bfe3-a5d6d8c2337a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:03.760317 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc006a-3360-499a-bfe3-a5d6d8c2337a None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:03.767105 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:03.779406 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-42fc006a-3360-499a-bfe3-a5d6d8c2337a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:03.779406 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:03.779406 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:03.779406 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:03.779406 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:03.779406 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:03.779406 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:03.779406 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:03.779406 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:03.779406 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:03.779406 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:03.779406 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:03.779406 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:21:03.779406 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:21:03.779406 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:21:03.780267 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:21:03.780267 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:03.780267 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:03.780267 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:03.780267 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:03.780267 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:03.780267 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:03.780267 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:03.780267 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:03.780267 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:03.780267 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:03.780267 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:03.780267 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:03.780267 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:03.780267 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:03.780267 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:03.780267 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:03.781434 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:21:03.781434 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:21:03.781434 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:03.781434 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:03.781434 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 260/509] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:21:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:03.781434 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc006a-3360-499a-bfe3-a5d6d8c2337a None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:03.802805 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919be52c-f1ac-40c6-acef-28eebc0a1128 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:03.824390 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:03.837271 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c5446e-092b-4d74-a7ba-85c167ffd16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:03.837863 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5446e-092b-4d74-a7ba-85c167ffd16e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:03.838149 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5446e-092b-4d74-a7ba-85c167ffd16e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:03.838426 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5446e-092b-4d74-a7ba-85c167ffd16e None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:03.839149 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c5446e-092b-4d74-a7ba-85c167ffd16e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:03.839456 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c5446e-092b-4d74-a7ba-85c167ffd16e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:03.840860 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c5446e-092b-4d74-a7ba-85c167ffd16e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:03.853445 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 250/510] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:21:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:03.854064 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c5446e-092b-4d74-a7ba-85c167ffd16e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:03.881975 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc006a-3360-499a-bfe3-a5d6d8c2337a None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:03.918032 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b3726-e36b-4d2c-8913-733995ed9234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:03.918687 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b3726-e36b-4d2c-8913-733995ed9234 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:03.918973 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b3726-e36b-4d2c-8913-733995ed9234 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:03.919254 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b3726-e36b-4d2c-8913-733995ed9234 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:03.952239 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c5446e-092b-4d74-a7ba-85c167ffd16e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:03.984804 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:03.987695 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c703cb-f6bd-4c54-99aa-810d5514e935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:03.988486 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c703cb-f6bd-4c54-99aa-810d5514e935 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:03.988768 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c703cb-f6bd-4c54-99aa-810d5514e935 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:03.989052 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b3726-e36b-4d2c-8913-733995ed9234 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:03.989150 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c703cb-f6bd-4c54-99aa-810d5514e935 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:03.990528 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b3726-e36b-4d2c-8913-733995ed9234 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:03.999173 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c703cb-f6bd-4c54-99aa-810d5514e935 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:04.000612 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c703cb-f6bd-4c54-99aa-810d5514e935 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:04.018540 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-b9c703cb-f6bd-4c54-99aa-810d5514e935 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:04.018540 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:04.018540 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:04.018540 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:04.018540 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:04.018540 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:04.018540 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:04.018540 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:04.018540 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:04.018540 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:04.018540 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:04.018540 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:04.018540 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:21:04.018540 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:21:04.018540 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:21:04.019462 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:21:04.019462 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:04.019462 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:04.019462 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:04.019462 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:04.019462 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:04.019462 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:04.019462 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:04.019462 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:04.019462 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:04.019462 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:04.019462 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:04.019462 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:04.019462 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:04.019462 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:04.019462 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:04.019462 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:04.020324 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:21:04.020324 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:21:04.020324 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:04.020324 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:04.020324 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 251/511] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:21:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:04.020594 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c703cb-f6bd-4c54-99aa-810d5514e935 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:04.057773 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:04.091117 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 261/512] 10.222.0.16 () {58 vars in 1282 bytes} [Thu May 26 12:21:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:21:04.091883 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b3726-e36b-4d2c-8913-733995ed9234 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:04.128607 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c703cb-f6bd-4c54-99aa-810d5514e935 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:04.161990 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd63b4b-e288-44e5-9591-606013329537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:04.162784 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd63b4b-e288-44e5-9591-606013329537 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:04.163072 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd63b4b-e288-44e5-9591-606013329537 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:04.163344 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd63b4b-e288-44e5-9591-606013329537 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:04.175684 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd63b4b-e288-44e5-9591-606013329537 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:04.177197 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd63b4b-e288-44e5-9591-606013329537 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:04.186059 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:04.190327 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b3726-e36b-4d2c-8913-733995ed9234 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:04.194810 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-cbd63b4b-e288-44e5-9591-606013329537 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:04.194810 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:04.194810 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:04.194810 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:04.194810 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:04.194810 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:04.194810 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:04.194810 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:04.194810 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:04.194810 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:04.194810 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:04.194810 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:04.194810 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:21:04.194810 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:21:04.194810 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:21:04.195707 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:21:04.195707 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:04.195707 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:04.195707 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:04.195707 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:04.195707 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:04.195707 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:04.195707 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:04.195707 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:04.195707 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:04.195707 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:04.195707 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:04.195707 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:04.195707 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:04.195707 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:04.195707 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:04.195707 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:04.196561 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:21:04.196561 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:21:04.196561 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:04.196561 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:04.196561 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 252/513] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:21:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:04.196821 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd63b4b-e288-44e5-9591-606013329537 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:04.229975 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028374b-34dd-4207-bec2-a22708eb2067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:04.230636 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028374b-34dd-4207-bec2-a22708eb2067 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:04.230914 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028374b-34dd-4207-bec2-a22708eb2067 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:04.231198 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028374b-34dd-4207-bec2-a22708eb2067 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:04.231907 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a028374b-34dd-4207-bec2-a22708eb2067 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:04.232220 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a028374b-34dd-4207-bec2-a22708eb2067 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:04.233604 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a028374b-34dd-4207-bec2-a22708eb2067 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:04.245489 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 262/514] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:21:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:04.246292 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028374b-34dd-4207-bec2-a22708eb2067 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:04.282305 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:04.298052 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd63b4b-e288-44e5-9591-606013329537 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:04.333741 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cace29-c313-4769-b63d-bb17fdcba81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:04.334647 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cace29-c313-4769-b63d-bb17fdcba81b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:04.334958 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cace29-c313-4769-b63d-bb17fdcba81b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:04.335283 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cace29-c313-4769-b63d-bb17fdcba81b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:04.342941 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cace29-c313-4769-b63d-bb17fdcba81b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:04.344354 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cace29-c313-4769-b63d-bb17fdcba81b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:04.348587 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028374b-34dd-4207-bec2-a22708eb2067 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:04.359735 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-32cace29-c313-4769-b63d-bb17fdcba81b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:21:04.359735 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:04.359735 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:04.359735 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:04.359735 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:04.359735 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:04.359735 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:04.359735 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:04.359735 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:04.359735 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:04.359735 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:04.359735 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:04.359735 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:21:04.359735 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:21:04.359735 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:21:04.361254 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:21:04.361254 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:04.361254 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:04.361254 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:04.361254 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:04.361254 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:04.361254 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:04.361254 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:04.361254 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:04.361254 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:04.361254 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:04.361254 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:04.361254 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:04.361254 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:04.361254 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:04.361254 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:04.361254 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:04.362089 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:21:04.362089 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:21:04.362089 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:21:04.362089 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:21:04.362089 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:21:04.362089 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:21:04.362089 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:21:04.362089 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:04.362089 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 253/515] 10.222.0.16 () {56 vars in 1111 bytes} [Thu May 26 12:21:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:04.362566 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cace29-c313-4769-b63d-bb17fdcba81b None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:04.385601 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac357a-4b6f-41c0-8fd4-5ca67cb409b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:04.386257 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac357a-4b6f-41c0-8fd4-5ca67cb409b5 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:04.386534 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac357a-4b6f-41c0-8fd4-5ca67cb409b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:04.386808 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac357a-4b6f-41c0-8fd4-5ca67cb409b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:04.387536 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ac357a-4b6f-41c0-8fd4-5ca67cb409b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:04.387842 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ac357a-4b6f-41c0-8fd4-5ca67cb409b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:04.389247 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ac357a-4b6f-41c0-8fd4-5ca67cb409b5 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:04.401972 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 263/516] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:21:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:04.402597 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac357a-4b6f-41c0-8fd4-5ca67cb409b5 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:04.422447 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:04.463374 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cace29-c313-4769-b63d-bb17fdcba81b None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:04.499870 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7bfc7c-6381-4edc-8005-6ab396726e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:04.500680 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7bfc7c-6381-4edc-8005-6ab396726e79 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:04.501008 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7bfc7c-6381-4edc-8005-6ab396726e79 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:04.501286 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7bfc7c-6381-4edc-8005-6ab396726e79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:04.507420 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac357a-4b6f-41c0-8fd4-5ca67cb409b5 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:04.511290 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7bfc7c-6381-4edc-8005-6ab396726e79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:04.512721 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7bfc7c-6381-4edc-8005-6ab396726e79 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:04.519567 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:04.530961 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-4e7bfc7c-6381-4edc-8005-6ab396726e79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:04.530961 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:04.530961 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:04.530961 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:04.530961 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:04.530961 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:04.530961 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:04.530961 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:04.530961 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:04.530961 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:04.530961 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:04.530961 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:04.530961 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:21:04.530961 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:21:04.530961 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:21:04.531833 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:21:04.531833 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:04.531833 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:04.531833 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:04.531833 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:04.531833 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:04.531833 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:04.531833 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:04.531833 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:04.531833 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:04.531833 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:04.531833 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:04.531833 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:04.531833 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:04.531833 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:04.531833 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:04.531833 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:04.533232 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:21:04.533232 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:21:04.533232 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:04.533232 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:04.533232 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 254/517] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:21:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:04.533828 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7bfc7c-6381-4edc-8005-6ab396726e79 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:04.547378 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e52a152-f4cf-48e7-80fa-9537859ea7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:04.548614 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52a152-f4cf-48e7-80fa-9537859ea7de None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:04.548926 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52a152-f4cf-48e7-80fa-9537859ea7de None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:04.549197 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52a152-f4cf-48e7-80fa-9537859ea7de None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:04.549919 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e52a152-f4cf-48e7-80fa-9537859ea7de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:04.550223 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e52a152-f4cf-48e7-80fa-9537859ea7de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:04.551593 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e52a152-f4cf-48e7-80fa-9537859ea7de None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:04.563822 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 264/518] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:21:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:04.564701 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e52a152-f4cf-48e7-80fa-9537859ea7de None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:04.639212 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7bfc7c-6381-4edc-8005-6ab396726e79 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:04.648282 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:04.671607 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e52a152-f4cf-48e7-80fa-9537859ea7de None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:04.674674 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c70963-3090-4b6d-9831-2bf1c0bdcd53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:04.675474 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c70963-3090-4b6d-9831-2bf1c0bdcd53 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:04.675759 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c70963-3090-4b6d-9831-2bf1c0bdcd53 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:04.676034 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c70963-3090-4b6d-9831-2bf1c0bdcd53 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:04.683305 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c70963-3090-4b6d-9831-2bf1c0bdcd53 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:04.684757 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c70963-3090-4b6d-9831-2bf1c0bdcd53 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:04.699307 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-98c70963-3090-4b6d-9831-2bf1c0bdcd53 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 26 12:21:04.699307 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:04.699307 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:04.699307 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:04.699307 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:04.699307 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:04.699307 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:04.699307 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:04.699307 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:04.699307 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:04.699307 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:04.699307 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:04.699307 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:21:04.699307 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:21:04.699307 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:21:04.699307 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:21:04.700263 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:04.700263 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:04.700263 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:21:04.700263 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:21:04.700263 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:21:04.700263 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:21:04.700263 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:04.700263 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:04.700263 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:04.700263 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:04.700263 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:04.700263 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:04.700263 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:04.700263 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:04.700263 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:04.700263 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:04.700263 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:04.700263 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:04.701625 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:04.701625 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:04.701625 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:21:04.701625 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:21:04.701625 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:21:04.701625 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:21:04.701625 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:21:04.701625 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:21:04.701625 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 26 12:21:04.701625 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:04.701625 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 255/519] 10.222.0.16 () {56 vars in 1102 bytes} [Thu May 26 12:21:04 2022] GET /identity/v3/users/neutron => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:04.701625 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c70963-3090-4b6d-9831-2bf1c0bdcd53 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:04.708751 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b483822-5398-4c87-a351-21c1dc36ccda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:04.709442 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b483822-5398-4c87-a351-21c1dc36ccda None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:04.709729 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b483822-5398-4c87-a351-21c1dc36ccda None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:04.710006 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b483822-5398-4c87-a351-21c1dc36ccda None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:04.710848 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b483822-5398-4c87-a351-21c1dc36ccda None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:04.711120 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b483822-5398-4c87-a351-21c1dc36ccda None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:04.712578 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b483822-5398-4c87-a351-21c1dc36ccda None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:04.732261 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 265/520] 10.222.0.16 () {56 vars in 1148 bytes} [Thu May 26 12:21:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:04.733116 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b483822-5398-4c87-a351-21c1dc36ccda None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:04.769905 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:04.813488 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c70963-3090-4b6d-9831-2bf1c0bdcd53 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:04.842435 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b483822-5398-4c87-a351-21c1dc36ccda None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:04.855884 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e5aa2-d08f-4dc4-91fd-5345ff6f3afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:04.856780 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e5aa2-d08f-4dc4-91fd-5345ff6f3afd None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:04.856918 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e5aa2-d08f-4dc4-91fd-5345ff6f3afd None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:04.857175 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e5aa2-d08f-4dc4-91fd-5345ff6f3afd None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:04.857880 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6e5aa2-d08f-4dc4-91fd-5345ff6f3afd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:04.859727 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6e5aa2-d08f-4dc4-91fd-5345ff6f3afd None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:04.878192 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8838b9c0-d294-4f45-a7ba-735a2653da2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:04.878854 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838b9c0-d294-4f45-a7ba-735a2653da2c None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:04.879133 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838b9c0-d294-4f45-a7ba-735a2653da2c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:04.879410 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838b9c0-d294-4f45-a7ba-735a2653da2c None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:04.879719 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 256/521] 10.222.0.16 () {60 vars in 1132 bytes} [Thu May 26 12:21:04 2022] POST /identity/v3/users => generated 247 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:21:04.880135 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8838b9c0-d294-4f45-a7ba-735a2653da2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:04.880437 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8838b9c0-d294-4f45-a7ba-735a2653da2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:04.880534 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e5aa2-d08f-4dc4-91fd-5345ff6f3afd None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:04.881935 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8838b9c0-d294-4f45-a7ba-735a2653da2c None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:04.889588 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:04.896424 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 266/522] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:21:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:04.897616 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8838b9c0-d294-4f45-a7ba-735a2653da2c None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:05.023223 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e5aa2-d08f-4dc4-91fd-5345ff6f3afd None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:05.030324 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8838b9c0-d294-4f45-a7ba-735a2653da2c None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:05.040313 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:05.069266 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b90e2a4-0eab-4e5b-96e9-25762dc3d641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:05.070085 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90e2a4-0eab-4e5b-96e9-25762dc3d641 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:05.070372 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90e2a4-0eab-4e5b-96e9-25762dc3d641 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:05.070669 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90e2a4-0eab-4e5b-96e9-25762dc3d641 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:05.080113 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b90e2a4-0eab-4e5b-96e9-25762dc3d641 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:05.081651 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b90e2a4-0eab-4e5b-96e9-25762dc3d641 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:05.097902 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-9b90e2a4-0eab-4e5b-96e9-25762dc3d641 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 12:21:05.097902 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:05.097902 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:05.097902 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:05.097902 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:05.097902 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:05.097902 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:05.097902 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:05.097902 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:05.097902 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:05.097902 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:05.097902 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:05.097902 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:21:05.097902 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:21:05.097902 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:21:05.097902 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:21:05.098847 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:05.098847 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:05.098847 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:21:05.098847 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:21:05.098847 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:21:05.098847 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:21:05.098847 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:05.098847 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:05.098847 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:05.098847 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:05.098847 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:05.098847 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:05.098847 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:05.098847 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:05.098847 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:05.098847 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:05.098847 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:05.098847 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:05.100249 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:05.100249 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:05.100249 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:21:05.100249 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:21:05.100249 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:21:05.100249 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:21:05.100249 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:21:05.100249 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:21:05.100249 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 12:21:05.100249 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:05.100249 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 257/523] 10.222.0.16 () {56 vars in 1099 bytes} [Thu May 26 12:21:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:05.100249 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b90e2a4-0eab-4e5b-96e9-25762dc3d641 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:05.102164 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d76eba-f621-402b-84ca-2e98f9029203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:05.103168 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d76eba-f621-402b-84ca-2e98f9029203 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:05.103468 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d76eba-f621-402b-84ca-2e98f9029203 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:05.104018 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d76eba-f621-402b-84ca-2e98f9029203 None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:05.105676 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d76eba-f621-402b-84ca-2e98f9029203 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:05.105996 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d76eba-f621-402b-84ca-2e98f9029203 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:05.107539 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d76eba-f621-402b-84ca-2e98f9029203 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:05.176353 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 267/524] 10.222.0.16 () {56 vars in 1139 bytes} [Thu May 26 12:21:04 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:05.177737 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d76eba-f621-402b-84ca-2e98f9029203 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:05.262221 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b90e2a4-0eab-4e5b-96e9-25762dc3d641 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:05.268757 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:05.306133 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae4e171-d05f-4b27-92a9-2ff3ec3fd6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:05.306820 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae4e171-d05f-4b27-92a9-2ff3ec3fd6ed None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:05.307080 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae4e171-d05f-4b27-92a9-2ff3ec3fd6ed None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:05.307358 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae4e171-d05f-4b27-92a9-2ff3ec3fd6ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:05.308205 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae4e171-d05f-4b27-92a9-2ff3ec3fd6ed None admin] RBAC: Adding query filter params (role.id=2991da7c6ccc478bbfdc0ce47a959495, scope.project.id=42e6c693bd224d92b8a0fe4ad0cc586d, user.id=536f68ff77794352adf41aaacdc0645c) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:05.308523 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae4e171-d05f-4b27-92a9-2ff3ec3fd6ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:05.310049 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae4e171-d05f-4b27-92a9-2ff3ec3fd6ed None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:05.321230 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 258/525] 10.222.0.16 () {56 vars in 1374 bytes} [Thu May 26 12:21:05 2022] GET /identity/v3/role_assignments?user.id=536f68ff77794352adf41aaacdc0645c&scope.project.id=42e6c693bd224d92b8a0fe4ad0cc586d&role.id=2991da7c6ccc478bbfdc0ce47a959495 => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:05.322214 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae4e171-d05f-4b27-92a9-2ff3ec3fd6ed None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:05.322605 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d76eba-f621-402b-84ca-2e98f9029203 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:05.370466 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee339ad-7453-4dba-b771-37b1b01c4c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:05.371295 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee339ad-7453-4dba-b771-37b1b01c4c6d None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:05.371581 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee339ad-7453-4dba-b771-37b1b01c4c6d None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:05.371858 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee339ad-7453-4dba-b771-37b1b01c4c6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:05.380697 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:05.382376 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee339ad-7453-4dba-b771-37b1b01c4c6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:05.384172 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee339ad-7453-4dba-b771-37b1b01c4c6d None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:05.404487 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-dee339ad-7453-4dba-b771-37b1b01c4c6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:21:05.404487 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:05.404487 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:05.404487 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:05.404487 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:05.404487 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:05.404487 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:05.404487 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:05.404487 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:05.404487 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:05.404487 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:05.404487 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:05.404487 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:21:05.404487 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:21:05.404487 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:21:05.405447 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:21:05.405447 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:05.405447 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:05.405447 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:05.405447 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:05.405447 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:05.405447 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:05.405447 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:05.405447 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:05.405447 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:05.405447 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:05.405447 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:05.405447 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:05.405447 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:05.405447 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:05.405447 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:05.405447 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:05.406419 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:21:05.406419 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:21:05.406419 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:21:05.406419 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:21:05.406419 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:21:05.406419 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:21:05.406419 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:21:05.406419 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:05.406419 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 268/526] 10.222.0.16 () {56 vars in 1111 bytes} [Thu May 26 12:21:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:05.407419 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee339ad-7453-4dba-b771-37b1b01c4c6d None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:05.476461 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae4e171-d05f-4b27-92a9-2ff3ec3fd6ed None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:05.525342 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2564d8-b448-42d7-8cd7-a1194b3b3656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:05.526013 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2564d8-b448-42d7-8cd7-a1194b3b3656 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:05.526297 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2564d8-b448-42d7-8cd7-a1194b3b3656 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:05.526569 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2564d8-b448-42d7-8cd7-a1194b3b3656 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:05.527424 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2564d8-b448-42d7-8cd7-a1194b3b3656 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:05.527733 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2564d8-b448-42d7-8cd7-a1194b3b3656 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:05.530624 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2564d8-b448-42d7-8cd7-a1194b3b3656 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:05.536063 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee339ad-7453-4dba-b771-37b1b01c4c6d None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:05.548971 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 259/527] 10.222.0.16 () {56 vars in 1137 bytes} [Thu May 26 12:21:05 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:05.549891 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2564d8-b448-42d7-8cd7-a1194b3b3656 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:05.557200 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:05.577414 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd675127-0b68-4596-911c-653b40e9600f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:05.578256 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd675127-0b68-4596-911c-653b40e9600f None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:05.578705 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd675127-0b68-4596-911c-653b40e9600f None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:05.579600 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd675127-0b68-4596-911c-653b40e9600f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:05.648588 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:05.655281 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2564d8-b448-42d7-8cd7-a1194b3b3656 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:05.660800 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd675127-0b68-4596-911c-653b40e9600f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:05.662529 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd675127-0b68-4596-911c-653b40e9600f None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:05.695045 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7dd7f-8dc4-4189-a333-90b22a9a3e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:05.695809 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7dd7f-8dc4-4189-a333-90b22a9a3e4a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:05.696162 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7dd7f-8dc4-4189-a333-90b22a9a3e4a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:05.696691 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7dd7f-8dc4-4189-a333-90b22a9a3e4a None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:05.698166 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd7dd7f-8dc4-4189-a333-90b22a9a3e4a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:05.698558 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd7dd7f-8dc4-4189-a333-90b22a9a3e4a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:05.700610 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd7dd7f-8dc4-4189-a333-90b22a9a3e4a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:05.725909 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 260/528] 10.222.0.16 () {56 vars in 1148 bytes} [Thu May 26 12:21:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:05.727281 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7dd7f-8dc4-4189-a333-90b22a9a3e4a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:05.802991 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 269/529] 10.222.0.16 () {58 vars in 1282 bytes} [Thu May 26 12:21:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:21:05.805332 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd675127-0b68-4596-911c-653b40e9600f None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:05.824225 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:05.862192 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7dd7f-8dc4-4189-a333-90b22a9a3e4a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:05.901525 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fff50cd-c8ae-404a-b588-6197f1cbe8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:05.902408 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff50cd-c8ae-404a-b588-6197f1cbe8b8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:05.902869 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff50cd-c8ae-404a-b588-6197f1cbe8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:05.903309 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff50cd-c8ae-404a-b588-6197f1cbe8b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:05.916749 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd675127-0b68-4596-911c-653b40e9600f None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:05.931044 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:05.964699 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc289a-1185-4e61-97dd-026b69663733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:05.965401 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc289a-1185-4e61-97dd-026b69663733 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:05.965715 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc289a-1185-4e61-97dd-026b69663733 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:05.966427 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc289a-1185-4e61-97dd-026b69663733 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:05.967786 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cc289a-1185-4e61-97dd-026b69663733 None admin] RBAC: Adding query filter params (role.id=2991da7c6ccc478bbfdc0ce47a959495, scope.project.id=42e6c693bd224d92b8a0fe4ad0cc586d, user.id=ad8cfccd3a4d42d381ce62ea90849f19) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:05.968117 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cc289a-1185-4e61-97dd-026b69663733 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:05.970756 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cc289a-1185-4e61-97dd-026b69663733 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:05.978736 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 270/530] 10.222.0.16 () {56 vars in 1374 bytes} [Thu May 26 12:21:05 2022] GET /identity/v3/role_assignments?user.id=ad8cfccd3a4d42d381ce62ea90849f19&scope.project.id=42e6c693bd224d92b8a0fe4ad0cc586d&role.id=2991da7c6ccc478bbfdc0ce47a959495 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:05.979283 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc289a-1185-4e61-97dd-026b69663733 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:05.981135 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fff50cd-c8ae-404a-b588-6197f1cbe8b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:05.982865 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fff50cd-c8ae-404a-b588-6197f1cbe8b8 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:06.099196 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:06.132241 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 261/531] 10.222.0.16 () {58 vars in 1282 bytes} [Thu May 26 12:21:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:21:06.140611 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fff50cd-c8ae-404a-b588-6197f1cbe8b8 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:06.146893 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc289a-1185-4e61-97dd-026b69663733 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:06.223863 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863d8a64-acb3-4ace-a18d-20694ba0e982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:06.225033 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d8a64-acb3-4ace-a18d-20694ba0e982 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:06.226635 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d8a64-acb3-4ace-a18d-20694ba0e982 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:06.227031 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d8a64-acb3-4ace-a18d-20694ba0e982 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:06.235476 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:06.245676 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863d8a64-acb3-4ace-a18d-20694ba0e982 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:06.247311 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863d8a64-acb3-4ace-a18d-20694ba0e982 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:06.270660 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-863d8a64-acb3-4ace-a18d-20694ba0e982 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:06.270660 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:06.270660 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:06.270660 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:06.270660 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:06.270660 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:06.270660 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:06.270660 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:06.270660 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:06.270660 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:06.270660 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:06.270660 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:06.270660 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:21:06.270660 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:21:06.270660 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:21:06.272075 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:21:06.272075 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:06.272075 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:06.272075 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:06.272075 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:06.272075 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:06.272075 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:06.272075 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:06.272075 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:06.272075 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:06.272075 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:06.272075 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:06.272075 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:06.272075 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:06.272075 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:06.272075 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:06.272075 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:06.273159 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:21:06.273159 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:21:06.273159 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:06.273159 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:06.274419 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 271/532] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:21:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:06.279846 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863d8a64-acb3-4ace-a18d-20694ba0e982 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:06.320398 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fff50cd-c8ae-404a-b588-6197f1cbe8b8 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:06.362907 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424b8fe7-5b84-4735-8027-134d1e0f19b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:06.363911 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b8fe7-5b84-4735-8027-134d1e0f19b1 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:06.364319 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b8fe7-5b84-4735-8027-134d1e0f19b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:06.364696 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b8fe7-5b84-4735-8027-134d1e0f19b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:06.375563 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424b8fe7-5b84-4735-8027-134d1e0f19b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:06.377209 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424b8fe7-5b84-4735-8027-134d1e0f19b1 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:06.395812 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-424b8fe7-5b84-4735-8027-134d1e0f19b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:06.395812 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:06.395812 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:06.395812 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:06.395812 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:06.395812 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:06.395812 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:06.395812 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:06.395812 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:06.395812 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:06.395812 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:06.395812 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:06.395812 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:21:06.395812 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:21:06.395812 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:21:06.396921 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:21:06.396921 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:06.396921 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:06.396921 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:06.396921 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:06.396921 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:06.396921 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:06.396921 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:06.396921 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:06.396921 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:06.396921 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:06.396921 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:06.396921 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:06.396921 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:06.396921 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:06.396921 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:06.396921 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:06.397984 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:21:06.397984 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:21:06.397984 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:06.397984 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:06.404859 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 262/533] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:21:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:06.404859 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424b8fe7-5b84-4735-8027-134d1e0f19b1 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:06.514333 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424b8fe7-5b84-4735-8027-134d1e0f19b1 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:06.524569 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:06.538892 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863d8a64-acb3-4ace-a18d-20694ba0e982 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:06.553919 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4c0ece-2358-4d35-b0ca-fc357f4412b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:06.554953 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c0ece-2358-4d35-b0ca-fc357f4412b0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:06.555445 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c0ece-2358-4d35-b0ca-fc357f4412b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:06.555947 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c0ece-2358-4d35-b0ca-fc357f4412b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:06.556934 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4c0ece-2358-4d35-b0ca-fc357f4412b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:06.557450 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4c0ece-2358-4d35-b0ca-fc357f4412b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:06.559144 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4c0ece-2358-4d35-b0ca-fc357f4412b0 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:06.572721 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 263/534] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:21:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:06.578536 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4c0ece-2358-4d35-b0ca-fc357f4412b0 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:06.579682 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:06.603696 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c3abce-c92a-43a6-bbd3-b54ac3feada9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:06.604392 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3abce-c92a-43a6-bbd3-b54ac3feada9 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:06.604679 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3abce-c92a-43a6-bbd3-b54ac3feada9 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:06.604985 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3abce-c92a-43a6-bbd3-b54ac3feada9 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:06.605740 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c3abce-c92a-43a6-bbd3-b54ac3feada9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:06.606046 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c3abce-c92a-43a6-bbd3-b54ac3feada9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:06.607462 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c3abce-c92a-43a6-bbd3-b54ac3feada9 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:06.637245 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 272/535] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:21:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:06.645917 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c3abce-c92a-43a6-bbd3-b54ac3feada9 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:06.727088 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4c0ece-2358-4d35-b0ca-fc357f4412b0 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:06.793562 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c3abce-c92a-43a6-bbd3-b54ac3feada9 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:06.804128 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dfe5c6-afc2-4ff4-ac3e-6250449405d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:06.805194 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dfe5c6-afc2-4ff4-ac3e-6250449405d3 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:06.805621 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dfe5c6-afc2-4ff4-ac3e-6250449405d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:06.806063 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dfe5c6-afc2-4ff4-ac3e-6250449405d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:06.818375 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dfe5c6-afc2-4ff4-ac3e-6250449405d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:06.820057 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dfe5c6-afc2-4ff4-ac3e-6250449405d3 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:06.843887 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-d9dfe5c6-afc2-4ff4-ac3e-6250449405d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:21:06.843887 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:06.843887 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:06.843887 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:06.843887 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:06.843887 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:06.843887 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:06.843887 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:06.843887 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:06.843887 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:06.843887 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:06.843887 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:06.843887 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:21:06.843887 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:21:06.843887 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:21:06.845522 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:21:06.845522 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:06.845522 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:06.845522 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:06.845522 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:06.845522 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:06.845522 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:06.845522 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:06.845522 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:06.845522 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:06.845522 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:06.845522 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:06.845522 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:06.845522 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:06.845522 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:06.845522 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:06.845522 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:06.846635 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:21:06.846635 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:21:06.846635 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:21:06.846635 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:21:06.846635 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:21:06.846635 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:21:06.846635 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:21:06.846635 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:06.857641 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 264/536] 10.222.0.16 () {56 vars in 1111 bytes} [Thu May 26 12:21:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:06.862253 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf4ed4-e6ba-428e-88d6-a7d6896cbc8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:06.863291 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dfe5c6-afc2-4ff4-ac3e-6250449405d3 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:06.864620 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf4ed4-e6ba-428e-88d6-a7d6896cbc8b None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:06.865447 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf4ed4-e6ba-428e-88d6-a7d6896cbc8b None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:06.867725 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf4ed4-e6ba-428e-88d6-a7d6896cbc8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:06.882943 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cf4ed4-e6ba-428e-88d6-a7d6896cbc8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:06.884661 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cf4ed4-e6ba-428e-88d6-a7d6896cbc8b None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:06.909263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-b3cf4ed4-e6ba-428e-88d6-a7d6896cbc8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:21:06.909263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:06.909263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:06.909263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:06.909263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:06.909263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:06.909263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:06.909263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:06.909263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:06.909263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:06.909263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:06.909263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:06.909263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:21:06.909263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:21:06.909263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:21:06.910334 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:21:06.910334 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:06.910334 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:06.910334 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:06.910334 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:06.910334 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:06.910334 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:06.910334 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:06.910334 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:06.910334 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:06.910334 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:06.910334 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:06.910334 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:06.910334 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:06.910334 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:06.910334 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:06.910334 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:06.911386 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:21:06.911386 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:21:06.911386 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:21:06.911386 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:21:06.911386 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:21:06.911386 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:21:06.911386 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:21:06.911386 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:06.915479 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 273/537] 10.222.0.16 () {56 vars in 1111 bytes} [Thu May 26 12:21:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:21:06.919559 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:06.920167 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf4ed4-e6ba-428e-88d6-a7d6896cbc8b None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:07.026899 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dfe5c6-afc2-4ff4-ac3e-6250449405d3 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:07.027996 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:07.065614 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0230e40-6517-4559-86cb-68a67b9b487b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:07.066573 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0230e40-6517-4559-86cb-68a67b9b487b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:07.067000 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0230e40-6517-4559-86cb-68a67b9b487b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:07.067419 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0230e40-6517-4559-86cb-68a67b9b487b None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:07.068353 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0230e40-6517-4559-86cb-68a67b9b487b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:07.068824 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0230e40-6517-4559-86cb-68a67b9b487b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:07.070881 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0230e40-6517-4559-86cb-68a67b9b487b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:07.084677 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 265/538] 10.222.0.16 () {56 vars in 1148 bytes} [Thu May 26 12:21:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:07.090520 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0230e40-6517-4559-86cb-68a67b9b487b None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:07.148212 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf4ed4-e6ba-428e-88d6-a7d6896cbc8b None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:07.225480 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec9aaae-4341-4464-be69-6137ad8cb9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:07.226399 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9aaae-4341-4464-be69-6137ad8cb9a0 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:07.226827 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9aaae-4341-4464-be69-6137ad8cb9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:07.227269 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9aaae-4341-4464-be69-6137ad8cb9a0 None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:07.228232 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec9aaae-4341-4464-be69-6137ad8cb9a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:07.228688 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec9aaae-4341-4464-be69-6137ad8cb9a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:07.230323 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec9aaae-4341-4464-be69-6137ad8cb9a0 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:07.255598 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 274/539] 10.222.0.16 () {56 vars in 1148 bytes} [Thu May 26 12:21:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:07.261164 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec9aaae-4341-4464-be69-6137ad8cb9a0 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:07.277356 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:07.323175 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0230e40-6517-4559-86cb-68a67b9b487b None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:07.382333 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec9aaae-4341-4464-be69-6137ad8cb9a0 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:07.398860 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:07.417594 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc610a4b-a778-462e-ae83-1d635f83b62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:07.418260 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc610a4b-a778-462e-ae83-1d635f83b62a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:07.418539 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc610a4b-a778-462e-ae83-1d635f83b62a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:07.418810 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc610a4b-a778-462e-ae83-1d635f83b62a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:07.419653 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc610a4b-a778-462e-ae83-1d635f83b62a None admin] RBAC: Adding query filter params (role.id=2991da7c6ccc478bbfdc0ce47a959495, scope.project.id=42e6c693bd224d92b8a0fe4ad0cc586d, user.id=736554efeba94a0b9547d18c3fc84fec) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:07.419958 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc610a4b-a778-462e-ae83-1d635f83b62a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:07.421669 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc610a4b-a778-462e-ae83-1d635f83b62a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:07.424336 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b5ae9-961a-40db-b58d-af210f00ad8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:07.425253 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b5ae9-961a-40db-b58d-af210f00ad8d None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:07.425732 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b5ae9-961a-40db-b58d-af210f00ad8d None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:07.426201 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b5ae9-961a-40db-b58d-af210f00ad8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:07.427218 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b5ae9-961a-40db-b58d-af210f00ad8d None admin] RBAC: Adding query filter params (role.id=2991da7c6ccc478bbfdc0ce47a959495, scope.project.id=42e6c693bd224d92b8a0fe4ad0cc586d, user.id=68033ffcafbc47bbadd008abd9e56c4b) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:07.427744 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b5ae9-961a-40db-b58d-af210f00ad8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:07.429393 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b5ae9-961a-40db-b58d-af210f00ad8d None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:07.436929 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 275/540] 10.222.0.16 () {56 vars in 1374 bytes} [Thu May 26 12:21:07 2022] GET /identity/v3/role_assignments?user.id=68033ffcafbc47bbadd008abd9e56c4b&scope.project.id=42e6c693bd224d92b8a0fe4ad0cc586d&role.id=2991da7c6ccc478bbfdc0ce47a959495 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:07.439114 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab1895-86d1-4c59-8ee9-83dd77670577 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:07.439493 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 266/541] 10.222.0.16 () {56 vars in 1374 bytes} [Thu May 26 12:21:07 2022] GET /identity/v3/role_assignments?user.id=736554efeba94a0b9547d18c3fc84fec&scope.project.id=42e6c693bd224d92b8a0fe4ad0cc586d&role.id=2991da7c6ccc478bbfdc0ce47a959495 => generated 259 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:07.439843 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab1895-86d1-4c59-8ee9-83dd77670577 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:07.440319 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab1895-86d1-4c59-8ee9-83dd77670577 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:07.442433 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 276/542] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:21:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:21:07.460106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af9f84-a616-41ee-9076-c6666b7ca500 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:07.460435 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af9f84-a616-41ee-9076-c6666b7ca500 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:07.460670 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af9f84-a616-41ee-9076-c6666b7ca500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:07.494088 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c4af9f84-a616-41ee-9076-c6666b7ca500 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:21:07.495320 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c4af9f84-a616-41ee-9076-c6666b7ca500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:21:07.606250 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 267/543] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:21:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:21:07.643192 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab1895-86d1-4c59-8ee9-83dd77670577 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:07.791225 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab1895-86d1-4c59-8ee9-83dd77670577 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:07.836402 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8c516-1f12-4aa7-b00d-99e9d31d78fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:07.837538 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8c516-1f12-4aa7-b00d-99e9d31d78fc None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:07.838009 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8c516-1f12-4aa7-b00d-99e9d31d78fc None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:07.838502 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8c516-1f12-4aa7-b00d-99e9d31d78fc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:07.850261 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc8c516-1f12-4aa7-b00d-99e9d31d78fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:21:07.858450 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-8dc8c516-1f12-4aa7-b00d-99e9d31d78fc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:21:07.858450 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:07.858450 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:07.858450 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:07.858450 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:07.858450 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:07.858450 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:07.858450 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:07.858450 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:07.858450 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:07.858450 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:07.858450 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:07.858450 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:21:07.858450 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:21:07.858450 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:21:07.858450 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:21:07.859329 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:21:07.859329 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:21:07.859329 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:21:07.859329 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:21:07.859329 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:07.859329 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:07.859329 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:07.859329 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:07.859329 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:07.859329 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:07.859329 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:07.859329 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:07.859329 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:07.859329 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:07.859329 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:07.859329 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:07.860672 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:07.860672 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:07.860672 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:07.860672 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:07.860672 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:21:07.860672 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:21:07.860672 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:21:07.860672 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:21:07.860672 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:21:07.860672 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:21:07.860672 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:21:07.860672 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:07.863090 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 277/544] 10.222.0.16 () {56 vars in 1102 bytes} [Thu May 26 12:21:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:07.870301 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af9f84-a616-41ee-9076-c6666b7ca500 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:07.988004 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:08.026998 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af9f84-a616-41ee-9076-c6666b7ca500 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:08.102118 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b48f2-9e67-46c6-9c2e-8e2581157518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:08.102798 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b48f2-9e67-46c6-9c2e-8e2581157518 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:08.103080 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b48f2-9e67-46c6-9c2e-8e2581157518 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:08.103349 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b48f2-9e67-46c6-9c2e-8e2581157518 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:08.104105 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5b48f2-9e67-46c6-9c2e-8e2581157518 None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:08.104477 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5b48f2-9e67-46c6-9c2e-8e2581157518 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:08.105898 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5b48f2-9e67-46c6-9c2e-8e2581157518 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:08.117464 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1eb25-0811-46d0-b09d-5d3b8d746005 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:08.118059 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1eb25-0811-46d0-b09d-5d3b8d746005 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:08.118164 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 268/545] 10.222.0.16 () {56 vars in 1103 bytes} [Thu May 26 12:21:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:08.118628 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1eb25-0811-46d0-b09d-5d3b8d746005 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:08.120252 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 278/546] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:21:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:21:08.123235 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b48f2-9e67-46c6-9c2e-8e2581157518 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:08.139065 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87e143-943b-41a8-8da6-11039e247ae7 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:08.139680 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87e143-943b-41a8-8da6-11039e247ae7 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:08.140141 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87e143-943b-41a8-8da6-11039e247ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:08.171868 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-fc87e143-943b-41a8-8da6-11039e247ae7 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:21:08.173133 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-fc87e143-943b-41a8-8da6-11039e247ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:21:08.234572 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:08.287236 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 279/547] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:21:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:21:08.288615 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b48f2-9e67-46c6-9c2e-8e2581157518 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:08.311800 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc87e143-943b-41a8-8da6-11039e247ae7 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:08.341358 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a7469-b718-45ab-9b22-a46b3095a84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:08.342461 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a7469-b718-45ab-9b22-a46b3095a84e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:08.342746 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a7469-b718-45ab-9b22-a46b3095a84e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:08.343025 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a7469-b718-45ab-9b22-a46b3095a84e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:08.361414 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a7469-b718-45ab-9b22-a46b3095a84e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:08.362902 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a7469-b718-45ab-9b22-a46b3095a84e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:08.369380 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:08.407505 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-670a7469-b718-45ab-9b22-a46b3095a84e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:08.407505 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:08.407505 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:08.407505 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:08.407505 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:08.407505 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:08.407505 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:08.407505 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:08.407505 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:08.407505 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:08.407505 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:08.407505 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:08.407505 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:21:08.407505 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:21:08.407505 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:21:08.408422 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:21:08.408422 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:08.408422 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:08.408422 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:08.408422 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:08.408422 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:08.408422 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:08.408422 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:08.408422 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:08.408422 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:08.408422 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:08.408422 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:08.408422 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:08.408422 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:08.408422 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:08.408422 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:08.408422 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:08.409387 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:21:08.409387 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:21:08.409387 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:08.409387 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:08.411645 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 269/548] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:21:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:08.421793 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a7469-b718-45ab-9b22-a46b3095a84e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:08.425831 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc87e143-943b-41a8-8da6-11039e247ae7 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:08.464511 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c807f86e-25e8-48e6-8711-72bab269c8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:08.465362 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807f86e-25e8-48e6-8711-72bab269c8aa None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:08.465645 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807f86e-25e8-48e6-8711-72bab269c8aa None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:08.465918 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807f86e-25e8-48e6-8711-72bab269c8aa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:08.482362 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c807f86e-25e8-48e6-8711-72bab269c8aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:21:08.491547 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-c807f86e-25e8-48e6-8711-72bab269c8aa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:21:08.491547 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:08.491547 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:08.491547 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:08.491547 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:08.491547 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:08.491547 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:08.491547 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:08.491547 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:08.491547 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:08.491547 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:08.491547 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:08.491547 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:21:08.491547 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:21:08.491547 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:21:08.491547 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:21:08.492532 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:21:08.492532 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:21:08.492532 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:21:08.492532 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:21:08.492532 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:08.492532 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:08.492532 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:08.492532 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:08.492532 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:08.492532 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:08.492532 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:08.492532 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:08.492532 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:08.492532 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:08.492532 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:08.492532 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:08.493904 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:08.493904 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:08.493904 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:08.493904 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:08.493904 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:21:08.493904 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:21:08.493904 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:21:08.493904 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:21:08.493904 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:21:08.493904 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:21:08.493904 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:21:08.493904 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:08.497184 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 280/549] 10.222.0.16 () {56 vars in 1102 bytes} [Thu May 26 12:21:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:08.504872 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c807f86e-25e8-48e6-8711-72bab269c8aa None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:08.557195 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:08.670580 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a7469-b718-45ab-9b22-a46b3095a84e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:08.690193 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c807f86e-25e8-48e6-8711-72bab269c8aa None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:08.714017 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e67a0c5-95f2-413c-8380-7ffb578db349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:08.714684 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67a0c5-95f2-413c-8380-7ffb578db349 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:08.714966 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67a0c5-95f2-413c-8380-7ffb578db349 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:08.715240 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67a0c5-95f2-413c-8380-7ffb578db349 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:08.716129 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e67a0c5-95f2-413c-8380-7ffb578db349 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:08.716440 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e67a0c5-95f2-413c-8380-7ffb578db349 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:08.718738 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e67a0c5-95f2-413c-8380-7ffb578db349 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:08.728489 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b355d7d-75d4-455b-967c-6835d2acc695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:08.729543 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b355d7d-75d4-455b-967c-6835d2acc695 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:08.730046 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b355d7d-75d4-455b-967c-6835d2acc695 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:08.730539 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b355d7d-75d4-455b-967c-6835d2acc695 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:08.731506 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b355d7d-75d4-455b-967c-6835d2acc695 None admin] RBAC: Adding query filter params (name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:08.732015 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b355d7d-75d4-455b-967c-6835d2acc695 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:08.733614 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b355d7d-75d4-455b-967c-6835d2acc695 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:08.736968 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 270/550] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:21:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:08.739201 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75083f79-2961-492a-b5e2-f379927aa8cc None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:08.739887 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75083f79-2961-492a-b5e2-f379927aa8cc None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:08.741218 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75083f79-2961-492a-b5e2-f379927aa8cc None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:08.746717 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 271/551] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:21:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:21:08.746717 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75083f79-2961-492a-b5e2-f379927aa8cc None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:08.752346 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 281/552] 10.222.0.16 () {56 vars in 1103 bytes} [Thu May 26 12:21:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:21:08.752346 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c755bf-f57f-4b16-8b8a-fae2416854bb None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:08.752346 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c755bf-f57f-4b16-8b8a-fae2416854bb None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:08.752346 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c755bf-f57f-4b16-8b8a-fae2416854bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:08.778681 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-22c755bf-f57f-4b16-8b8a-fae2416854bb None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:21:08.780352 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-22c755bf-f57f-4b16-8b8a-fae2416854bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:21:08.825055 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:08.877948 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75083f79-2961-492a-b5e2-f379927aa8cc None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:08.878298 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 282/553] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:21:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:21:08.879435 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c755bf-f57f-4b16-8b8a-fae2416854bb None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:08.914706 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:08.921126 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4c8ec-3192-40d1-8883-d5e651dce562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:08.923488 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4c8ec-3192-40d1-8883-d5e651dce562 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:08.924041 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4c8ec-3192-40d1-8883-d5e651dce562 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:08.924559 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4c8ec-3192-40d1-8883-d5e651dce562 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:08.935262 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc4c8ec-3192-40d1-8883-d5e651dce562 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:08.936956 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc4c8ec-3192-40d1-8883-d5e651dce562 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:08.957017 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-cdc4c8ec-3192-40d1-8883-d5e651dce562 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 12:21:08.957017 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:08.957017 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:08.957017 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:08.957017 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:08.957017 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:08.957017 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:08.957017 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:08.957017 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:08.957017 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:08.957017 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:08.957017 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:08.957017 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:21:08.957017 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:21:08.957017 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:21:08.957017 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:21:08.958222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:08.958222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:08.958222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:21:08.958222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:21:08.958222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:21:08.958222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:21:08.958222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:08.958222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:08.958222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:08.958222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:08.958222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:08.958222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:08.958222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:08.958222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:08.958222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:08.958222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:08.958222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:08.958222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:08.959356 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:08.959356 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:08.959356 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:21:08.959356 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:21:08.959356 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:21:08.959356 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:21:08.959356 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:21:08.959356 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:21:08.959356 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 12:21:08.959356 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:08.962480 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 272/554] 10.222.0.16 () {56 vars in 1096 bytes} [Thu May 26 12:21:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:08.963402 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4c8ec-3192-40d1-8883-d5e651dce562 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:09.009508 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c755bf-f57f-4b16-8b8a-fae2416854bb None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:09.045145 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1331c-9509-42cf-9c1f-0b20d369ae02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:09.046317 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1331c-9509-42cf-9c1f-0b20d369ae02 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:09.046860 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1331c-9509-42cf-9c1f-0b20d369ae02 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:09.047370 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1331c-9509-42cf-9c1f-0b20d369ae02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:09.062667 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b1331c-9509-42cf-9c1f-0b20d369ae02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:09.064579 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b1331c-9509-42cf-9c1f-0b20d369ae02 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:09.086688 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4c8ec-3192-40d1-8883-d5e651dce562 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:09.088086 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-85b1331c-9509-42cf-9c1f-0b20d369ae02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:09.088086 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:09.088086 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:09.088086 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:09.088086 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:09.088086 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:09.088086 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:09.088086 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:09.088086 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:09.088086 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:09.088086 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:09.088086 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:09.088086 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:21:09.088086 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:21:09.088086 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:21:09.088986 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:21:09.088986 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:09.088986 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:09.088986 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:09.088986 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:09.088986 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:09.088986 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:09.088986 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:09.088986 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:09.088986 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:09.088986 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:09.088986 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:09.088986 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:09.088986 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:09.088986 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:09.088986 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:09.088986 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:09.089939 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:21:09.089939 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:21:09.089939 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:09.089939 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:09.092918 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 283/555] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:21:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:09.093934 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1331c-9509-42cf-9c1f-0b20d369ae02 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:09.116447 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:09.143962 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8bf54b-aa29-448f-b948-547d9f9fefdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:09.144755 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8bf54b-aa29-448f-b948-547d9f9fefdb None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:09.145062 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8bf54b-aa29-448f-b948-547d9f9fefdb None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:09.145341 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8bf54b-aa29-448f-b948-547d9f9fefdb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:09.160784 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8bf54b-aa29-448f-b948-547d9f9fefdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:21:09.171122 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:09.171416 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-4a8bf54b-aa29-448f-b948-547d9f9fefdb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:21:09.171416 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:09.171416 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:09.171416 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:09.171416 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:09.171416 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:09.171416 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:09.171416 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:09.171416 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:09.171416 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:09.171416 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:09.171416 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:09.171416 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:21:09.171416 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:21:09.171416 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:21:09.171416 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:21:09.172331 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:21:09.172331 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:21:09.172331 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:21:09.172331 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:21:09.172331 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:09.172331 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:09.172331 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:09.172331 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:09.172331 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:09.172331 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:09.172331 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:09.172331 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:09.172331 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:09.172331 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:09.172331 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:09.172331 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:09.173777 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:09.173777 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:09.173777 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:09.173777 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:09.173777 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:21:09.173777 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:21:09.173777 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:21:09.173777 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:21:09.173777 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:21:09.173777 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:21:09.173777 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:21:09.173777 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:09.173777 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 273/556] 10.222.0.16 () {56 vars in 1102 bytes} [Thu May 26 12:21:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:09.174962 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8bf54b-aa29-448f-b948-547d9f9fefdb None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:09.210649 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1331c-9509-42cf-9c1f-0b20d369ae02 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:09.250844 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a451bfec-c38f-4a1f-9a82-ca7ede621de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:09.251945 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451bfec-c38f-4a1f-9a82-ca7ede621de3 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:09.252549 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451bfec-c38f-4a1f-9a82-ca7ede621de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:09.253086 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451bfec-c38f-4a1f-9a82-ca7ede621de3 None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:09.254233 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a451bfec-c38f-4a1f-9a82-ca7ede621de3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:09.254776 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a451bfec-c38f-4a1f-9a82-ca7ede621de3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:09.256573 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a451bfec-c38f-4a1f-9a82-ca7ede621de3 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:09.280866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 284/557] 10.222.0.16 () {56 vars in 1135 bytes} [Thu May 26 12:21:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:09.280866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a451bfec-c38f-4a1f-9a82-ca7ede621de3 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:09.308547 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8bf54b-aa29-448f-b948-547d9f9fefdb None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:09.346086 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ddfac-2acb-401d-9df7-5e2e81e875b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:09.347606 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ddfac-2acb-401d-9df7-5e2e81e875b7 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:09.348160 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ddfac-2acb-401d-9df7-5e2e81e875b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:09.348646 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ddfac-2acb-401d-9df7-5e2e81e875b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:09.349691 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476ddfac-2acb-401d-9df7-5e2e81e875b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:09.350226 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476ddfac-2acb-401d-9df7-5e2e81e875b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:09.351872 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476ddfac-2acb-401d-9df7-5e2e81e875b7 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:09.365244 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 274/558] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:21:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:09.366519 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ddfac-2acb-401d-9df7-5e2e81e875b7 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:09.408217 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:09.418595 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a451bfec-c38f-4a1f-9a82-ca7ede621de3 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:09.450162 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:09.461236 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0605d8-af22-4a0e-b7ad-013fbe6179eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:09.462209 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0605d8-af22-4a0e-b7ad-013fbe6179eb None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:09.462705 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0605d8-af22-4a0e-b7ad-013fbe6179eb None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:09.463193 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0605d8-af22-4a0e-b7ad-013fbe6179eb None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:09.464186 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0605d8-af22-4a0e-b7ad-013fbe6179eb None admin] RBAC: Adding query filter params (name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:09.464704 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0605d8-af22-4a0e-b7ad-013fbe6179eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:09.466329 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0605d8-af22-4a0e-b7ad-013fbe6179eb None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:09.478271 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 285/559] 10.222.0.16 () {56 vars in 1103 bytes} [Thu May 26 12:21:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:09.479488 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0605d8-af22-4a0e-b7ad-013fbe6179eb None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:09.492885 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ddfac-2acb-401d-9df7-5e2e81e875b7 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:09.541161 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6461bda-a7bc-4b82-a29a-7471a3de1fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:09.542275 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6461bda-a7bc-4b82-a29a-7471a3de1fd2 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:09.542681 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6461bda-a7bc-4b82-a29a-7471a3de1fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:09.542973 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6461bda-a7bc-4b82-a29a-7471a3de1fd2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:09.590104 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0605d8-af22-4a0e-b7ad-013fbe6179eb None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:09.632332 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50765c1d-d487-498d-872b-61b0bafe3c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:09.633597 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50765c1d-d487-498d-872b-61b0bafe3c05 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:09.634098 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50765c1d-d487-498d-872b-61b0bafe3c05 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:09.634614 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50765c1d-d487-498d-872b-61b0bafe3c05 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:09.639446 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6461bda-a7bc-4b82-a29a-7471a3de1fd2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:09.640952 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6461bda-a7bc-4b82-a29a-7471a3de1fd2 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:09.645047 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50765c1d-d487-498d-872b-61b0bafe3c05 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:09.646802 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50765c1d-d487-498d-872b-61b0bafe3c05 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:09.663444 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-50765c1d-d487-498d-872b-61b0bafe3c05 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 12:21:09.663444 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:09.663444 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:09.663444 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:09.663444 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:09.663444 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:09.663444 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:09.663444 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:09.663444 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:09.663444 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:09.663444 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:09.663444 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:09.663444 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:21:09.663444 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:21:09.663444 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:21:09.663444 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:21:09.664427 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:09.664427 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:09.664427 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:21:09.664427 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:21:09.664427 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:21:09.664427 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:21:09.664427 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:09.664427 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:09.664427 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:09.664427 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:09.664427 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:09.664427 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:09.664427 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:09.664427 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:09.664427 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:09.664427 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:09.664427 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:09.664427 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:09.665400 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:09.665400 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:09.665400 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:21:09.665400 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:21:09.665400 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:21:09.665400 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:21:09.665400 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:21:09.665400 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:21:09.665400 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 12:21:09.665400 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:09.673152 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 286/560] 10.222.0.16 () {56 vars in 1093 bytes} [Thu May 26 12:21:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:09.674277 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50765c1d-d487-498d-872b-61b0bafe3c05 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:09.678145 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:09.741615 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:09.772008 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 275/561] 10.222.0.16 () {58 vars in 1282 bytes} [Thu May 26 12:21:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:21:09.773247 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6461bda-a7bc-4b82-a29a-7471a3de1fd2 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:09.806209 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50765c1d-d487-498d-872b-61b0bafe3c05 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:09.844352 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2c8895-1999-45e3-b81b-acc624ef1ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:09.845970 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c8895-1999-45e3-b81b-acc624ef1ba4 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:09.846251 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c8895-1999-45e3-b81b-acc624ef1ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:09.846524 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c8895-1999-45e3-b81b-acc624ef1ba4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:09.857397 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2c8895-1999-45e3-b81b-acc624ef1ba4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:09.858844 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2c8895-1999-45e3-b81b-acc624ef1ba4 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:09.877151 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-ff2c8895-1999-45e3-b81b-acc624ef1ba4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:09.877151 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:09.877151 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:09.877151 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:09.877151 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:09.877151 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:09.877151 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:09.877151 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:09.877151 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:09.877151 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:09.877151 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:09.877151 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:09.877151 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:21:09.877151 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:21:09.877151 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:21:09.878025 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:21:09.878025 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:09.878025 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:09.878025 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:09.878025 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:09.878025 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:09.878025 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:09.878025 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:09.878025 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:09.878025 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:09.878025 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:09.878025 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:09.878025 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:09.878025 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:09.878025 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:09.878025 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:09.878025 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:09.878910 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:21:09.878910 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:21:09.878910 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:09.878910 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:09.878910 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 287/562] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:21:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:09.879182 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2c8895-1999-45e3-b81b-acc624ef1ba4 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:09.892537 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6461bda-a7bc-4b82-a29a-7471a3de1fd2 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:09.929129 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c7ec97-7b05-4824-bdf2-085639cb7bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:09.930305 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c7ec97-7b05-4824-bdf2-085639cb7bdd None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:09.930767 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c7ec97-7b05-4824-bdf2-085639cb7bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:09.931354 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c7ec97-7b05-4824-bdf2-085639cb7bdd None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:09.932871 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c7ec97-7b05-4824-bdf2-085639cb7bdd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:09.933460 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c7ec97-7b05-4824-bdf2-085639cb7bdd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:09.935581 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c7ec97-7b05-4824-bdf2-085639cb7bdd None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:09.938787 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:09.956214 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 276/563] 10.222.0.16 () {56 vars in 1133 bytes} [Thu May 26 12:21:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:09.957907 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff9c8f-22c0-4c2d-a7fa-5eb3232c7463 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:09.958369 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff9c8f-22c0-4c2d-a7fa-5eb3232c7463 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:09.958815 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff9c8f-22c0-4c2d-a7fa-5eb3232c7463 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:09.964484 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 277/564] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:21:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:21:09.965261 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ff9c8f-22c0-4c2d-a7fa-5eb3232c7463 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:09.993648 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2c8895-1999-45e3-b81b-acc624ef1ba4 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:09.995106 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:10.029270 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de7c24c-39b5-4f01-b7c5-dde4b73e6b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:10.030052 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7c24c-39b5-4f01-b7c5-dde4b73e6b02 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:10.030336 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7c24c-39b5-4f01-b7c5-dde4b73e6b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:10.030612 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7c24c-39b5-4f01-b7c5-dde4b73e6b02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:10.041030 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de7c24c-39b5-4f01-b7c5-dde4b73e6b02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:10.042456 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de7c24c-39b5-4f01-b7c5-dde4b73e6b02 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:10.059999 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-8de7c24c-39b5-4f01-b7c5-dde4b73e6b02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:10.059999 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:10.059999 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:10.059999 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:10.059999 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:10.059999 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:10.059999 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:10.059999 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:10.059999 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:10.059999 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:10.059999 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:10.059999 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:10.059999 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:21:10.059999 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:21:10.059999 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:21:10.061082 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:21:10.061082 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:10.061082 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:10.061082 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:10.061082 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:10.061082 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:10.061082 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:10.061082 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:10.061082 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:10.061082 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:10.061082 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:10.061082 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:10.061082 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:10.061082 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:10.061082 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:10.061082 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:10.061082 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:10.061972 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:21:10.061972 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:21:10.061972 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:10.061972 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:10.061972 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 288/565] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:21:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:10.061972 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de7c24c-39b5-4f01-b7c5-dde4b73e6b02 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:10.069108 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ff9c8f-22c0-4c2d-a7fa-5eb3232c7463 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:10.102568 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91a5d2-12b1-4d15-bfca-65a7f89ddbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:10.103218 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91a5d2-12b1-4d15-bfca-65a7f89ddbf8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:10.103504 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91a5d2-12b1-4d15-bfca-65a7f89ddbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:10.103782 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91a5d2-12b1-4d15-bfca-65a7f89ddbf8 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:10.104502 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91a5d2-12b1-4d15-bfca-65a7f89ddbf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:10.104810 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91a5d2-12b1-4d15-bfca-65a7f89ddbf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:10.106211 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91a5d2-12b1-4d15-bfca-65a7f89ddbf8 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:10.117747 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 278/566] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:21:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:10.118988 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf989eff-a518-4444-bb9c-8b6b21c6ce2f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:10.119277 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf989eff-a518-4444-bb9c-8b6b21c6ce2f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:10.119548 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf989eff-a518-4444-bb9c-8b6b21c6ce2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:10.135075 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-cf989eff-a518-4444-bb9c-8b6b21c6ce2f None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:21:10.136250 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-cf989eff-a518-4444-bb9c-8b6b21c6ce2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:21:10.165878 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de7c24c-39b5-4f01-b7c5-dde4b73e6b02 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:10.184740 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:10.198532 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac57cc6a-d324-4eae-be62-501748f0afbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:10.199308 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57cc6a-d324-4eae-be62-501748f0afbf None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:10.199586 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57cc6a-d324-4eae-be62-501748f0afbf None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:10.199853 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57cc6a-d324-4eae-be62-501748f0afbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:10.203033 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 279/567] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:21:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:21:10.204855 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cedd19-883e-4071-8b14-09a6eed4f9e6 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:10.205166 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cedd19-883e-4071-8b14-09a6eed4f9e6 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:10.205442 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cedd19-883e-4071-8b14-09a6eed4f9e6 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:10.206912 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 280/568] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:21:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:21:10.211483 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cedd19-883e-4071-8b14-09a6eed4f9e6 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:10.213480 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac57cc6a-d324-4eae-be62-501748f0afbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:10.215119 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac57cc6a-d324-4eae-be62-501748f0afbf None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:10.233904 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-ac57cc6a-d324-4eae-be62-501748f0afbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:10.233904 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:10.233904 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:10.233904 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:10.233904 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:10.233904 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:10.233904 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:10.233904 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:10.233904 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:10.233904 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:10.233904 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:10.233904 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:10.233904 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:21:10.233904 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:21:10.233904 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:21:10.234826 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:21:10.234826 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:10.234826 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:10.234826 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:10.234826 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:10.234826 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:10.234826 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:10.234826 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:10.234826 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:10.234826 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:10.234826 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:10.234826 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:10.234826 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:10.234826 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:10.234826 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:10.234826 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:10.234826 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:10.235751 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:21:10.235751 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:21:10.235751 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:10.235751 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:10.235751 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 289/569] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:21:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:10.236022 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac57cc6a-d324-4eae-be62-501748f0afbf None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:10.245069 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:10.314205 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cedd19-883e-4071-8b14-09a6eed4f9e6 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:10.333874 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac57cc6a-d324-4eae-be62-501748f0afbf None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:10.348969 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bff75a-f0f4-45b4-b698-46eca8be8083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:10.349628 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bff75a-f0f4-45b4-b698-46eca8be8083 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:10.349910 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bff75a-f0f4-45b4-b698-46eca8be8083 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:10.350185 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bff75a-f0f4-45b4-b698-46eca8be8083 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:10.350907 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bff75a-f0f4-45b4-b698-46eca8be8083 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:10.351211 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bff75a-f0f4-45b4-b698-46eca8be8083 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:10.352587 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bff75a-f0f4-45b4-b698-46eca8be8083 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:10.363314 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 281/570] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:21:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:10.364479 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844232af-4976-4522-950d-9d1ea6ed51f3 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:10.364767 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844232af-4976-4522-950d-9d1ea6ed51f3 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:10.365073 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844232af-4976-4522-950d-9d1ea6ed51f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:10.366677 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b477dead-cd5d-43de-acaf-2b01d3ca8a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:10.367471 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477dead-cd5d-43de-acaf-2b01d3ca8a0b None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:10.367749 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477dead-cd5d-43de-acaf-2b01d3ca8a0b None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:10.368001 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477dead-cd5d-43de-acaf-2b01d3ca8a0b None admin] PATH_INFO: `/v3/users/glance` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:10.378925 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b477dead-cd5d-43de-acaf-2b01d3ca8a0b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:10.380355 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b477dead-cd5d-43de-acaf-2b01d3ca8a0b None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:10.382539 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-844232af-4976-4522-950d-9d1ea6ed51f3 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:21:10.383734 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-844232af-4976-4522-950d-9d1ea6ed51f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:21:10.394680 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-b477dead-cd5d-43de-acaf-2b01d3ca8a0b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 26 12:21:10.394680 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:10.394680 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:10.394680 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:10.394680 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:10.394680 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:10.394680 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:10.394680 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:10.394680 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:10.394680 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:10.394680 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:10.394680 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:10.394680 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:21:10.394680 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:21:10.394680 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:21:10.394680 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:21:10.395712 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:10.395712 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:10.395712 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:21:10.395712 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:21:10.395712 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:21:10.395712 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:21:10.395712 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:10.395712 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:10.395712 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:10.395712 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:10.395712 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:10.395712 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:10.395712 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:10.395712 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:10.395712 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:10.395712 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:10.395712 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:10.395712 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:10.396750 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:10.396750 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:10.396750 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:21:10.396750 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:21:10.396750 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:21:10.396750 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:21:10.396750 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:21:10.396750 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:21:10.396750 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 26 12:21:10.396750 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:10.396750 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 290/571] 10.222.0.16 () {56 vars in 1099 bytes} [Thu May 26 12:21:10 2022] GET /identity/v3/users/glance => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:10.396750 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b477dead-cd5d-43de-acaf-2b01d3ca8a0b None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:10.426699 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:10.452823 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 282/572] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:21:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:21:10.453647 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844232af-4976-4522-950d-9d1ea6ed51f3 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:10.468313 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:10.504298 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b477dead-cd5d-43de-acaf-2b01d3ca8a0b None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:10.544559 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f37c16-8650-4561-9687-560a6a5aefd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:10.545378 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f37c16-8650-4561-9687-560a6a5aefd8 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:10.545667 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f37c16-8650-4561-9687-560a6a5aefd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:10.545942 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f37c16-8650-4561-9687-560a6a5aefd8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:10.551156 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844232af-4976-4522-950d-9d1ea6ed51f3 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:10.556175 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f37c16-8650-4561-9687-560a6a5aefd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:21:10.564361 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-85f37c16-8650-4561-9687-560a6a5aefd8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:21:10.564361 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:10.564361 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:10.564361 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:10.564361 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:10.564361 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:10.564361 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:10.564361 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:10.564361 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:10.564361 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:10.564361 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:10.564361 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:10.564361 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:21:10.564361 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:21:10.564361 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:21:10.564361 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:21:10.565369 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:21:10.565369 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:21:10.565369 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:21:10.565369 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:21:10.565369 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:10.565369 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:10.565369 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:10.565369 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:10.565369 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:10.565369 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:10.565369 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:10.565369 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:10.565369 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:10.565369 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:10.565369 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:10.565369 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:10.566280 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:10.566280 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:10.566280 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:10.566280 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:10.566280 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:21:10.566280 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:21:10.566280 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:21:10.566280 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:21:10.566280 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:21:10.566280 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:21:10.566280 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:21:10.566280 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:10.566280 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 291/573] 10.222.0.16 () {56 vars in 1102 bytes} [Thu May 26 12:21:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:10.567484 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f37c16-8650-4561-9687-560a6a5aefd8 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:10.587713 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e3e2f-a2b5-46f5-9a43-f30c4013efd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:10.588364 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e3e2f-a2b5-46f5-9a43-f30c4013efd2 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:10.588646 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e3e2f-a2b5-46f5-9a43-f30c4013efd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:10.588953 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e3e2f-a2b5-46f5-9a43-f30c4013efd2 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:10.589672 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802e3e2f-a2b5-46f5-9a43-f30c4013efd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:10.589981 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802e3e2f-a2b5-46f5-9a43-f30c4013efd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:10.591356 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802e3e2f-a2b5-46f5-9a43-f30c4013efd2 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:10.602953 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 283/574] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:21:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:10.603570 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e3e2f-a2b5-46f5-9a43-f30c4013efd2 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:10.635847 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:10.666684 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f37c16-8650-4561-9687-560a6a5aefd8 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:10.693706 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:10.701541 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e3e2f-a2b5-46f5-9a43-f30c4013efd2 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:10.702599 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58f877-9510-4373-a80f-07616ebe9540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:10.703391 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58f877-9510-4373-a80f-07616ebe9540 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:10.703675 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58f877-9510-4373-a80f-07616ebe9540 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:10.703977 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58f877-9510-4373-a80f-07616ebe9540 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:10.710721 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f58f877-9510-4373-a80f-07616ebe9540 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:10.712161 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f58f877-9510-4373-a80f-07616ebe9540 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:10.726559 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-5f58f877-9510-4373-a80f-07616ebe9540 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:21:10.726559 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:10.726559 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:10.726559 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:10.726559 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:10.726559 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:10.726559 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:10.726559 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:10.726559 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:10.726559 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:10.726559 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:10.726559 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:10.726559 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:21:10.726559 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:21:10.726559 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:21:10.727602 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:21:10.727602 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:10.727602 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:10.727602 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:10.727602 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:10.727602 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:10.727602 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:10.727602 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:10.727602 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:10.727602 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:10.727602 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:10.727602 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:10.727602 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:10.727602 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:10.727602 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:10.727602 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:10.727602 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:10.728515 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:21:10.728515 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:21:10.728515 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:21:10.728515 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:21:10.728515 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:21:10.728515 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:21:10.728515 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:21:10.728515 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:10.728515 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 292/575] 10.222.0.16 () {56 vars in 1111 bytes} [Thu May 26 12:21:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:10.729026 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58f877-9510-4373-a80f-07616ebe9540 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:10.738408 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44cbf2b-7d9a-4f25-8b6c-36bb12ad1297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:10.739079 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cbf2b-7d9a-4f25-8b6c-36bb12ad1297 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:10.739361 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cbf2b-7d9a-4f25-8b6c-36bb12ad1297 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:10.739635 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cbf2b-7d9a-4f25-8b6c-36bb12ad1297 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:10.740475 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44cbf2b-7d9a-4f25-8b6c-36bb12ad1297 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:10.740784 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44cbf2b-7d9a-4f25-8b6c-36bb12ad1297 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:10.742246 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44cbf2b-7d9a-4f25-8b6c-36bb12ad1297 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:10.760294 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 284/576] 10.222.0.16 () {56 vars in 1137 bytes} [Thu May 26 12:21:10 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:10.761083 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44cbf2b-7d9a-4f25-8b6c-36bb12ad1297 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:10.832504 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58f877-9510-4373-a80f-07616ebe9540 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:10.850385 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:10.859482 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44cbf2b-7d9a-4f25-8b6c-36bb12ad1297 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:10.865730 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fd66ee-0284-49c5-a31e-c104e84dbe38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:10.866516 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd66ee-0284-49c5-a31e-c104e84dbe38 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:10.866795 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd66ee-0284-49c5-a31e-c104e84dbe38 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:10.867067 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd66ee-0284-49c5-a31e-c104e84dbe38 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:10.877363 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fd66ee-0284-49c5-a31e-c104e84dbe38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:21:10.885015 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-02fd66ee-0284-49c5-a31e-c104e84dbe38 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:21:10.885015 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:10.885015 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:10.885015 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:10.885015 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:10.885015 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:10.885015 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:10.885015 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:10.885015 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:10.885015 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:10.885015 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:10.885015 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:10.885015 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:21:10.885015 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:21:10.885015 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:21:10.885015 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:21:10.886121 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:21:10.886121 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:21:10.886121 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:21:10.886121 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:21:10.886121 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:10.886121 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:10.886121 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:10.886121 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:10.886121 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:10.886121 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:10.886121 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:10.886121 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:10.886121 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:10.886121 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:10.886121 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:10.886121 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:10.887137 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:10.887137 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:10.887137 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:10.887137 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:10.887137 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:21:10.887137 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:21:10.887137 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:21:10.887137 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:21:10.887137 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:21:10.887137 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:21:10.887137 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:21:10.887137 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:10.887137 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 293/577] 10.222.0.16 () {56 vars in 1102 bytes} [Thu May 26 12:21:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:10.887137 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fd66ee-0284-49c5-a31e-c104e84dbe38 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:10.898106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2848f1-dc17-4804-8037-b0e14559e262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:10.899129 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2848f1-dc17-4804-8037-b0e14559e262 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:10.899415 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2848f1-dc17-4804-8037-b0e14559e262 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:10.899695 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2848f1-dc17-4804-8037-b0e14559e262 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:10.900769 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2848f1-dc17-4804-8037-b0e14559e262 None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:10.901110 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2848f1-dc17-4804-8037-b0e14559e262 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:10.902496 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2848f1-dc17-4804-8037-b0e14559e262 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:10.910404 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 285/578] 10.222.0.16 () {56 vars in 1103 bytes} [Thu May 26 12:21:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:10.911186 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2848f1-dc17-4804-8037-b0e14559e262 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:10.934843 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:10.986953 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fd66ee-0284-49c5-a31e-c104e84dbe38 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:11.008511 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2848f1-dc17-4804-8037-b0e14559e262 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:11.019932 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750eb5b1-aaca-4e03-b6f0-ac18cd79341d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:11.020651 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750eb5b1-aaca-4e03-b6f0-ac18cd79341d None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:11.020958 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750eb5b1-aaca-4e03-b6f0-ac18cd79341d None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:11.021232 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750eb5b1-aaca-4e03-b6f0-ac18cd79341d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:11.027760 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750eb5b1-aaca-4e03-b6f0-ac18cd79341d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:11.029217 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750eb5b1-aaca-4e03-b6f0-ac18cd79341d None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:11.040202 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16497649-0e9a-468c-b0f3-fb1390bc4e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:11.040932 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16497649-0e9a-468c-b0f3-fb1390bc4e50 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:11.041152 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16497649-0e9a-468c-b0f3-fb1390bc4e50 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:11.041421 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16497649-0e9a-468c-b0f3-fb1390bc4e50 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:11.042187 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16497649-0e9a-468c-b0f3-fb1390bc4e50 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:11.042490 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16497649-0e9a-468c-b0f3-fb1390bc4e50 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:11.042995 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-750eb5b1-aaca-4e03-b6f0-ac18cd79341d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:21:11.042995 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:11.042995 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:11.042995 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:11.042995 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:11.042995 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:11.042995 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:11.042995 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:11.042995 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:11.042995 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:11.042995 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:11.042995 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:11.042995 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:21:11.042995 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:21:11.042995 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:21:11.043861 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:21:11.043861 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:11.043861 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:11.043861 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:11.043861 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:11.043861 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:11.043861 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:11.043861 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:11.043861 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:11.043861 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:11.043861 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:11.043861 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:11.043861 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:11.043861 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:11.043861 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:11.043861 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:11.043861 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:11.044863 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:21:11.044863 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:21:11.044863 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:21:11.044863 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:21:11.044863 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:21:11.044863 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:21:11.044863 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:21:11.044863 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:11.045829 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16497649-0e9a-468c-b0f3-fb1390bc4e50 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:11.045928 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 294/579] 10.222.0.16 () {56 vars in 1111 bytes} [Thu May 26 12:21:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:11.045928 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750eb5b1-aaca-4e03-b6f0-ac18cd79341d None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:11.060650 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 286/580] 10.222.0.16 () {56 vars in 1148 bytes} [Thu May 26 12:21:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:11.061478 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16497649-0e9a-468c-b0f3-fb1390bc4e50 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:11.076431 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:11.148130 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750eb5b1-aaca-4e03-b6f0-ac18cd79341d None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:11.155634 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:11.158802 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16497649-0e9a-468c-b0f3-fb1390bc4e50 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:11.183377 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0672ff33-85f0-4611-91bf-186c60ca4305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:11.184164 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672ff33-85f0-4611-91bf-186c60ca4305 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:11.184452 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672ff33-85f0-4611-91bf-186c60ca4305 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:11.184729 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672ff33-85f0-4611-91bf-186c60ca4305 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:11.191547 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e9c01-01fc-4026-b267-7ec1b0c130f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:11.192199 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e9c01-01fc-4026-b267-7ec1b0c130f1 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:11.192482 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e9c01-01fc-4026-b267-7ec1b0c130f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:11.192808 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e9c01-01fc-4026-b267-7ec1b0c130f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:11.193573 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5e9c01-01fc-4026-b267-7ec1b0c130f1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:11.193878 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5e9c01-01fc-4026-b267-7ec1b0c130f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:11.194765 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0672ff33-85f0-4611-91bf-186c60ca4305 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:11.195235 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5e9c01-01fc-4026-b267-7ec1b0c130f1 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:11.196198 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0672ff33-85f0-4611-91bf-186c60ca4305 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:11.203175 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 287/581] 10.222.0.16 () {56 vars in 1103 bytes} [Thu May 26 12:21:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:11.204039 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e9c01-01fc-4026-b267-7ec1b0c130f1 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:11.213989 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-0672ff33-85f0-4611-91bf-186c60ca4305 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:11.213989 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:11.213989 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:11.213989 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:11.213989 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:11.213989 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:11.213989 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:11.213989 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:11.213989 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:11.213989 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:11.213989 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:11.213989 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:11.213989 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:21:11.213989 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:21:11.213989 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:21:11.215055 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:21:11.215055 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:11.215055 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:11.215055 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:11.215055 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:11.215055 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:11.215055 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:11.215055 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:11.215055 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:11.215055 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:11.215055 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:11.215055 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:11.215055 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:11.215055 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:11.215055 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:11.215055 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:11.215055 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:11.221180 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:21:11.221180 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:21:11.221180 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:11.221180 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:11.221180 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 295/582] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:21:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:11.221180 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0672ff33-85f0-4611-91bf-186c60ca4305 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:11.280038 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:11.304136 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e9c01-01fc-4026-b267-7ec1b0c130f1 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:11.317588 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0672ff33-85f0-4611-91bf-186c60ca4305 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:11.340428 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd2774-443a-4c3b-bfac-8e193203a503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:11.341236 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd2774-443a-4c3b-bfac-8e193203a503 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:11.341524 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd2774-443a-4c3b-bfac-8e193203a503 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:11.341803 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd2774-443a-4c3b-bfac-8e193203a503 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:11.351117 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c272d-8fc2-4192-9fcd-3412371f60d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:11.351762 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c272d-8fc2-4192-9fcd-3412371f60d8 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:11.352043 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c272d-8fc2-4192-9fcd-3412371f60d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:11.352315 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c272d-8fc2-4192-9fcd-3412371f60d8 None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:11.352420 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd2774-443a-4c3b-bfac-8e193203a503 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:11.353144 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52c272d-8fc2-4192-9fcd-3412371f60d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:11.353450 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52c272d-8fc2-4192-9fcd-3412371f60d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:11.353805 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd2774-443a-4c3b-bfac-8e193203a503 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:11.354850 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52c272d-8fc2-4192-9fcd-3412371f60d8 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:11.366353 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 296/583] 10.222.0.16 () {56 vars in 1148 bytes} [Thu May 26 12:21:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:11.366957 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c272d-8fc2-4192-9fcd-3412371f60d8 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:11.372147 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-29cd2774-443a-4c3b-bfac-8e193203a503 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:11.372147 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:11.372147 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:11.372147 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:11.372147 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:11.372147 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:11.372147 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:11.372147 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:11.372147 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:11.372147 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:11.372147 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:11.372147 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:11.372147 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:21:11.372147 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:21:11.372147 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:21:11.373230 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:21:11.373230 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:11.373230 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:11.373230 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:11.373230 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:11.373230 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:11.373230 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:11.373230 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:11.373230 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:11.373230 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:11.373230 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:11.373230 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:11.373230 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:11.373230 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:11.373230 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:11.373230 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:11.373230 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:11.379160 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:21:11.379160 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:21:11.379160 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:11.379160 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:11.379160 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 288/584] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:21:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:11.379160 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd2774-443a-4c3b-bfac-8e193203a503 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:11.387405 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:11.467449 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c272d-8fc2-4192-9fcd-3412371f60d8 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:11.475497 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd2774-443a-4c3b-bfac-8e193203a503 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:11.500752 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:11.501301 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68ae579-ae5a-481d-aaac-35236542eb26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:11.501947 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ae579-ae5a-481d-aaac-35236542eb26 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:11.502228 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ae579-ae5a-481d-aaac-35236542eb26 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:11.502500 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ae579-ae5a-481d-aaac-35236542eb26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:11.503317 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68ae579-ae5a-481d-aaac-35236542eb26 None admin] RBAC: Adding query filter params (role.id=2991da7c6ccc478bbfdc0ce47a959495, scope.project.id=42e6c693bd224d92b8a0fe4ad0cc586d, user.id=02767dcbd1574e08a9e82a775ac2b289) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:11.503661 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68ae579-ae5a-481d-aaac-35236542eb26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:11.505272 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68ae579-ae5a-481d-aaac-35236542eb26 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:11.508722 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eeb8ab-82d3-4478-b963-a4dc6525c9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:11.509785 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eeb8ab-82d3-4478-b963-a4dc6525c9ce None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:11.510066 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eeb8ab-82d3-4478-b963-a4dc6525c9ce None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:11.510336 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eeb8ab-82d3-4478-b963-a4dc6525c9ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:11.510562 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 297/585] 10.222.0.16 () {56 vars in 1374 bytes} [Thu May 26 12:21:11 2022] GET /identity/v3/role_assignments?user.id=02767dcbd1574e08a9e82a775ac2b289&scope.project.id=42e6c693bd224d92b8a0fe4ad0cc586d&role.id=2991da7c6ccc478bbfdc0ce47a959495 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:11.511320 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68ae579-ae5a-481d-aaac-35236542eb26 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:11.529784 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eeb8ab-82d3-4478-b963-a4dc6525c9ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:11.531345 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eeb8ab-82d3-4478-b963-a4dc6525c9ce None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:11.551475 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-64eeb8ab-82d3-4478-b963-a4dc6525c9ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:11.551475 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:11.551475 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:11.551475 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:11.551475 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:11.551475 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:11.551475 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:11.551475 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:11.551475 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:11.551475 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:11.551475 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:11.551475 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:11.551475 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:21:11.551475 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:21:11.551475 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:21:11.552453 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:21:11.552453 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:11.552453 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:11.552453 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:11.552453 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:11.552453 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:11.552453 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:11.552453 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:11.552453 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:11.552453 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:11.552453 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:11.552453 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:11.552453 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:11.552453 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:11.552453 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:11.552453 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:11.552453 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:11.553404 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:21:11.553404 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:21:11.553404 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:11.553404 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:11.553404 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 289/586] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:21:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:11.554160 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eeb8ab-82d3-4478-b963-a4dc6525c9ce None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:11.603755 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:11.631860 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68ae579-ae5a-481d-aaac-35236542eb26 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:11.671528 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df47fc5f-866e-419d-a9e7-73e78f5369d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:11.672195 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47fc5f-866e-419d-a9e7-73e78f5369d4 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:11.672491 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47fc5f-866e-419d-a9e7-73e78f5369d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:11.672774 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47fc5f-866e-419d-a9e7-73e78f5369d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:11.673533 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df47fc5f-866e-419d-a9e7-73e78f5369d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:11.673835 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df47fc5f-866e-419d-a9e7-73e78f5369d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:11.675227 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df47fc5f-866e-419d-a9e7-73e78f5369d4 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:11.676372 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eeb8ab-82d3-4478-b963-a4dc6525c9ce None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:11.689549 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 298/587] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:21:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:11.691051 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df47fc5f-866e-419d-a9e7-73e78f5369d4 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:11.716926 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc269a4a-0036-4b5e-ba01-0f365f22145f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:11.718087 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc269a4a-0036-4b5e-ba01-0f365f22145f None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:11.718371 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc269a4a-0036-4b5e-ba01-0f365f22145f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:11.718646 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc269a4a-0036-4b5e-ba01-0f365f22145f None admin] PATH_INFO: `/v3/projects/42e6c693bd224d92b8a0fe4ad0cc586d/users/536f68ff77794352adf41aaacdc0645c/roles/2991da7c6ccc478bbfdc0ce47a959495` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:11.734639 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc269a4a-0036-4b5e-ba01-0f365f22145f None admin] RBAC: Authorizing `identity:create_grant(project_id=42e6c693bd224d92b8a0fe4ad0cc586d, user_id=536f68ff77794352adf41aaacdc0645c, role_id=2991da7c6ccc478bbfdc0ce47a959495)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:11.736137 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc269a4a-0036-4b5e-ba01-0f365f22145f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:11.761516 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 290/588] 10.222.0.16 () {58 vars in 1439 bytes} [Thu May 26 12:21:11 2022] PUT /identity/v3/projects/42e6c693bd224d92b8a0fe4ad0cc586d/users/536f68ff77794352adf41aaacdc0645c/roles/2991da7c6ccc478bbfdc0ce47a959495 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:21:11.761516 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc269a4a-0036-4b5e-ba01-0f365f22145f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:11.803699 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:11.846472 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df47fc5f-866e-419d-a9e7-73e78f5369d4 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:11.886441 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d4468-c01e-4e55-a95d-cd6b01082d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:11.887136 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d4468-c01e-4e55-a95d-cd6b01082d3d None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:11.887415 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d4468-c01e-4e55-a95d-cd6b01082d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:11.887688 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d4468-c01e-4e55-a95d-cd6b01082d3d None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:11.888514 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d4468-c01e-4e55-a95d-cd6b01082d3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:11.888819 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d4468-c01e-4e55-a95d-cd6b01082d3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:11.890428 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d4468-c01e-4e55-a95d-cd6b01082d3d None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:11.900963 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc269a4a-0036-4b5e-ba01-0f365f22145f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:11.905380 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 299/589] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:21:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:11.906490 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d4468-c01e-4e55-a95d-cd6b01082d3d None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:11.909796 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:11.951642 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d4034-cb6b-425d-a324-7e03349caa1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:11.952319 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d4034-cb6b-425d-a324-7e03349caa1e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:11.952612 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d4034-cb6b-425d-a324-7e03349caa1e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:11.952922 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d4034-cb6b-425d-a324-7e03349caa1e None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:11.953659 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5d4034-cb6b-425d-a324-7e03349caa1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:11.954573 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5d4034-cb6b-425d-a324-7e03349caa1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:11.956599 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5d4034-cb6b-425d-a324-7e03349caa1e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:11.970052 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 291/590] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:21:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:11.970888 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d4034-cb6b-425d-a324-7e03349caa1e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:12.024998 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d4468-c01e-4e55-a95d-cd6b01082d3d None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:12.066030 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4567c90a-13ef-495a-b590-c53f1aa844ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:12.066745 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567c90a-13ef-495a-b590-c53f1aa844ea None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:12.067024 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567c90a-13ef-495a-b590-c53f1aa844ea None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:12.067295 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567c90a-13ef-495a-b590-c53f1aa844ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:12.076088 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4567c90a-13ef-495a-b590-c53f1aa844ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:12.077745 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4567c90a-13ef-495a-b590-c53f1aa844ea None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:12.085076 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:12.096660 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-4567c90a-13ef-495a-b590-c53f1aa844ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:21:12.096660 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:12.096660 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:12.096660 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:12.096660 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:12.096660 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:12.096660 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:12.096660 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:12.096660 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:12.096660 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:12.096660 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:12.096660 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:12.096660 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:21:12.096660 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:21:12.096660 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:21:12.097592 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:21:12.097592 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:12.097592 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:12.097592 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:12.097592 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:12.097592 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:12.097592 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:12.097592 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:12.097592 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:12.097592 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:12.097592 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:12.097592 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:12.097592 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:12.097592 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:12.097592 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:12.097592 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:12.097592 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:12.098906 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:21:12.098906 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:21:12.098906 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:21:12.098906 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:21:12.098906 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:21:12.098906 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:21:12.098906 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:21:12.098906 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:12.098906 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 300/591] 10.222.0.16 () {56 vars in 1111 bytes} [Thu May 26 12:21:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:12.099422 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4567c90a-13ef-495a-b590-c53f1aa844ea None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:12.100099 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d4034-cb6b-425d-a324-7e03349caa1e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:12.140878 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea082d-add6-4c91-94df-1e66cd72961d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:12.142321 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea082d-add6-4c91-94df-1e66cd72961d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:12.142607 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea082d-add6-4c91-94df-1e66cd72961d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:12.142879 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea082d-add6-4c91-94df-1e66cd72961d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:12.150788 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ea082d-add6-4c91-94df-1e66cd72961d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:12.152347 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ea082d-add6-4c91-94df-1e66cd72961d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:12.167396 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-82ea082d-add6-4c91-94df-1e66cd72961d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 26 12:21:12.167396 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:12.167396 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:12.167396 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:12.167396 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:12.167396 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:12.167396 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:12.167396 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:12.167396 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:12.167396 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:12.167396 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:12.167396 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:12.167396 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:21:12.167396 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:21:12.167396 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:21:12.167396 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:21:12.168376 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:12.168376 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:12.168376 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:21:12.168376 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:21:12.168376 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:21:12.168376 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:21:12.168376 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:12.168376 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:12.168376 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:12.168376 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:12.168376 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:12.168376 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:12.168376 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:12.168376 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:12.168376 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:12.168376 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:12.168376 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:12.168376 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:12.170032 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:12.170032 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:12.170032 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:21:12.170032 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:21:12.170032 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:21:12.170032 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:21:12.170032 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:21:12.170032 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:21:12.170032 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 26 12:21:12.170032 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:12.173817 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 292/592] 10.222.0.16 () {56 vars in 1102 bytes} [Thu May 26 12:21:11 2022] GET /identity/v3/users/neutron => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:12.174609 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea082d-add6-4c91-94df-1e66cd72961d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:12.177108 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:12.221038 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4567c90a-13ef-495a-b590-c53f1aa844ea None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:12.259603 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a134fbaf-9c89-4855-b5c2-1afc65a4e60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:12.260936 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134fbaf-9c89-4855-b5c2-1afc65a4e60d None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:12.261426 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134fbaf-9c89-4855-b5c2-1afc65a4e60d None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:12.261938 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134fbaf-9c89-4855-b5c2-1afc65a4e60d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:12.270305 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a134fbaf-9c89-4855-b5c2-1afc65a4e60d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:12.272136 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a134fbaf-9c89-4855-b5c2-1afc65a4e60d None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:12.282725 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea082d-add6-4c91-94df-1e66cd72961d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:12.288476 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-a134fbaf-9c89-4855-b5c2-1afc65a4e60d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 12:21:12.288476 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:12.288476 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:12.288476 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:12.288476 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:12.288476 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:12.288476 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:12.288476 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:12.288476 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:12.288476 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:12.288476 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:12.288476 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:12.288476 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:21:12.288476 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:21:12.288476 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:21:12.288476 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:21:12.289623 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:12.289623 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:12.289623 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:21:12.289623 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:21:12.289623 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:21:12.289623 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:21:12.289623 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:12.289623 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:12.289623 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:12.289623 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:12.289623 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:12.289623 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:12.289623 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:12.289623 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:12.289623 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:12.289623 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:12.289623 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:12.289623 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:12.290544 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:12.290544 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:12.290544 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:21:12.290544 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:21:12.290544 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:21:12.290544 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:21:12.290544 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:21:12.290544 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:21:12.290544 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 12:21:12.290544 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:12.293328 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 301/593] 10.222.0.16 () {56 vars in 1099 bytes} [Thu May 26 12:21:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:12.294377 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a134fbaf-9c89-4855-b5c2-1afc65a4e60d None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:12.321206 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4f62bb-5942-46a3-a51a-5ea3beba54de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:12.321770 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f62bb-5942-46a3-a51a-5ea3beba54de None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:12.322051 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f62bb-5942-46a3-a51a-5ea3beba54de None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:12.322325 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f62bb-5942-46a3-a51a-5ea3beba54de None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:12.323139 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4f62bb-5942-46a3-a51a-5ea3beba54de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:12.323550 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4f62bb-5942-46a3-a51a-5ea3beba54de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:12.325214 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4f62bb-5942-46a3-a51a-5ea3beba54de None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:12.338555 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 293/594] 10.222.0.16 () {56 vars in 1148 bytes} [Thu May 26 12:21:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:12.339192 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4f62bb-5942-46a3-a51a-5ea3beba54de None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:12.356653 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:12.411594 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a134fbaf-9c89-4855-b5c2-1afc65a4e60d None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:12.436083 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:12.450229 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e97ca0-8bea-493c-a083-508b9cf87fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:12.451200 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e97ca0-8bea-493c-a083-508b9cf87fac None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:12.451682 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e97ca0-8bea-493c-a083-508b9cf87fac None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:12.451811 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4f62bb-5942-46a3-a51a-5ea3beba54de None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:12.452276 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e97ca0-8bea-493c-a083-508b9cf87fac None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:12.453524 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e97ca0-8bea-493c-a083-508b9cf87fac None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:12.454668 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e97ca0-8bea-493c-a083-508b9cf87fac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:12.456337 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e97ca0-8bea-493c-a083-508b9cf87fac None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:12.477639 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 302/595] 10.222.0.16 () {56 vars in 1139 bytes} [Thu May 26 12:21:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:12.478910 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e97ca0-8bea-493c-a083-508b9cf87fac None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:12.499798 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16d7ec-3848-4269-9da1-9d9e0a6d7970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:12.500863 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16d7ec-3848-4269-9da1-9d9e0a6d7970 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:12.501419 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16d7ec-3848-4269-9da1-9d9e0a6d7970 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:12.502154 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16d7ec-3848-4269-9da1-9d9e0a6d7970 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:12.503376 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e16d7ec-3848-4269-9da1-9d9e0a6d7970 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:12.503940 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e16d7ec-3848-4269-9da1-9d9e0a6d7970 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:12.505973 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e16d7ec-3848-4269-9da1-9d9e0a6d7970 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:12.535385 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 294/596] 10.222.0.16 () {56 vars in 1137 bytes} [Thu May 26 12:21:12 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:12.537512 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16d7ec-3848-4269-9da1-9d9e0a6d7970 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:12.611063 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e97ca0-8bea-493c-a083-508b9cf87fac None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:12.623799 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:12.655916 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac34820-c450-4a81-9e1c-24291944aa7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:12.656986 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac34820-c450-4a81-9e1c-24291944aa7e None admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:12.657280 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac34820-c450-4a81-9e1c-24291944aa7e None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:12.657831 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac34820-c450-4a81-9e1c-24291944aa7e None admin] PATH_INFO: `/v3/projects/42e6c693bd224d92b8a0fe4ad0cc586d/users/ad8cfccd3a4d42d381ce62ea90849f19/roles/2991da7c6ccc478bbfdc0ce47a959495` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:12.669972 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16d7ec-3848-4269-9da1-9d9e0a6d7970 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:12.678710 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac34820-c450-4a81-9e1c-24291944aa7e None admin] RBAC: Authorizing `identity:create_grant(project_id=42e6c693bd224d92b8a0fe4ad0cc586d, user_id=ad8cfccd3a4d42d381ce62ea90849f19, role_id=2991da7c6ccc478bbfdc0ce47a959495)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:12.680541 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac34820-c450-4a81-9e1c-24291944aa7e None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:12.698298 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 303/597] 10.222.0.16 () {58 vars in 1439 bytes} [Thu May 26 12:21:12 2022] PUT /identity/v3/projects/42e6c693bd224d92b8a0fe4ad0cc586d/users/ad8cfccd3a4d42d381ce62ea90849f19/roles/2991da7c6ccc478bbfdc0ce47a959495 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:21:12.699581 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac34820-c450-4a81-9e1c-24291944aa7e None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:12.730079 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef1305-d93c-4248-ac7a-24408417f861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:12.731260 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef1305-d93c-4248-ac7a-24408417f861 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:12.732315 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef1305-d93c-4248-ac7a-24408417f861 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:12.732821 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef1305-d93c-4248-ac7a-24408417f861 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:12.758012 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ef1305-d93c-4248-ac7a-24408417f861 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:12.762554 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ef1305-d93c-4248-ac7a-24408417f861 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:12.780800 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:12.806881 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-29ef1305-d93c-4248-ac7a-24408417f861 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:12.806881 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:12.806881 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:12.806881 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:12.806881 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:12.806881 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:12.806881 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:12.806881 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:12.806881 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:12.806881 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:12.806881 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:12.806881 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:12.806881 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:21:12.806881 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:21:12.806881 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:21:12.807875 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:21:12.807875 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:12.807875 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:12.807875 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:12.807875 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:12.807875 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:12.807875 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:12.807875 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:12.807875 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:12.807875 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:12.807875 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:12.807875 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:12.807875 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:12.807875 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:12.807875 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:12.807875 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:12.807875 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:12.808857 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:21:12.808857 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:21:12.808857 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:12.808857 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:12.814054 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 295/598] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:21:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:12.818587 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef1305-d93c-4248-ac7a-24408417f861 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:12.942642 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef1305-d93c-4248-ac7a-24408417f861 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:12.945734 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac34820-c450-4a81-9e1c-24291944aa7e None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:12.966152 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:12.987413 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa455d-6a40-4d8e-afd3-63050d738811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:12.987742 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa455d-6a40-4d8e-afd3-63050d738811 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:12.988008 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa455d-6a40-4d8e-afd3-63050d738811 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:12.988286 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa455d-6a40-4d8e-afd3-63050d738811 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:12.989402 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaa455d-6a40-4d8e-afd3-63050d738811 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:12.989715 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaa455d-6a40-4d8e-afd3-63050d738811 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:12.991486 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaa455d-6a40-4d8e-afd3-63050d738811 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:13.003775 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20ffcac-b3d3-4f9c-81b9-aa89e614f0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:13.004972 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ffcac-b3d3-4f9c-81b9-aa89e614f0a0 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:13.005453 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ffcac-b3d3-4f9c-81b9-aa89e614f0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:13.005846 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 296/599] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:21:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:13.006158 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ffcac-b3d3-4f9c-81b9-aa89e614f0a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:13.012517 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa455d-6a40-4d8e-afd3-63050d738811 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:13.023677 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20ffcac-b3d3-4f9c-81b9-aa89e614f0a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:13.025695 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20ffcac-b3d3-4f9c-81b9-aa89e614f0a0 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:13.053570 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-f20ffcac-b3d3-4f9c-81b9-aa89e614f0a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:13.053570 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:13.053570 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:13.053570 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:13.053570 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:13.053570 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:13.053570 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:13.053570 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:13.053570 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:13.053570 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:13.053570 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:13.053570 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:13.053570 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:21:13.053570 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:21:13.053570 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:21:13.054509 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:21:13.054509 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:13.054509 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:13.054509 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:13.054509 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:13.054509 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:13.054509 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:13.054509 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:13.054509 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:13.054509 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:13.054509 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:13.054509 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:13.054509 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:13.054509 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:13.054509 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:13.054509 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:13.054509 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:13.055812 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:21:13.055812 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:21:13.055812 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:13.055812 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:13.055812 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 304/600] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:21:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:13.065078 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20ffcac-b3d3-4f9c-81b9-aa89e614f0a0 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:13.184631 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa455d-6a40-4d8e-afd3-63050d738811 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:13.193971 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:13.225196 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20ffcac-b3d3-4f9c-81b9-aa89e614f0a0 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:13.249584 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523c0bf-3101-4628-ab46-398f5bad7875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:13.250385 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523c0bf-3101-4628-ab46-398f5bad7875 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:13.250690 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523c0bf-3101-4628-ab46-398f5bad7875 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:13.250971 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523c0bf-3101-4628-ab46-398f5bad7875 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:13.264242 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6523c0bf-3101-4628-ab46-398f5bad7875 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:13.265738 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6523c0bf-3101-4628-ab46-398f5bad7875 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:13.292084 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-6523c0bf-3101-4628-ab46-398f5bad7875 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:21:13.292084 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:13.292084 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:13.292084 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:13.292084 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:13.292084 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:13.292084 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:13.292084 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:13.292084 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:13.292084 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:13.292084 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:13.292084 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:13.292084 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:21:13.292084 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:21:13.292084 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:21:13.293106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:21:13.293106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:13.293106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:13.293106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:13.293106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:13.293106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:13.293106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:13.293106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:13.293106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:13.293106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:13.293106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:13.293106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:13.293106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:13.293106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:13.293106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:13.293106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:13.293106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:13.294019 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:21:13.294019 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:21:13.294019 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:21:13.294019 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:21:13.294019 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:21:13.294019 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:21:13.294019 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:21:13.294019 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:13.294479 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac0d16-0e22-41b9-8ce0-9d06fb64aebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:13.294479 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac0d16-0e22-41b9-8ce0-9d06fb64aebb None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:13.294479 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac0d16-0e22-41b9-8ce0-9d06fb64aebb None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:13.294479 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac0d16-0e22-41b9-8ce0-9d06fb64aebb None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:13.294765 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaac0d16-0e22-41b9-8ce0-9d06fb64aebb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:13.295381 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaac0d16-0e22-41b9-8ce0-9d06fb64aebb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:13.296420 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaac0d16-0e22-41b9-8ce0-9d06fb64aebb None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:13.306645 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 297/601] 10.222.0.16 () {56 vars in 1111 bytes} [Thu May 26 12:21:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:13.310090 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523c0bf-3101-4628-ab46-398f5bad7875 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:13.323234 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 305/602] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:21:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:21:13.328540 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac0d16-0e22-41b9-8ce0-9d06fb64aebb None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:13.384824 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:13.486740 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac0d16-0e22-41b9-8ce0-9d06fb64aebb None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:13.502500 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523c0bf-3101-4628-ab46-398f5bad7875 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:13.549078 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b8b9c-b7fc-4b83-90e3-4daa72997221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:13.549876 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b8b9c-b7fc-4b83-90e3-4daa72997221 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:13.550157 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b8b9c-b7fc-4b83-90e3-4daa72997221 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:13.550429 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b8b9c-b7fc-4b83-90e3-4daa72997221 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:13.561800 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952b8b9c-b7fc-4b83-90e3-4daa72997221 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:13.564929 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbaa23f-52d6-4b6f-87c9-c09efe58ea1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:13.565593 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbaa23f-52d6-4b6f-87c9-c09efe58ea1d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:13.565874 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbaa23f-52d6-4b6f-87c9-c09efe58ea1d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:13.566146 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbaa23f-52d6-4b6f-87c9-c09efe58ea1d None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:13.566936 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbaa23f-52d6-4b6f-87c9-c09efe58ea1d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:13.567242 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbaa23f-52d6-4b6f-87c9-c09efe58ea1d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:13.568663 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbaa23f-52d6-4b6f-87c9-c09efe58ea1d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:13.570357 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952b8b9c-b7fc-4b83-90e3-4daa72997221 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:13.595086 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 298/603] 10.222.0.16 () {56 vars in 1148 bytes} [Thu May 26 12:21:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:21:13.595622 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-952b8b9c-b7fc-4b83-90e3-4daa72997221 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:21:13.595622 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:13.595622 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:13.595622 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:13.595622 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:13.595622 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:13.595622 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:13.595622 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:13.595622 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:13.595622 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:13.595622 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:13.595622 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:13.595622 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:21:13.595622 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:21:13.595622 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:21:13.596535 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:21:13.596535 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:13.596535 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:13.596535 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:13.596535 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:13.596535 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:13.596535 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:13.596535 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:13.596535 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:13.596535 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:13.596535 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:13.596535 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:13.596535 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:13.596535 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:13.596535 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:13.596535 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:13.596535 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:13.597457 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:21:13.597457 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:21:13.597457 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:21:13.597457 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:21:13.597457 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:21:13.597457 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:21:13.597457 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:21:13.597457 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:13.602661 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbaa23f-52d6-4b6f-87c9-c09efe58ea1d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:13.605574 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 306/604] 10.222.0.16 () {56 vars in 1111 bytes} [Thu May 26 12:21:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:13.607501 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b8b9c-b7fc-4b83-90e3-4daa72997221 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:13.615327 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:13.759293 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b8b9c-b7fc-4b83-90e3-4daa72997221 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:13.801649 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbaa23f-52d6-4b6f-87c9-c09efe58ea1d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:13.805139 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:13.829656 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fac188-12e6-40b3-a150-ab59e6b84d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:13.830319 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fac188-12e6-40b3-a150-ab59e6b84d27 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:13.830598 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fac188-12e6-40b3-a150-ab59e6b84d27 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:13.830870 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fac188-12e6-40b3-a150-ab59e6b84d27 None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:13.831664 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fac188-12e6-40b3-a150-ab59e6b84d27 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:13.832431 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fac188-12e6-40b3-a150-ab59e6b84d27 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:13.835264 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fac188-12e6-40b3-a150-ab59e6b84d27 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:13.851281 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 307/605] 10.222.0.16 () {56 vars in 1148 bytes} [Thu May 26 12:21:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:13.852675 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6617c6-79e6-4b22-8535-116f1d0f2967 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:13.853005 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6617c6-79e6-4b22-8535-116f1d0f2967 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:13.853284 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6617c6-79e6-4b22-8535-116f1d0f2967 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:13.854741 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 308/606] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:21:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:21:13.856647 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6617c6-79e6-4b22-8535-116f1d0f2967 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:13.869933 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526ee39-8633-45e6-8140-4c1e1bdf3f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:13.870831 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526ee39-8633-45e6-8140-4c1e1bdf3f5a None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:13.871529 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526ee39-8633-45e6-8140-4c1e1bdf3f5a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:13.871811 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526ee39-8633-45e6-8140-4c1e1bdf3f5a None admin] PATH_INFO: `/v3/projects/42e6c693bd224d92b8a0fe4ad0cc586d/users/68033ffcafbc47bbadd008abd9e56c4b/roles/2991da7c6ccc478bbfdc0ce47a959495` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:13.890993 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0526ee39-8633-45e6-8140-4c1e1bdf3f5a None admin] RBAC: Authorizing `identity:create_grant(project_id=42e6c693bd224d92b8a0fe4ad0cc586d, user_id=68033ffcafbc47bbadd008abd9e56c4b, role_id=2991da7c6ccc478bbfdc0ce47a959495)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:13.893750 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0526ee39-8633-45e6-8140-4c1e1bdf3f5a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:13.916924 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 299/607] 10.222.0.16 () {58 vars in 1439 bytes} [Thu May 26 12:21:13 2022] PUT /identity/v3/projects/42e6c693bd224d92b8a0fe4ad0cc586d/users/68033ffcafbc47bbadd008abd9e56c4b/roles/2991da7c6ccc478bbfdc0ce47a959495 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:21:13.918532 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc434ab7-e0d3-41f4-8f1b-2f51bee5ff5b None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:13.918830 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc434ab7-e0d3-41f4-8f1b-2f51bee5ff5b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:13.919163 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc434ab7-e0d3-41f4-8f1b-2f51bee5ff5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:13.963270 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-dc434ab7-e0d3-41f4-8f1b-2f51bee5ff5b None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:21:13.967650 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:13.968447 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-dc434ab7-e0d3-41f4-8f1b-2f51bee5ff5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:21:14.051084 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6617c6-79e6-4b22-8535-116f1d0f2967 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:14.092826 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ceffb-b6dd-49b0-9e44-8b15f6db8b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:14.093760 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ceffb-b6dd-49b0-9e44-8b15f6db8b3f None admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:14.094043 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ceffb-b6dd-49b0-9e44-8b15f6db8b3f None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:14.094322 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ceffb-b6dd-49b0-9e44-8b15f6db8b3f None admin] PATH_INFO: `/v3/projects/42e6c693bd224d92b8a0fe4ad0cc586d/users/736554efeba94a0b9547d18c3fc84fec/roles/2991da7c6ccc478bbfdc0ce47a959495` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:14.112943 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61ceffb-b6dd-49b0-9e44-8b15f6db8b3f None admin] RBAC: Authorizing `identity:create_grant(project_id=42e6c693bd224d92b8a0fe4ad0cc586d, user_id=736554efeba94a0b9547d18c3fc84fec, role_id=2991da7c6ccc478bbfdc0ce47a959495)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:14.114964 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61ceffb-b6dd-49b0-9e44-8b15f6db8b3f None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:14.123378 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 300/608] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:21:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:21:14.124883 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f99277-1f84-4373-acf9-d4991680a4fa None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:14.125185 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f99277-1f84-4373-acf9-d4991680a4fa None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:14.125466 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f99277-1f84-4373-acf9-d4991680a4fa None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:14.131876 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 301/609] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:21:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:21:14.133266 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf91930f-8c69-4c92-a6c3-0f0d97fcb1a5 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:14.133556 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf91930f-8c69-4c92-a6c3-0f0d97fcb1a5 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:14.133838 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf91930f-8c69-4c92-a6c3-0f0d97fcb1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:14.139546 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 309/610] 10.222.0.16 () {58 vars in 1439 bytes} [Thu May 26 12:21:13 2022] PUT /identity/v3/projects/42e6c693bd224d92b8a0fe4ad0cc586d/users/736554efeba94a0b9547d18c3fc84fec/roles/2991da7c6ccc478bbfdc0ce47a959495 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:21:14.153464 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-bf91930f-8c69-4c92-a6c3-0f0d97fcb1a5 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:21:14.154818 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-bf91930f-8c69-4c92-a6c3-0f0d97fcb1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:21:14.159635 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ceffb-b6dd-49b0-9e44-8b15f6db8b3f None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:14.258445 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 302/611] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:21:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:21:14.291700 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf91930f-8c69-4c92-a6c3-0f0d97fcb1a5 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:14.293332 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ceffb-b6dd-49b0-9e44-8b15f6db8b3f None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:14.307002 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:14.316405 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:14.361691 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395552d-7146-4469-8676-facbd20128ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:14.362507 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395552d-7146-4469-8676-facbd20128ef None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:14.362794 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395552d-7146-4469-8676-facbd20128ef None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:14.363070 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395552d-7146-4469-8676-facbd20128ef None admin] PATH_INFO: `/v3/roles/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:14.374084 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6395552d-7146-4469-8676-facbd20128ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:21:14.382481 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-6395552d-7146-4469-8676-facbd20128ef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:21:14.382481 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:14.382481 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:14.382481 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:14.382481 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:14.382481 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:14.382481 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:14.382481 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:14.382481 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:14.382481 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:14.382481 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:14.382481 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:14.382481 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:21:14.382481 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:21:14.382481 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:21:14.382481 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:21:14.383425 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:21:14.383425 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:21:14.383425 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:21:14.383425 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:21:14.383425 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:14.383425 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:14.383425 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:14.383425 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:14.383425 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:14.383425 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:14.383425 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:14.383425 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:14.383425 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:14.383425 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:14.383425 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:14.383425 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:14.384999 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:14.384999 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:14.384999 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:14.384999 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:14.384999 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:21:14.384999 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:21:14.384999 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:21:14.384999 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:21:14.384999 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:21:14.384999 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:21:14.384999 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:21:14.384999 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:14.384999 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 310/612] 10.222.0.16 () {56 vars in 1102 bytes} [Thu May 26 12:21:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:21:14.397913 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395552d-7146-4469-8676-facbd20128ef None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:14.416830 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf91930f-8c69-4c92-a6c3-0f0d97fcb1a5 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:14.472728 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323fbc88-53cc-4244-b68f-75e095d6b453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:14.473751 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323fbc88-53cc-4244-b68f-75e095d6b453 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:14.474032 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323fbc88-53cc-4244-b68f-75e095d6b453 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:14.474305 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323fbc88-53cc-4244-b68f-75e095d6b453 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:14.494350 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323fbc88-53cc-4244-b68f-75e095d6b453 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:21:14.510320 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-323fbc88-53cc-4244-b68f-75e095d6b453 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:21:14.510320 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:14.510320 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:14.510320 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:14.510320 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:14.510320 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:14.510320 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:14.510320 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:14.510320 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:14.510320 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:14.510320 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:14.510320 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:14.510320 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:21:14.510320 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:21:14.510320 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:21:14.510320 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:21:14.512522 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:21:14.512522 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:21:14.512522 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:21:14.512522 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:21:14.512522 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:14.512522 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:14.512522 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:14.512522 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:14.512522 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:14.512522 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:14.512522 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:14.512522 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:14.512522 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:14.512522 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:14.512522 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:14.512522 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:14.514569 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:14.514569 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:14.514569 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:14.514569 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:14.514569 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:21:14.514569 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:21:14.514569 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:21:14.514569 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:21:14.514569 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:21:14.514569 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:21:14.514569 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:21:14.514569 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:14.514569 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 303/613] 10.222.0.16 () {56 vars in 1102 bytes} [Thu May 26 12:21:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:14.522552 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323fbc88-53cc-4244-b68f-75e095d6b453 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:14.541444 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395552d-7146-4469-8676-facbd20128ef None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:14.578689 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2acd835-d573-4aee-a00a-c426bfd86899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:14.579781 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acd835-d573-4aee-a00a-c426bfd86899 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:14.580357 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acd835-d573-4aee-a00a-c426bfd86899 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:14.580865 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acd835-d573-4aee-a00a-c426bfd86899 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:14.581815 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2acd835-d573-4aee-a00a-c426bfd86899 None admin] RBAC: Adding query filter params (name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:14.582303 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2acd835-d573-4aee-a00a-c426bfd86899 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:14.584084 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2acd835-d573-4aee-a00a-c426bfd86899 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:14.593296 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 311/614] 10.222.0.16 () {56 vars in 1103 bytes} [Thu May 26 12:21:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:14.599271 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2acd835-d573-4aee-a00a-c426bfd86899 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:14.651414 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:14.653199 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:14.707275 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323fbc88-53cc-4244-b68f-75e095d6b453 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:14.742691 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b2bb4-24fc-4548-abfa-b984a041c2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:14.743361 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b2bb4-24fc-4548-abfa-b984a041c2af None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:14.743648 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b2bb4-24fc-4548-abfa-b984a041c2af None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:14.743922 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b2bb4-24fc-4548-abfa-b984a041c2af None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:14.744677 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460b2bb4-24fc-4548-abfa-b984a041c2af None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:14.745015 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460b2bb4-24fc-4548-abfa-b984a041c2af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:14.746396 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460b2bb4-24fc-4548-abfa-b984a041c2af None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:14.760865 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 304/615] 10.222.0.16 () {56 vars in 1103 bytes} [Thu May 26 12:21:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:14.763794 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b2bb4-24fc-4548-abfa-b984a041c2af None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:14.789909 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2acd835-d573-4aee-a00a-c426bfd86899 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:14.857469 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd89b1-4a89-420e-bad0-cd0f7bae846c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:14.858177 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd89b1-4a89-420e-bad0-cd0f7bae846c None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:14.858460 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd89b1-4a89-420e-bad0-cd0f7bae846c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:14.858733 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd89b1-4a89-420e-bad0-cd0f7bae846c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:14.881419 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cd89b1-4a89-420e-bad0-cd0f7bae846c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:14.882883 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cd89b1-4a89-420e-bad0-cd0f7bae846c None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:14.919837 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-d9cd89b1-4a89-420e-bad0-cd0f7bae846c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:14.919837 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:14.919837 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:14.919837 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:14.919837 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:14.919837 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:14.919837 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:14.919837 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:14.919837 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:14.919837 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:14.919837 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:14.919837 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:14.919837 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:21:14.919837 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:21:14.919837 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:21:14.920812 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:21:14.920812 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:14.920812 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:14.920812 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:14.920812 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:14.920812 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:14.920812 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:14.920812 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:14.920812 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:14.920812 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:14.920812 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:14.920812 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:14.920812 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:14.920812 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:14.920812 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:14.920812 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:14.920812 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:14.921723 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:21:14.921723 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:21:14.921723 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:14.921723 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:14.926419 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 312/616] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:21:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:21:14.933116 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd89b1-4a89-420e-bad0-cd0f7bae846c None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:14.964651 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b2bb4-24fc-4548-abfa-b984a041c2af None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:15.025280 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:15.037124 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b90a2f-bac6-4da9-aa52-78f241e3a5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:15.037921 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b90a2f-bac6-4da9-aa52-78f241e3a5e7 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:15.038245 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b90a2f-bac6-4da9-aa52-78f241e3a5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:15.038582 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b90a2f-bac6-4da9-aa52-78f241e3a5e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:15.058500 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b90a2f-bac6-4da9-aa52-78f241e3a5e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:15.059979 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b90a2f-bac6-4da9-aa52-78f241e3a5e7 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:15.091738 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-38b90a2f-bac6-4da9-aa52-78f241e3a5e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:15.091738 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:15.091738 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:15.091738 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:15.091738 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:15.091738 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:15.091738 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:15.091738 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:15.091738 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:15.091738 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:15.091738 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:15.091738 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:15.091738 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:21:15.091738 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:21:15.091738 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:21:15.092989 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:21:15.092989 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:15.092989 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:15.092989 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:15.092989 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:15.092989 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:15.092989 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:15.092989 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:15.092989 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:15.092989 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:15.092989 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:15.092989 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:15.092989 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:15.092989 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:15.092989 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:15.092989 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:15.092989 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:15.093902 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:21:15.093902 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:21:15.093902 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:15.093902 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:15.100562 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 305/617] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:21:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:15.106096 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b90a2f-bac6-4da9-aa52-78f241e3a5e7 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:15.107917 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:15.137258 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd89b1-4a89-420e-bad0-cd0f7bae846c None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:15.205526 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c250cb-3aa7-4285-858c-23880b2db808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:15.206218 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c250cb-3aa7-4285-858c-23880b2db808 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:15.206561 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c250cb-3aa7-4285-858c-23880b2db808 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:15.206831 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c250cb-3aa7-4285-858c-23880b2db808 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:15.207585 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c250cb-3aa7-4285-858c-23880b2db808 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:15.207894 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c250cb-3aa7-4285-858c-23880b2db808 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:15.209348 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c250cb-3aa7-4285-858c-23880b2db808 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:15.240829 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 313/618] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:21:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:15.248445 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c250cb-3aa7-4285-858c-23880b2db808 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:15.310438 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b90a2f-bac6-4da9-aa52-78f241e3a5e7 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:15.374441 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6e9811-7516-445f-bea1-f46d0dfd2810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:15.375026 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e9811-7516-445f-bea1-f46d0dfd2810 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:15.375311 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e9811-7516-445f-bea1-f46d0dfd2810 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:15.375590 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e9811-7516-445f-bea1-f46d0dfd2810 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:15.376380 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6e9811-7516-445f-bea1-f46d0dfd2810 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:15.376687 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6e9811-7516-445f-bea1-f46d0dfd2810 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:15.378109 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6e9811-7516-445f-bea1-f46d0dfd2810 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:15.402322 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 306/619] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:21:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:15.408360 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6e9811-7516-445f-bea1-f46d0dfd2810 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:15.418704 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c250cb-3aa7-4285-858c-23880b2db808 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:15.459304 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c424d16-3fcc-46c6-acf0-61bf3b933755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:15.460302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:15.460746 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c424d16-3fcc-46c6-acf0-61bf3b933755 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:15.460746 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c424d16-3fcc-46c6-acf0-61bf3b933755 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:15.461045 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c424d16-3fcc-46c6-acf0-61bf3b933755 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:15.471432 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c424d16-3fcc-46c6-acf0-61bf3b933755 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:15.472982 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c424d16-3fcc-46c6-acf0-61bf3b933755 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:15.494278 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-3c424d16-3fcc-46c6-acf0-61bf3b933755 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 12:21:15.494278 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:15.494278 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:15.494278 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:15.494278 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:15.494278 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:15.494278 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:15.494278 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:15.494278 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:15.494278 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:15.494278 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:15.494278 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:15.494278 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:21:15.494278 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:21:15.494278 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:21:15.494278 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:21:15.495316 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:15.495316 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:15.495316 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:21:15.495316 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:21:15.495316 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:21:15.495316 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:21:15.495316 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:15.495316 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:15.495316 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:15.495316 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:15.495316 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:15.495316 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:15.495316 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:15.495316 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:15.495316 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:15.495316 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:15.495316 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:15.495316 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:15.496295 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:15.496295 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:15.496295 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:21:15.496295 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:21:15.496295 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:21:15.496295 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:21:15.496295 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:21:15.496295 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:21:15.496295 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 12:21:15.496295 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:15.496295 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 314/620] 10.222.0.16 () {56 vars in 1096 bytes} [Thu May 26 12:21:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:15.501235 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47331b23-b9a0-4c1c-ac07-9b6dd0a151ab None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:15.501960 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47331b23-b9a0-4c1c-ac07-9b6dd0a151ab None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:15.502623 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47331b23-b9a0-4c1c-ac07-9b6dd0a151ab None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:15.504866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 315/621] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:21:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:21:15.508971 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47331b23-b9a0-4c1c-ac07-9b6dd0a151ab None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:15.526432 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:15.552500 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6e9811-7516-445f-bea1-f46d0dfd2810 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:15.598735 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3fcb0b-4c6b-469b-a973-44e385d05134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:15.600170 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3fcb0b-4c6b-469b-a973-44e385d05134 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:15.601236 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3fcb0b-4c6b-469b-a973-44e385d05134 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:15.601515 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3fcb0b-4c6b-469b-a973-44e385d05134 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:15.614525 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3fcb0b-4c6b-469b-a973-44e385d05134 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:15.616813 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3fcb0b-4c6b-469b-a973-44e385d05134 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:15.634975 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47331b23-b9a0-4c1c-ac07-9b6dd0a151ab None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:15.636979 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-7c3fcb0b-4c6b-469b-a973-44e385d05134 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 12:21:15.636979 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:15.636979 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:15.636979 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:15.636979 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:15.636979 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:15.636979 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:15.636979 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:15.636979 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:15.636979 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:15.636979 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:15.636979 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:15.636979 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:21:15.636979 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:21:15.636979 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:21:15.636979 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:21:15.637892 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:15.637892 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:15.637892 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:21:15.637892 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:21:15.637892 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:21:15.637892 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:21:15.637892 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:15.637892 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:15.637892 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:15.637892 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:15.637892 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:15.637892 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:15.637892 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:15.637892 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:15.637892 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:15.637892 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:15.637892 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:15.637892 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:15.638832 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:15.638832 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:15.638832 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:21:15.638832 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:21:15.638832 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:21:15.638832 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:21:15.638832 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:21:15.638832 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:21:15.638832 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 12:21:15.638832 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:15.647316 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 307/622] 10.222.0.16 () {56 vars in 1093 bytes} [Thu May 26 12:21:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:15.649222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3bdcf6-12ec-49f5-9fc2-8c4f126ad261 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:15.649667 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3bdcf6-12ec-49f5-9fc2-8c4f126ad261 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:15.650094 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3bdcf6-12ec-49f5-9fc2-8c4f126ad261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:15.671591 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-3b3bdcf6-12ec-49f5-9fc2-8c4f126ad261 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:21:15.673914 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3b3bdcf6-12ec-49f5-9fc2-8c4f126ad261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:21:15.678809 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ccec9-d171-4610-b96c-c12f430be522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:15.679582 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ccec9-d171-4610-b96c-c12f430be522 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:15.680015 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ccec9-d171-4610-b96c-c12f430be522 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:15.680378 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ccec9-d171-4610-b96c-c12f430be522 None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:15.681414 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39ccec9-d171-4610-b96c-c12f430be522 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:15.681818 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39ccec9-d171-4610-b96c-c12f430be522 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:15.683891 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39ccec9-d171-4610-b96c-c12f430be522 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:15.712927 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 316/623] 10.222.0.16 () {56 vars in 1135 bytes} [Thu May 26 12:21:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:15.712927 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ccec9-d171-4610-b96c-c12f430be522 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:15.771232 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 308/624] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:21:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:21:15.771232 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3bdcf6-12ec-49f5-9fc2-8c4f126ad261 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:15.800495 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:15.832084 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:15.846466 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ccec9-d171-4610-b96c-c12f430be522 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:15.885539 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d3b54d-5fd4-4cb3-b336-96dea24e1c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:15.887309 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3b54d-5fd4-4cb3-b336-96dea24e1c05 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:15.887763 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3b54d-5fd4-4cb3-b336-96dea24e1c05 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:15.888190 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3b54d-5fd4-4cb3-b336-96dea24e1c05 None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:15.889229 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d3b54d-5fd4-4cb3-b336-96dea24e1c05 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:15.889707 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d3b54d-5fd4-4cb3-b336-96dea24e1c05 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:15.891957 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d3b54d-5fd4-4cb3-b336-96dea24e1c05 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:15.916774 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 317/625] 10.222.0.16 () {56 vars in 1133 bytes} [Thu May 26 12:21:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:15.917911 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d3b54d-5fd4-4cb3-b336-96dea24e1c05 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:15.925658 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3bdcf6-12ec-49f5-9fc2-8c4f126ad261 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:15.962033 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187be249-41af-446a-9151-4fedd36af56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:15.962931 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187be249-41af-446a-9151-4fedd36af56a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:15.963882 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187be249-41af-446a-9151-4fedd36af56a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:15.963882 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187be249-41af-446a-9151-4fedd36af56a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:15.975583 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187be249-41af-446a-9151-4fedd36af56a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:15.977197 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187be249-41af-446a-9151-4fedd36af56a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:15.997004 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-187be249-41af-446a-9151-4fedd36af56a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:15.997004 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:15.997004 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:15.997004 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:15.997004 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:15.997004 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:15.997004 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:15.997004 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:15.997004 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:15.997004 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:15.997004 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:15.997004 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:15.997004 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:21:15.997004 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:21:15.997004 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:21:15.998170 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:21:15.998170 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:15.998170 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:15.998170 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:15.998170 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:15.998170 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:15.998170 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:15.998170 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:15.998170 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:15.998170 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:15.998170 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:15.998170 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:15.998170 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:15.998170 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:15.998170 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:15.998170 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:15.998170 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:15.999273 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:21:15.999273 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:21:15.999273 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:15.999273 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:16.004280 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 309/626] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:21:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:16.004280 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187be249-41af-446a-9151-4fedd36af56a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:16.058330 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d3b54d-5fd4-4cb3-b336-96dea24e1c05 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:16.082259 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:16.096467 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b13741-9ee0-401b-b145-8b7f91a8a9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:16.097479 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b13741-9ee0-401b-b145-8b7f91a8a9ea None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:16.097822 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b13741-9ee0-401b-b145-8b7f91a8a9ea None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:16.098172 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b13741-9ee0-401b-b145-8b7f91a8a9ea None admin] PATH_INFO: `/v3/roles/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:16.105600 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:16.112052 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b13741-9ee0-401b-b145-8b7f91a8a9ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:21:16.120953 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-c5b13741-9ee0-401b-b145-8b7f91a8a9ea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:21:16.120953 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:16.120953 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:16.120953 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:16.120953 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:16.120953 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:16.120953 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:16.120953 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:16.120953 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:16.120953 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:16.120953 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:16.120953 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:16.120953 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:21:16.120953 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:21:16.120953 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:21:16.120953 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:21:16.122134 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:21:16.122134 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:21:16.122134 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:21:16.122134 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:21:16.122134 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:16.122134 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:16.122134 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:16.122134 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:16.122134 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:16.122134 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:16.122134 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:16.122134 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:16.122134 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:16.122134 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:16.122134 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:16.122134 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:16.123261 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:16.123261 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:16.123261 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:16.123261 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:16.123261 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:21:16.123261 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:21:16.123261 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:21:16.123261 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:21:16.123261 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:21:16.123261 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:21:16.123261 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:21:16.123261 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:16.125833 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187be249-41af-446a-9151-4fedd36af56a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:16.129522 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 318/627] 10.222.0.16 () {56 vars in 1102 bytes} [Thu May 26 12:21:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:16.130107 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b13741-9ee0-401b-b145-8b7f91a8a9ea None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:16.162647 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c8032-7bbc-42d1-aade-446ec3360741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:16.163660 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c8032-7bbc-42d1-aade-446ec3360741 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:16.164129 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c8032-7bbc-42d1-aade-446ec3360741 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:16.164677 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c8032-7bbc-42d1-aade-446ec3360741 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:16.237217 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0c8032-7bbc-42d1-aade-446ec3360741 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:16.239060 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0c8032-7bbc-42d1-aade-446ec3360741 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:16.239475 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b13741-9ee0-401b-b145-8b7f91a8a9ea None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:16.278439 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dfea6f-6fd2-4010-8873-2c17c5ecc72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:16.279113 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfea6f-6fd2-4010-8873-2c17c5ecc72d None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:16.279392 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfea6f-6fd2-4010-8873-2c17c5ecc72d None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:16.279663 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfea6f-6fd2-4010-8873-2c17c5ecc72d None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:16.280406 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dfea6f-6fd2-4010-8873-2c17c5ecc72d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:16.280733 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dfea6f-6fd2-4010-8873-2c17c5ecc72d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:16.282360 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dfea6f-6fd2-4010-8873-2c17c5ecc72d None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:16.302317 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 319/628] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:21:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:16.303326 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dfea6f-6fd2-4010-8873-2c17c5ecc72d None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:16.334151 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:16.351939 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 310/629] 10.222.0.16 () {58 vars in 1282 bytes} [Thu May 26 12:21:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:21:16.353091 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c8032-7bbc-42d1-aade-446ec3360741 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:16.361531 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:16.431169 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dfea6f-6fd2-4010-8873-2c17c5ecc72d None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:16.461116 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c8032-7bbc-42d1-aade-446ec3360741 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:16.472194 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4bd10-1bc2-4304-b438-2a1bef0c5402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:16.473354 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4bd10-1bc2-4304-b438-2a1bef0c5402 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:16.473639 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4bd10-1bc2-4304-b438-2a1bef0c5402 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:16.473913 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4bd10-1bc2-4304-b438-2a1bef0c5402 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:16.474666 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea4bd10-1bc2-4304-b438-2a1bef0c5402 None admin] RBAC: Adding query filter params (name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:16.474969 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea4bd10-1bc2-4304-b438-2a1bef0c5402 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:16.476423 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea4bd10-1bc2-4304-b438-2a1bef0c5402 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:16.485489 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 320/630] 10.222.0.16 () {56 vars in 1103 bytes} [Thu May 26 12:21:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:16.486299 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4bd10-1bc2-4304-b438-2a1bef0c5402 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:16.500633 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2690dd1c-cb66-4c03-b11d-53be63e8a510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:16.502357 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690dd1c-cb66-4c03-b11d-53be63e8a510 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:16.502845 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690dd1c-cb66-4c03-b11d-53be63e8a510 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:16.503312 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690dd1c-cb66-4c03-b11d-53be63e8a510 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:16.511226 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2690dd1c-cb66-4c03-b11d-53be63e8a510 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:16.512939 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2690dd1c-cb66-4c03-b11d-53be63e8a510 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:16.527403 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-2690dd1c-cb66-4c03-b11d-53be63e8a510 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:21:16.527403 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:16.527403 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:16.527403 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:16.527403 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:16.527403 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:16.527403 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:16.527403 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:16.527403 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:16.527403 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:16.527403 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:16.527403 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:16.527403 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:21:16.527403 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:21:16.527403 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:21:16.528302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:21:16.528302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:16.528302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:16.528302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:16.528302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:16.528302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:16.528302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:16.528302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:16.528302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:16.528302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:16.528302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:16.528302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:16.528302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:16.528302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:16.528302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:16.528302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:16.528302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:16.529244 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:21:16.529244 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:21:16.529244 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:21:16.529244 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:21:16.529244 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:21:16.529244 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:21:16.529244 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:21:16.529244 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:16.529244 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 311/631] 10.222.0.16 () {56 vars in 1111 bytes} [Thu May 26 12:21:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:16.530049 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332ebeb-cb7a-4731-8441-3ad084390b5d None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:16.530049 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332ebeb-cb7a-4731-8441-3ad084390b5d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:16.530326 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332ebeb-cb7a-4731-8441-3ad084390b5d None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:16.531710 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 312/632] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:21:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:21:16.532250 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1332ebeb-cb7a-4731-8441-3ad084390b5d None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:16.582817 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:16.602276 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4bd10-1bc2-4304-b438-2a1bef0c5402 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:16.606181 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:16.639006 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02f4b1-9abd-4b71-8516-7cfca6ccba12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:16.639796 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02f4b1-9abd-4b71-8516-7cfca6ccba12 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:16.640079 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02f4b1-9abd-4b71-8516-7cfca6ccba12 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:16.640325 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1332ebeb-cb7a-4731-8441-3ad084390b5d None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:16.640441 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02f4b1-9abd-4b71-8516-7cfca6ccba12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:16.651284 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f02f4b1-9abd-4b71-8516-7cfca6ccba12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:16.652726 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f02f4b1-9abd-4b71-8516-7cfca6ccba12 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:16.669533 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-6f02f4b1-9abd-4b71-8516-7cfca6ccba12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:16.669533 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:16.669533 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:16.669533 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:16.669533 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:16.669533 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:16.669533 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:16.669533 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:16.669533 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:16.669533 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:16.669533 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:16.669533 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:16.669533 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:21:16.669533 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:21:16.669533 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:21:16.670428 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:21:16.670428 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:16.670428 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:16.670428 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:16.670428 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:16.670428 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:16.670428 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:16.670428 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:16.670428 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:16.670428 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:16.670428 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:16.670428 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:16.670428 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:16.670428 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:16.670428 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:16.670428 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:16.670428 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:16.671329 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:21:16.671329 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:21:16.671329 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:16.671329 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:16.671329 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 321/633] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:21:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:16.671614 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02f4b1-9abd-4b71-8516-7cfca6ccba12 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:16.677985 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93cd4db-55f8-4226-871c-15f025810856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:16.678776 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93cd4db-55f8-4226-871c-15f025810856 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:16.679055 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93cd4db-55f8-4226-871c-15f025810856 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:16.679328 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93cd4db-55f8-4226-871c-15f025810856 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:16.690310 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93cd4db-55f8-4226-871c-15f025810856 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:16.691689 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93cd4db-55f8-4226-871c-15f025810856 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:16.708410 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-a93cd4db-55f8-4226-871c-15f025810856 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:16.708410 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:16.708410 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:16.708410 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:16.708410 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:16.708410 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:16.708410 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:16.708410 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:16.708410 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:16.708410 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:16.708410 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:16.708410 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:16.708410 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:21:16.708410 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:21:16.708410 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:21:16.709385 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:21:16.709385 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:16.709385 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:16.709385 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:16.709385 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:16.709385 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:16.709385 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:16.709385 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:16.709385 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:16.709385 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:16.709385 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:16.709385 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:16.709385 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:16.709385 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:16.709385 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:16.709385 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:16.709385 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:16.715381 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:21:16.715381 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:21:16.715381 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:16.715381 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:16.715381 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 313/634] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:21:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:16.715381 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad00ae6-a3bb-43d6-8d15-3074a0d92dfe None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:16.715381 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad00ae6-a3bb-43d6-8d15-3074a0d92dfe None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:16.715381 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad00ae6-a3bb-43d6-8d15-3074a0d92dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:16.727598 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-4ad00ae6-a3bb-43d6-8d15-3074a0d92dfe None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:21:16.728776 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4ad00ae6-a3bb-43d6-8d15-3074a0d92dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:21:16.775013 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02f4b1-9abd-4b71-8516-7cfca6ccba12 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:16.795052 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 314/635] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:21:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:21:16.796543 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa14838-987a-4c75-bbec-55066d3dfa09 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:16.796857 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa14838-987a-4c75-bbec-55066d3dfa09 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:16.797145 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa14838-987a-4c75-bbec-55066d3dfa09 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:16.798955 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 315/636] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:21:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:21:16.799632 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa14838-987a-4c75-bbec-55066d3dfa09 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:16.815566 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a5b56-d9cc-4d2d-8dfe-457f18520de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:16.816231 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a5b56-d9cc-4d2d-8dfe-457f18520de7 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:16.816518 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a5b56-d9cc-4d2d-8dfe-457f18520de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:16.816815 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a5b56-d9cc-4d2d-8dfe-457f18520de7 None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:16.817633 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0a5b56-d9cc-4d2d-8dfe-457f18520de7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:16.817940 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0a5b56-d9cc-4d2d-8dfe-457f18520de7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:16.819367 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0a5b56-d9cc-4d2d-8dfe-457f18520de7 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:16.831833 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 322/637] 10.222.0.16 () {56 vars in 1148 bytes} [Thu May 26 12:21:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:16.832741 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a5b56-d9cc-4d2d-8dfe-457f18520de7 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:16.837193 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:16.850504 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:16.911499 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa14838-987a-4c75-bbec-55066d3dfa09 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:16.933250 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a5b56-d9cc-4d2d-8dfe-457f18520de7 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:16.945099 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d446385-cff2-48ce-8ace-4527e6e6bef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:16.945692 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d446385-cff2-48ce-8ace-4527e6e6bef5 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:16.945974 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d446385-cff2-48ce-8ace-4527e6e6bef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:16.946249 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d446385-cff2-48ce-8ace-4527e6e6bef5 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:16.946969 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d446385-cff2-48ce-8ace-4527e6e6bef5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:16.947529 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d446385-cff2-48ce-8ace-4527e6e6bef5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:16.948639 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d446385-cff2-48ce-8ace-4527e6e6bef5 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:16.959634 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 316/638] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:21:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:16.960920 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f595840-0e29-4c5a-9f52-6b5f50d12569 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:16.961189 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f595840-0e29-4c5a-9f52-6b5f50d12569 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:16.961471 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f595840-0e29-4c5a-9f52-6b5f50d12569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:16.967036 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca63b41-574e-42e5-9833-72911c131cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:16.967964 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca63b41-574e-42e5-9833-72911c131cda None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:16.968249 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca63b41-574e-42e5-9833-72911c131cda None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:16.968527 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca63b41-574e-42e5-9833-72911c131cda None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:16.969277 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca63b41-574e-42e5-9833-72911c131cda None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:16.969585 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca63b41-574e-42e5-9833-72911c131cda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:16.970938 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca63b41-574e-42e5-9833-72911c131cda None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:16.978862 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-0f595840-0e29-4c5a-9f52-6b5f50d12569 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:21:16.980053 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0f595840-0e29-4c5a-9f52-6b5f50d12569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:21:16.982444 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 323/639] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:21:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:16.983049 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca63b41-574e-42e5-9833-72911c131cda None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:17.045246 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 317/640] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:21:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:21:17.046043 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f595840-0e29-4c5a-9f52-6b5f50d12569 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:17.059132 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:17.074755 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:17.083487 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca63b41-574e-42e5-9833-72911c131cda None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:17.118009 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7bf502-b75c-4fd5-84b4-4aed332d1b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:17.118787 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7bf502-b75c-4fd5-84b4-4aed332d1b8e None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:17.119075 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7bf502-b75c-4fd5-84b4-4aed332d1b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:17.119354 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7bf502-b75c-4fd5-84b4-4aed332d1b8e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:17.129405 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7bf502-b75c-4fd5-84b4-4aed332d1b8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:21:17.137035 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-2a7bf502-b75c-4fd5-84b4-4aed332d1b8e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:21:17.137035 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:17.137035 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:17.137035 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:17.137035 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:17.137035 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:17.137035 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:17.137035 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:17.137035 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:17.137035 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:17.137035 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:17.137035 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:17.137035 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:21:17.137035 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:21:17.137035 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:21:17.137035 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:21:17.137979 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:21:17.137979 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:21:17.137979 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:21:17.137979 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:21:17.137979 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:17.137979 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:17.137979 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:17.137979 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:17.137979 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:17.137979 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:17.137979 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:17.137979 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:17.137979 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:17.137979 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:17.137979 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:17.137979 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:17.138809 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:17.138809 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:17.138809 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:17.138809 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:17.138809 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:21:17.138809 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:21:17.138809 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:21:17.138809 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:21:17.138809 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:21:17.138809 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:21:17.138809 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:21:17.138809 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:17.138809 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 324/641] 10.222.0.16 () {56 vars in 1102 bytes} [Thu May 26 12:21:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:17.139924 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7bf502-b75c-4fd5-84b4-4aed332d1b8e None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:17.158913 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f595840-0e29-4c5a-9f52-6b5f50d12569 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:17.191923 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab8982f-71ad-496c-ad49-d9b59a62be87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:17.192872 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab8982f-71ad-496c-ad49-d9b59a62be87 None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:17.193161 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab8982f-71ad-496c-ad49-d9b59a62be87 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:17.193440 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab8982f-71ad-496c-ad49-d9b59a62be87 None admin] PATH_INFO: `/v3/projects/42e6c693bd224d92b8a0fe4ad0cc586d/users/02767dcbd1574e08a9e82a775ac2b289/roles/2991da7c6ccc478bbfdc0ce47a959495` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:17.207434 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab8982f-71ad-496c-ad49-d9b59a62be87 None admin] RBAC: Authorizing `identity:create_grant(project_id=42e6c693bd224d92b8a0fe4ad0cc586d, user_id=02767dcbd1574e08a9e82a775ac2b289, role_id=2991da7c6ccc478bbfdc0ce47a959495)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:17.208891 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab8982f-71ad-496c-ad49-d9b59a62be87 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:17.222557 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 318/642] 10.222.0.16 () {58 vars in 1439 bytes} [Thu May 26 12:21:17 2022] PUT /identity/v3/projects/42e6c693bd224d92b8a0fe4ad0cc586d/users/02767dcbd1574e08a9e82a775ac2b289/roles/2991da7c6ccc478bbfdc0ce47a959495 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:21:17.223541 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab8982f-71ad-496c-ad49-d9b59a62be87 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:17.245809 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7bf502-b75c-4fd5-84b4-4aed332d1b8e None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:17.285820 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d721ebb-e8e8-4acc-834a-c3021ba3f7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:17.286643 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d721ebb-e8e8-4acc-834a-c3021ba3f7c3 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:17.286920 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d721ebb-e8e8-4acc-834a-c3021ba3f7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:17.287197 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d721ebb-e8e8-4acc-834a-c3021ba3f7c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:17.290851 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:17.296169 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d721ebb-e8e8-4acc-834a-c3021ba3f7c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:17.298082 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d721ebb-e8e8-4acc-834a-c3021ba3f7c3 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:17.313851 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:17.314854 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-7d721ebb-e8e8-4acc-834a-c3021ba3f7c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:21:17.314854 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:17.314854 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:17.314854 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:17.314854 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:17.314854 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:17.314854 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:17.314854 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:17.314854 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:17.314854 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:17.314854 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:17.314854 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:17.314854 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:21:17.314854 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:21:17.314854 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:21:17.315952 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:21:17.315952 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:17.315952 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:17.315952 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:17.315952 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:17.315952 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:17.315952 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:17.315952 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:17.315952 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:17.315952 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:17.315952 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:17.315952 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:17.315952 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:17.315952 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:17.315952 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:17.315952 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:17.315952 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:17.317543 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:21:17.317543 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:21:17.317543 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:21:17.317543 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:21:17.317543 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:21:17.317543 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:21:17.317543 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:21:17.317543 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:17.317543 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 325/643] 10.222.0.16 () {56 vars in 1111 bytes} [Thu May 26 12:21:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:17.317543 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d721ebb-e8e8-4acc-834a-c3021ba3f7c3 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:17.358875 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab8982f-71ad-496c-ad49-d9b59a62be87 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:17.398702 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939fc650-0868-40c9-a969-b12090c400b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:17.399501 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939fc650-0868-40c9-a969-b12090c400b5 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:17.399792 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939fc650-0868-40c9-a969-b12090c400b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:17.400748 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939fc650-0868-40c9-a969-b12090c400b5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:17.413451 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939fc650-0868-40c9-a969-b12090c400b5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:17.414959 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939fc650-0868-40c9-a969-b12090c400b5 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:17.430346 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-939fc650-0868-40c9-a969-b12090c400b5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 26 12:21:17.430346 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:17.430346 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:17.430346 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:17.430346 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:17.430346 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:17.430346 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:17.430346 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:17.430346 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:17.430346 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:17.430346 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:17.430346 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:17.430346 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:21:17.430346 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:21:17.430346 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:21:17.430346 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:21:17.431505 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:17.431505 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:17.431505 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:21:17.431505 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:21:17.431505 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:21:17.431505 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:21:17.431505 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:17.431505 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:17.431505 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:17.431505 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:17.431505 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:17.431505 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:17.431505 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:17.431505 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:17.431505 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:17.431505 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:17.431505 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:17.431505 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:17.432801 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:17.432801 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:17.432801 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:21:17.432801 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:21:17.432801 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:21:17.432801 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:21:17.432801 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:21:17.432801 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:21:17.432801 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 26 12:21:17.432801 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:17.432801 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 319/644] 10.222.0.16 () {56 vars in 1099 bytes} [Thu May 26 12:21:17 2022] GET /identity/v3/users/glance => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:17.432801 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939fc650-0868-40c9-a969-b12090c400b5 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:17.434692 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d721ebb-e8e8-4acc-834a-c3021ba3f7c3 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:17.471721 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbdd29f-e902-485f-8362-c260735d7694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:17.472560 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbdd29f-e902-485f-8362-c260735d7694 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:17.472917 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbdd29f-e902-485f-8362-c260735d7694 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:17.473218 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbdd29f-e902-485f-8362-c260735d7694 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:17.484142 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbdd29f-e902-485f-8362-c260735d7694 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:21:17.492487 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-1fbdd29f-e902-485f-8362-c260735d7694 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:21:17.492487 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:17.492487 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:17.492487 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:17.492487 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:17.492487 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:17.492487 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:17.492487 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:17.492487 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:17.492487 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:17.492487 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:17.492487 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:17.492487 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:21:17.492487 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:21:17.492487 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:21:17.492487 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:21:17.493460 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:21:17.493460 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:21:17.493460 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:21:17.493460 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:21:17.493460 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:17.493460 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:17.493460 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:17.493460 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:17.493460 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:17.493460 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:17.493460 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:17.493460 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:17.493460 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:17.493460 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:17.493460 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:17.493460 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:17.494310 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:17.494310 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:17.494310 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:17.494310 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:17.494310 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:21:17.494310 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:21:17.494310 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:21:17.494310 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:21:17.494310 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:21:17.494310 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:21:17.494310 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:21:17.494310 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:17.494310 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 326/645] 10.222.0.16 () {56 vars in 1102 bytes} [Thu May 26 12:21:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:17.495008 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbdd29f-e902-485f-8362-c260735d7694 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:17.549082 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939fc650-0868-40c9-a969-b12090c400b5 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:17.557515 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:17.577751 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:17.587684 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48502677-4be8-4a7b-a9d0-192ff0aae59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:17.588357 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48502677-4be8-4a7b-a9d0-192ff0aae59c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:17.588643 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48502677-4be8-4a7b-a9d0-192ff0aae59c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:17.588952 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48502677-4be8-4a7b-a9d0-192ff0aae59c None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:17.589705 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48502677-4be8-4a7b-a9d0-192ff0aae59c None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:17.590011 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48502677-4be8-4a7b-a9d0-192ff0aae59c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:17.591390 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48502677-4be8-4a7b-a9d0-192ff0aae59c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:17.600077 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 320/646] 10.222.0.16 () {56 vars in 1103 bytes} [Thu May 26 12:21:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:17.600909 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48502677-4be8-4a7b-a9d0-192ff0aae59c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:17.609568 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbdd29f-e902-485f-8362-c260735d7694 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:17.644568 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c902e588-c0b2-477c-b560-1fa796f16da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:17.645264 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902e588-c0b2-477c-b560-1fa796f16da5 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:17.645548 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902e588-c0b2-477c-b560-1fa796f16da5 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:17.645828 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902e588-c0b2-477c-b560-1fa796f16da5 None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:17.646616 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c902e588-c0b2-477c-b560-1fa796f16da5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:17.646929 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c902e588-c0b2-477c-b560-1fa796f16da5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:17.648360 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c902e588-c0b2-477c-b560-1fa796f16da5 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:17.665908 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 327/647] 10.222.0.16 () {56 vars in 1148 bytes} [Thu May 26 12:21:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:17.665908 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c902e588-c0b2-477c-b560-1fa796f16da5 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:17.709056 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48502677-4be8-4a7b-a9d0-192ff0aae59c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:17.745345 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a07d099-5bc8-4f46-978c-bd0cb9079289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:17.745841 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07d099-5bc8-4f46-978c-bd0cb9079289 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:17.746125 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07d099-5bc8-4f46-978c-bd0cb9079289 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:17.746401 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07d099-5bc8-4f46-978c-bd0cb9079289 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:17.747245 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a07d099-5bc8-4f46-978c-bd0cb9079289 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:17.747556 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a07d099-5bc8-4f46-978c-bd0cb9079289 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:17.751656 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a07d099-5bc8-4f46-978c-bd0cb9079289 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:17.772967 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 321/648] 10.222.0.16 () {56 vars in 1137 bytes} [Thu May 26 12:21:17 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:17.772967 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a07d099-5bc8-4f46-978c-bd0cb9079289 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:17.780958 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c902e588-c0b2-477c-b560-1fa796f16da5 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:17.798755 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:17.822129 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef282fa-8888-4985-ad5a-16a52aea0315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:17.822363 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:17.822925 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef282fa-8888-4985-ad5a-16a52aea0315 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:17.823741 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef282fa-8888-4985-ad5a-16a52aea0315 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:17.823741 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef282fa-8888-4985-ad5a-16a52aea0315 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:17.824541 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef282fa-8888-4985-ad5a-16a52aea0315 None admin] RBAC: Adding query filter params (name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:17.824866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef282fa-8888-4985-ad5a-16a52aea0315 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:17.826637 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef282fa-8888-4985-ad5a-16a52aea0315 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:17.841183 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 328/649] 10.222.0.16 () {56 vars in 1103 bytes} [Thu May 26 12:21:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:17.841183 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef282fa-8888-4985-ad5a-16a52aea0315 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:17.878665 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a07d099-5bc8-4f46-978c-bd0cb9079289 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:17.914716 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1277b75b-260e-467a-817b-805b160b5d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:17.915568 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277b75b-260e-467a-817b-805b160b5d2c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:17.915851 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277b75b-260e-467a-817b-805b160b5d2c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:17.916178 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277b75b-260e-467a-817b-805b160b5d2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:17.927114 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1277b75b-260e-467a-817b-805b160b5d2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:17.928575 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1277b75b-260e-467a-817b-805b160b5d2c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:17.943443 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef282fa-8888-4985-ad5a-16a52aea0315 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:17.946311 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-1277b75b-260e-467a-817b-805b160b5d2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:17.946311 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:17.946311 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:17.946311 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:17.946311 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:17.946311 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:17.946311 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:17.946311 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:17.946311 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:17.946311 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:17.946311 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:17.946311 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:17.946311 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:21:17.946311 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:21:17.946311 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:21:17.947198 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:21:17.947198 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:17.947198 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:17.947198 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:17.947198 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:17.947198 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:17.947198 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:17.947198 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:17.947198 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:17.947198 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:17.947198 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:17.947198 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:17.947198 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:17.947198 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:17.947198 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:17.947198 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:17.947198 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:17.948112 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:21:17.948112 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:21:17.948112 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:17.948112 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:17.948112 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 322/650] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:21:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:17.948662 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1277b75b-260e-467a-817b-805b160b5d2c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:17.983225 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e7816-723b-467b-8174-4fe18bdf6984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:17.984126 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e7816-723b-467b-8174-4fe18bdf6984 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:17.984413 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e7816-723b-467b-8174-4fe18bdf6984 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:17.984691 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e7816-723b-467b-8174-4fe18bdf6984 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:17.985615 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e7816-723b-467b-8174-4fe18bdf6984 None admin] RBAC: Adding query filter params (role.id=2991da7c6ccc478bbfdc0ce47a959495, scope.project.id=42e6c693bd224d92b8a0fe4ad0cc586d, user.id=536f68ff77794352adf41aaacdc0645c) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:17.985927 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e7816-723b-467b-8174-4fe18bdf6984 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:17.987358 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e7816-723b-467b-8174-4fe18bdf6984 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:17.993427 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 329/651] 10.222.0.16 () {56 vars in 1374 bytes} [Thu May 26 12:21:17 2022] GET /identity/v3/role_assignments?user.id=536f68ff77794352adf41aaacdc0645c&scope.project.id=42e6c693bd224d92b8a0fe4ad0cc586d&role.id=2991da7c6ccc478bbfdc0ce47a959495 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:17.994206 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e7816-723b-467b-8174-4fe18bdf6984 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:18.057249 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:18.060769 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1277b75b-260e-467a-817b-805b160b5d2c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:18.079767 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:18.102438 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b04d5ab-1bbb-4c37-ba96-24da703131a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:18.103468 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04d5ab-1bbb-4c37-ba96-24da703131a7 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:18.103769 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04d5ab-1bbb-4c37-ba96-24da703131a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:18.104074 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04d5ab-1bbb-4c37-ba96-24da703131a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:18.145444 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e7816-723b-467b-8174-4fe18bdf6984 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:18.186547 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b04d5ab-1bbb-4c37-ba96-24da703131a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:18.188040 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b04d5ab-1bbb-4c37-ba96-24da703131a7 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:18.188221 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63977bac-8944-48f5-a9da-0c9b67707812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:18.189512 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63977bac-8944-48f5-a9da-0c9b67707812 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:18.189794 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63977bac-8944-48f5-a9da-0c9b67707812 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:18.190067 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63977bac-8944-48f5-a9da-0c9b67707812 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:18.202335 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63977bac-8944-48f5-a9da-0c9b67707812 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:18.204122 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63977bac-8944-48f5-a9da-0c9b67707812 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:18.223050 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-63977bac-8944-48f5-a9da-0c9b67707812 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:18.223050 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:18.223050 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:18.223050 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:18.223050 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:18.223050 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:18.223050 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:18.223050 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:18.223050 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:18.223050 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:18.223050 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:18.223050 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:18.223050 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:21:18.223050 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:21:18.223050 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:21:18.223976 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:21:18.223976 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:18.223976 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:18.223976 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:18.223976 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:18.223976 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:18.223976 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:18.223976 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:18.223976 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:18.223976 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:18.223976 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:18.223976 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:18.223976 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:18.223976 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:18.223976 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:18.223976 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:18.223976 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:18.225015 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:21:18.225015 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:21:18.225015 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:18.225015 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:18.225015 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 330/652] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:21:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:18.225307 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63977bac-8944-48f5-a9da-0c9b67707812 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:18.315175 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:18.319330 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 323/653] 10.222.0.16 () {58 vars in 1282 bytes} [Thu May 26 12:21:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:21:18.320235 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b04d5ab-1bbb-4c37-ba96-24da703131a7 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:18.349927 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:18.358024 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63977bac-8944-48f5-a9da-0c9b67707812 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:18.398601 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae08fa4-59e2-4574-88b1-ddf4e7567b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:18.399478 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae08fa4-59e2-4574-88b1-ddf4e7567b81 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:18.399832 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae08fa4-59e2-4574-88b1-ddf4e7567b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:18.400176 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae08fa4-59e2-4574-88b1-ddf4e7567b81 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:18.401193 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae08fa4-59e2-4574-88b1-ddf4e7567b81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:18.401569 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae08fa4-59e2-4574-88b1-ddf4e7567b81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:18.403105 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae08fa4-59e2-4574-88b1-ddf4e7567b81 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:18.417984 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 331/654] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:21:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:18.418743 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae08fa4-59e2-4574-88b1-ddf4e7567b81 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:18.470308 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b04d5ab-1bbb-4c37-ba96-24da703131a7 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:18.517905 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e169348-bbf4-4646-a727-64ed8e277003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:18.519051 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e169348-bbf4-4646-a727-64ed8e277003 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:18.519403 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e169348-bbf4-4646-a727-64ed8e277003 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:18.519769 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e169348-bbf4-4646-a727-64ed8e277003 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:18.520572 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e169348-bbf4-4646-a727-64ed8e277003 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:18.520976 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e169348-bbf4-4646-a727-64ed8e277003 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:18.523085 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e169348-bbf4-4646-a727-64ed8e277003 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:18.537178 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae08fa4-59e2-4574-88b1-ddf4e7567b81 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:18.542221 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 324/655] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:21:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:18.543262 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e169348-bbf4-4646-a727-64ed8e277003 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:18.582651 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef4606-0d83-4c00-8a42-86fc0ecb9f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:18.583371 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef4606-0d83-4c00-8a42-86fc0ecb9f7b None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:18.583659 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef4606-0d83-4c00-8a42-86fc0ecb9f7b None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:18.583939 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef4606-0d83-4c00-8a42-86fc0ecb9f7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:18.596739 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baef4606-0d83-4c00-8a42-86fc0ecb9f7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:18.598351 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baef4606-0d83-4c00-8a42-86fc0ecb9f7b None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:18.612193 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:18.627769 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-baef4606-0d83-4c00-8a42-86fc0ecb9f7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:18.627769 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:18.627769 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:18.627769 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:18.627769 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:18.627769 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:18.627769 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:18.627769 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:18.627769 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:18.627769 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:18.627769 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:18.627769 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:18.627769 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:21:18.627769 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:21:18.627769 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:21:18.629938 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:21:18.629938 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:18.629938 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:18.629938 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:18.629938 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:18.629938 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:18.629938 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:18.629938 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:18.629938 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:18.629938 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:18.629938 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:18.629938 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:18.629938 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:18.629938 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:18.629938 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:18.629938 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:18.629938 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:18.632046 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:21:18.632046 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:21:18.632046 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:18.632046 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:18.632046 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 332/656] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:21:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:18.632046 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef4606-0d83-4c00-8a42-86fc0ecb9f7b None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:18.639542 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:18.667926 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e169348-bbf4-4646-a727-64ed8e277003 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:18.705025 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5632d397-ecee-4965-9c7d-4a89e5448079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:18.705967 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632d397-ecee-4965-9c7d-4a89e5448079 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:18.706349 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632d397-ecee-4965-9c7d-4a89e5448079 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:18.706756 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632d397-ecee-4965-9c7d-4a89e5448079 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:18.714758 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5632d397-ecee-4965-9c7d-4a89e5448079 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:18.716559 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5632d397-ecee-4965-9c7d-4a89e5448079 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:18.732145 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-5632d397-ecee-4965-9c7d-4a89e5448079 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 12:21:18.732145 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:18.732145 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:18.732145 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:18.732145 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:18.732145 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:18.732145 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:18.732145 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:18.732145 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:18.732145 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:18.732145 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:18.732145 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:18.732145 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:21:18.732145 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:21:18.732145 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:21:18.732145 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:21:18.733385 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:18.733385 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:18.733385 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:21:18.733385 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:21:18.733385 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:21:18.733385 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:21:18.733385 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:18.733385 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:18.733385 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:18.733385 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:18.733385 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:18.733385 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:18.733385 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:18.733385 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:18.733385 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:18.733385 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:18.733385 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:18.733385 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:18.734637 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:18.734637 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:18.734637 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:21:18.734637 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:21:18.734637 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:21:18.734637 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:21:18.734637 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:21:18.734637 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:21:18.734637 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 12:21:18.734637 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:18.741048 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 325/657] 10.222.0.16 () {56 vars in 1099 bytes} [Thu May 26 12:21:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:18.741971 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5632d397-ecee-4965-9c7d-4a89e5448079 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:18.758146 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef4606-0d83-4c00-8a42-86fc0ecb9f7b None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:18.803538 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a321739-94a5-4661-8dbb-f2b6979d9536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:18.805427 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a321739-94a5-4661-8dbb-f2b6979d9536 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:18.806145 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a321739-94a5-4661-8dbb-f2b6979d9536 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:18.806574 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a321739-94a5-4661-8dbb-f2b6979d9536 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:18.816600 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a321739-94a5-4661-8dbb-f2b6979d9536 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:18.818483 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a321739-94a5-4661-8dbb-f2b6979d9536 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:18.837698 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-4a321739-94a5-4661-8dbb-f2b6979d9536 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 26 12:21:18.837698 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:18.837698 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:18.837698 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:18.837698 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:18.837698 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:18.837698 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:18.837698 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:18.837698 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:18.837698 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:18.837698 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:18.837698 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:18.837698 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:21:18.837698 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:21:18.837698 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:21:18.837698 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:21:18.838695 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:18.838695 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:18.838695 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:21:18.838695 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:21:18.838695 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:21:18.838695 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:21:18.838695 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:18.838695 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:18.838695 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:18.838695 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:18.838695 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:18.838695 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:18.838695 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:18.838695 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:18.838695 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:18.838695 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:18.838695 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:18.838695 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:18.839633 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:18.839633 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:18.839633 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:21:18.839633 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:21:18.839633 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:21:18.839633 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:21:18.839633 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:21:18.839633 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:21:18.839633 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 26 12:21:18.839633 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:18.842321 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 333/658] 10.222.0.16 () {56 vars in 1102 bytes} [Thu May 26 12:21:18 2022] GET /identity/v3/users/neutron => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:18.843515 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a321739-94a5-4661-8dbb-f2b6979d9536 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:18.863704 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5632d397-ecee-4965-9c7d-4a89e5448079 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:18.884334 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:18.901202 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba90e1a-939c-49ef-96b2-671ab30da91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:18.902034 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba90e1a-939c-49ef-96b2-671ab30da91c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:18.902436 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba90e1a-939c-49ef-96b2-671ab30da91c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:18.902809 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba90e1a-939c-49ef-96b2-671ab30da91c None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:18.903630 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba90e1a-939c-49ef-96b2-671ab30da91c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:18.904036 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba90e1a-939c-49ef-96b2-671ab30da91c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:18.905603 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba90e1a-939c-49ef-96b2-671ab30da91c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:18.918879 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 326/659] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:21:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:18.920055 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba90e1a-939c-49ef-96b2-671ab30da91c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:18.930148 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:18.976941 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a321739-94a5-4661-8dbb-f2b6979d9536 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:19.015380 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5c7cb6-18bf-4a07-b65d-ae06da06d0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:19.016233 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c7cb6-18bf-4a07-b65d-ae06da06d0e1 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:19.017170 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c7cb6-18bf-4a07-b65d-ae06da06d0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:19.017559 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c7cb6-18bf-4a07-b65d-ae06da06d0e1 None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:19.018852 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5c7cb6-18bf-4a07-b65d-ae06da06d0e1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:19.019204 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5c7cb6-18bf-4a07-b65d-ae06da06d0e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:19.020742 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5c7cb6-18bf-4a07-b65d-ae06da06d0e1 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:19.037880 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba90e1a-939c-49ef-96b2-671ab30da91c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:19.044689 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 334/660] 10.222.0.16 () {56 vars in 1137 bytes} [Thu May 26 12:21:18 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:19.046064 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5c7cb6-18bf-4a07-b65d-ae06da06d0e1 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:19.081331 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581ca3b-338e-404a-bc83-273b70e0c352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:19.082507 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581ca3b-338e-404a-bc83-273b70e0c352 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:19.082938 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581ca3b-338e-404a-bc83-273b70e0c352 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:19.084215 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581ca3b-338e-404a-bc83-273b70e0c352 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:19.085260 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e581ca3b-338e-404a-bc83-273b70e0c352 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:19.085723 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e581ca3b-338e-404a-bc83-273b70e0c352 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:19.087301 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e581ca3b-338e-404a-bc83-273b70e0c352 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:19.113360 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 327/661] 10.222.0.16 () {56 vars in 1139 bytes} [Thu May 26 12:21:18 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:19.114339 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581ca3b-338e-404a-bc83-273b70e0c352 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:19.154918 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:19.163890 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5c7cb6-18bf-4a07-b65d-ae06da06d0e1 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:19.192930 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:19.207152 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf8b2a9-b851-4c19-9e58-6246e67d4afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:19.208510 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf8b2a9-b851-4c19-9e58-6246e67d4afa None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:19.209022 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf8b2a9-b851-4c19-9e58-6246e67d4afa None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:19.209602 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf8b2a9-b851-4c19-9e58-6246e67d4afa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:19.219450 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf8b2a9-b851-4c19-9e58-6246e67d4afa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:19.222301 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf8b2a9-b851-4c19-9e58-6246e67d4afa None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:19.223415 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581ca3b-338e-404a-bc83-273b70e0c352 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:19.239920 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-9bf8b2a9-b851-4c19-9e58-6246e67d4afa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:21:19.239920 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:19.239920 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:19.239920 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:19.239920 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:19.239920 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:19.239920 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:19.239920 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:19.239920 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:19.239920 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:19.239920 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:19.239920 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:19.239920 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:21:19.239920 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:21:19.239920 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:21:19.240877 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:21:19.240877 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:19.240877 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:19.240877 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:19.240877 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:19.240877 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:19.240877 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:19.240877 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:19.240877 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:19.240877 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:19.240877 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:19.240877 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:19.240877 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:19.240877 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:19.240877 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:19.240877 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:19.240877 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:19.241778 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:21:19.241778 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:21:19.241778 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:21:19.241778 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:21:19.241778 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:21:19.241778 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:21:19.241778 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:21:19.241778 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:19.242810 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 335/662] 10.222.0.16 () {56 vars in 1111 bytes} [Thu May 26 12:21:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:19.244914 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf8b2a9-b851-4c19-9e58-6246e67d4afa None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:19.269011 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d274b85-33b6-4d72-a28a-06709b2b448c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:19.270276 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d274b85-33b6-4d72-a28a-06709b2b448c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:19.270878 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d274b85-33b6-4d72-a28a-06709b2b448c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:19.271171 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d274b85-33b6-4d72-a28a-06709b2b448c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:19.365855 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d274b85-33b6-4d72-a28a-06709b2b448c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:19.367802 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d274b85-33b6-4d72-a28a-06709b2b448c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:19.374292 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf8b2a9-b851-4c19-9e58-6246e67d4afa None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:19.410714 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bfdc0f-84bc-4db4-843d-9a1a346901f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:19.411477 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bfdc0f-84bc-4db4-843d-9a1a346901f1 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:19.411761 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bfdc0f-84bc-4db4-843d-9a1a346901f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:19.412039 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bfdc0f-84bc-4db4-843d-9a1a346901f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:19.422994 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:19.469350 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:19.487767 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 328/663] 10.222.0.16 () {58 vars in 1282 bytes} [Thu May 26 12:21:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:21:19.488618 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d274b85-33b6-4d72-a28a-06709b2b448c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:19.493105 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bfdc0f-84bc-4db4-843d-9a1a346901f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:19.494558 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bfdc0f-84bc-4db4-843d-9a1a346901f1 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:19.595169 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d274b85-33b6-4d72-a28a-06709b2b448c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:19.598997 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 336/664] 10.222.0.16 () {58 vars in 1282 bytes} [Thu May 26 12:21:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:21:19.600412 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b21207-0f63-44af-bf45-9171df4e1608 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:19.600772 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b21207-0f63-44af-bf45-9171df4e1608 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:19.601143 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b21207-0f63-44af-bf45-9171df4e1608 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:19.602752 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 337/665] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:21:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:21:19.603529 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b21207-0f63-44af-bf45-9171df4e1608 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:19.640025 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aef70d-edd0-4fb0-9ee4-7b14e8509a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:19.640543 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aef70d-edd0-4fb0-9ee4-7b14e8509a8b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:19.640782 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aef70d-edd0-4fb0-9ee4-7b14e8509a8b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:19.641146 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aef70d-edd0-4fb0-9ee4-7b14e8509a8b None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:19.642973 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aef70d-edd0-4fb0-9ee4-7b14e8509a8b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:19.642973 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aef70d-edd0-4fb0-9ee4-7b14e8509a8b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:19.644242 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aef70d-edd0-4fb0-9ee4-7b14e8509a8b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:19.651600 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:19.661285 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 329/666] 10.222.0.16 () {56 vars in 1148 bytes} [Thu May 26 12:21:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:19.661815 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aef70d-edd0-4fb0-9ee4-7b14e8509a8b None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:19.696098 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:19.713862 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b21207-0f63-44af-bf45-9171df4e1608 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:19.751832 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391fa845-14f7-4dc9-ac47-435dff0f9475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:19.752856 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fa845-14f7-4dc9-ac47-435dff0f9475 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:19.753408 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fa845-14f7-4dc9-ac47-435dff0f9475 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:19.753866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fa845-14f7-4dc9-ac47-435dff0f9475 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:19.764254 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391fa845-14f7-4dc9-ac47-435dff0f9475 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:19.765754 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391fa845-14f7-4dc9-ac47-435dff0f9475 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:19.771626 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aef70d-edd0-4fb0-9ee4-7b14e8509a8b None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:19.785935 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-391fa845-14f7-4dc9-ac47-435dff0f9475 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:19.785935 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:19.785935 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:19.785935 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:19.785935 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:19.785935 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:19.785935 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:19.785935 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:19.785935 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:19.785935 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:19.785935 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:19.785935 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:19.785935 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:21:19.785935 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:21:19.785935 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:21:19.786850 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:21:19.786850 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:19.786850 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:19.786850 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:19.786850 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:19.786850 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:19.786850 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:19.786850 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:19.786850 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:19.786850 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:19.786850 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:19.786850 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:19.786850 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:19.786850 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:19.786850 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:19.786850 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:19.786850 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:19.787774 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:21:19.787774 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:21:19.787774 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:19.787774 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:19.787774 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 338/667] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:21:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:19.788568 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc8d44-86ae-44e3-9379-983fcd3a2119 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:19.788568 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc8d44-86ae-44e3-9379-983fcd3a2119 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:19.788807 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc8d44-86ae-44e3-9379-983fcd3a2119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:19.805718 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-efbc8d44-86ae-44e3-9379-983fcd3a2119 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:21:19.806896 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-efbc8d44-86ae-44e3-9379-983fcd3a2119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:21:19.814040 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05eaa5a-3629-4511-9b42-ffe516af63f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:19.814831 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05eaa5a-3629-4511-9b42-ffe516af63f1 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:19.815118 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05eaa5a-3629-4511-9b42-ffe516af63f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:19.815393 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05eaa5a-3629-4511-9b42-ffe516af63f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:19.825996 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05eaa5a-3629-4511-9b42-ffe516af63f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:19.827509 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05eaa5a-3629-4511-9b42-ffe516af63f1 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:19.845178 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-e05eaa5a-3629-4511-9b42-ffe516af63f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:19.845178 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:19.845178 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:19.845178 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:19.845178 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:19.845178 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:19.845178 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:19.845178 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:19.845178 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:19.845178 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:19.845178 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:19.845178 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:19.845178 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:21:19.845178 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:21:19.845178 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:21:19.846103 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:21:19.846103 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:19.846103 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:19.846103 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:19.846103 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:19.846103 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:19.846103 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:19.846103 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:19.846103 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:19.846103 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:19.846103 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:19.846103 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:19.846103 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:19.846103 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:19.846103 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:19.846103 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:19.846103 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:19.846988 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:21:19.846988 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:21:19.846988 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:19.846988 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:19.846988 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 330/668] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:21:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:19.847311 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05eaa5a-3629-4511-9b42-ffe516af63f1 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:19.882625 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 339/669] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:21:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:21:19.883472 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc8d44-86ae-44e3-9379-983fcd3a2119 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:19.909543 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:19.960587 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05eaa5a-3629-4511-9b42-ffe516af63f1 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:19.969096 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:19.997750 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edce579-ee30-4428-9f24-020a0e4d2b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:19.998413 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edce579-ee30-4428-9f24-020a0e4d2b88 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:19.998950 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edce579-ee30-4428-9f24-020a0e4d2b88 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:19.999232 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edce579-ee30-4428-9f24-020a0e4d2b88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:20.000536 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edce579-ee30-4428-9f24-020a0e4d2b88 None admin] RBAC: Adding query filter params (role.id=2991da7c6ccc478bbfdc0ce47a959495, scope.project.id=42e6c693bd224d92b8a0fe4ad0cc586d, user.id=ad8cfccd3a4d42d381ce62ea90849f19) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:20.001389 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edce579-ee30-4428-9f24-020a0e4d2b88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:20.002869 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edce579-ee30-4428-9f24-020a0e4d2b88 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:20.016874 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 331/670] 10.222.0.16 () {56 vars in 1374 bytes} [Thu May 26 12:21:19 2022] GET /identity/v3/role_assignments?user.id=ad8cfccd3a4d42d381ce62ea90849f19&scope.project.id=42e6c693bd224d92b8a0fe4ad0cc586d&role.id=2991da7c6ccc478bbfdc0ce47a959495 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:20.017119 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc8d44-86ae-44e3-9379-983fcd3a2119 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:20.017217 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edce579-ee30-4428-9f24-020a0e4d2b88 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:20.068296 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2512e2-3a1c-43d3-a330-bb3fabf3b16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:20.069013 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2512e2-3a1c-43d3-a330-bb3fabf3b16c None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:20.069348 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2512e2-3a1c-43d3-a330-bb3fabf3b16c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:20.069623 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2512e2-3a1c-43d3-a330-bb3fabf3b16c None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:20.070426 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2512e2-3a1c-43d3-a330-bb3fabf3b16c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:20.070739 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2512e2-3a1c-43d3-a330-bb3fabf3b16c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:20.072372 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2512e2-3a1c-43d3-a330-bb3fabf3b16c None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:20.090090 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 340/671] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:21:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:20.091103 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2512e2-3a1c-43d3-a330-bb3fabf3b16c None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:20.137144 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edce579-ee30-4428-9f24-020a0e4d2b88 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:20.155623 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:20.180116 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f94fe-193e-4df2-b2d9-70592b685978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:20.181309 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f94fe-193e-4df2-b2d9-70592b685978 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:20.181892 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f94fe-193e-4df2-b2d9-70592b685978 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:20.182445 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f94fe-193e-4df2-b2d9-70592b685978 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:20.183838 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126f94fe-193e-4df2-b2d9-70592b685978 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:20.184458 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126f94fe-193e-4df2-b2d9-70592b685978 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:20.186265 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126f94fe-193e-4df2-b2d9-70592b685978 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:20.201783 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 332/672] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:21:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:20.202461 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f94fe-193e-4df2-b2d9-70592b685978 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:20.243196 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2512e2-3a1c-43d3-a330-bb3fabf3b16c None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:20.272817 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:20.284317 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4c93a-2736-4ec3-a707-e766f0a90203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:20.285204 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4c93a-2736-4ec3-a707-e766f0a90203 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:20.285485 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4c93a-2736-4ec3-a707-e766f0a90203 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:20.285767 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4c93a-2736-4ec3-a707-e766f0a90203 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:20.296654 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e4c93a-2736-4ec3-a707-e766f0a90203 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:21:20.305354 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-83e4c93a-2736-4ec3-a707-e766f0a90203 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:21:20.305354 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:20.305354 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:20.305354 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:20.305354 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:20.305354 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:20.305354 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:20.305354 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:20.305354 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:20.305354 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:20.305354 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:20.305354 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:20.305354 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:21:20.305354 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:21:20.305354 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:21:20.305354 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:21:20.306380 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:21:20.306380 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:21:20.306380 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:21:20.306380 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:21:20.306380 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:20.306380 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:20.306380 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:20.306380 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:20.306380 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:20.306380 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:20.306380 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:20.306380 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:20.306380 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:20.306380 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:20.306380 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:20.306380 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:20.307216 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:20.307216 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:20.307216 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:20.307216 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:20.307216 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:21:20.307216 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:21:20.307216 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:21:20.307216 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:21:20.307216 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:21:20.307216 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:21:20.307216 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:21:20.307216 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:20.307216 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 341/673] 10.222.0.16 () {56 vars in 1102 bytes} [Thu May 26 12:21:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:20.307921 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4c93a-2736-4ec3-a707-e766f0a90203 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:20.330806 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f94fe-193e-4df2-b2d9-70592b685978 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:20.383279 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2e4b09-12ff-4bde-9191-28ca8cd0abc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:20.384579 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e4b09-12ff-4bde-9191-28ca8cd0abc5 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:20.385090 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e4b09-12ff-4bde-9191-28ca8cd0abc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:20.385505 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e4b09-12ff-4bde-9191-28ca8cd0abc5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:20.394867 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2e4b09-12ff-4bde-9191-28ca8cd0abc5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:20.396491 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2e4b09-12ff-4bde-9191-28ca8cd0abc5 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:20.416313 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-fb2e4b09-12ff-4bde-9191-28ca8cd0abc5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:21:20.416313 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:20.416313 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:20.416313 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:20.416313 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:20.416313 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:20.416313 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:20.416313 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:20.416313 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:20.416313 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:20.416313 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:20.416313 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:20.416313 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:21:20.416313 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:21:20.416313 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:21:20.417457 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:21:20.417457 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:20.417457 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:20.417457 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:20.417457 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:20.417457 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:20.417457 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:20.417457 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:20.417457 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:20.417457 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:20.417457 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:20.417457 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:20.417457 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:20.417457 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:20.417457 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:20.417457 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:20.417457 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:20.418559 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:21:20.418559 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:21:20.418559 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:21:20.418559 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:21:20.418559 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:21:20.418559 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:21:20.418559 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:21:20.418559 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:20.420954 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 333/674] 10.222.0.16 () {56 vars in 1111 bytes} [Thu May 26 12:21:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:20.421982 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2e4b09-12ff-4bde-9191-28ca8cd0abc5 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:20.426795 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4c93a-2736-4ec3-a707-e766f0a90203 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:20.462709 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ad86f-4be3-4fe1-a907-28794b2bc55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:20.463422 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ad86f-4be3-4fe1-a907-28794b2bc55e None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:20.463704 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ad86f-4be3-4fe1-a907-28794b2bc55e None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:20.463980 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ad86f-4be3-4fe1-a907-28794b2bc55e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:20.465413 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:20.472107 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702ad86f-4be3-4fe1-a907-28794b2bc55e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:20.473985 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702ad86f-4be3-4fe1-a907-28794b2bc55e None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:20.488263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-702ad86f-4be3-4fe1-a907-28794b2bc55e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:21:20.488263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:20.488263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:20.488263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:20.488263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:20.488263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:20.488263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:20.488263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:20.488263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:20.488263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:20.488263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:20.488263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:20.488263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:21:20.488263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:21:20.488263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:21:20.489407 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:21:20.489407 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:20.489407 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:20.489407 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:20.489407 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:20.489407 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:20.489407 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:20.489407 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:20.489407 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:20.489407 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:20.489407 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:20.489407 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:20.489407 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:20.489407 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:20.489407 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:20.489407 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:20.489407 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:20.490496 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:21:20.490496 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:21:20.490496 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:21:20.490496 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:21:20.490496 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:21:20.490496 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:21:20.490496 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:21:20.490496 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:20.494127 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 342/675] 10.222.0.16 () {56 vars in 1111 bytes} [Thu May 26 12:21:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:20.495297 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fbc8e4-98ac-4092-98a0-083b2d92ca2a None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:20.495589 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fbc8e4-98ac-4092-98a0-083b2d92ca2a None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:20.495869 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fbc8e4-98ac-4092-98a0-083b2d92ca2a None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:20.497167 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 343/676] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:21:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:21:20.497849 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fbc8e4-98ac-4092-98a0-083b2d92ca2a None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:20.549624 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:20.557862 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2e4b09-12ff-4bde-9191-28ca8cd0abc5 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:20.598168 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f6051-4d23-4d6c-8dac-17a4d72cafa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:20.598990 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f6051-4d23-4d6c-8dac-17a4d72cafa0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:20.599281 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f6051-4d23-4d6c-8dac-17a4d72cafa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:20.599887 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f6051-4d23-4d6c-8dac-17a4d72cafa0 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:20.600935 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229f6051-4d23-4d6c-8dac-17a4d72cafa0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:20.601245 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229f6051-4d23-4d6c-8dac-17a4d72cafa0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:20.603110 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229f6051-4d23-4d6c-8dac-17a4d72cafa0 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:20.606318 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fbc8e4-98ac-4092-98a0-083b2d92ca2a None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:20.617255 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 334/677] 10.222.0.16 () {56 vars in 1103 bytes} [Thu May 26 12:21:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:20.618111 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f6051-4d23-4d6c-8dac-17a4d72cafa0 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:20.650114 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d4964a-c0fc-4805-8898-83c97d4c4d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:20.651111 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4964a-c0fc-4805-8898-83c97d4c4d7c None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:20.651389 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4964a-c0fc-4805-8898-83c97d4c4d7c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:20.651665 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4964a-c0fc-4805-8898-83c97d4c4d7c None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:20.652553 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d4964a-c0fc-4805-8898-83c97d4c4d7c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:20.652764 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d4964a-c0fc-4805-8898-83c97d4c4d7c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:20.654265 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d4964a-c0fc-4805-8898-83c97d4c4d7c None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:20.666590 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 344/678] 10.222.0.16 () {56 vars in 1148 bytes} [Thu May 26 12:21:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:20.667638 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade2638-ae3a-4127-9a24-a0a13a6e5a17 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:20.667929 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade2638-ae3a-4127-9a24-a0a13a6e5a17 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:20.668207 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade2638-ae3a-4127-9a24-a0a13a6e5a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:20.686944 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-3ade2638-ae3a-4127-9a24-a0a13a6e5a17 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:21:20.688127 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-3ade2638-ae3a-4127-9a24-a0a13a6e5a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:21:20.727033 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:20.733993 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f6051-4d23-4d6c-8dac-17a4d72cafa0 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:20.760536 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 345/679] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:21:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:21:20.761574 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ade2638-ae3a-4127-9a24-a0a13a6e5a17 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:20.775339 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6af3c0-3025-4d39-a11f-8f135e03aae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:20.776142 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6af3c0-3025-4d39-a11f-8f135e03aae0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:20.776500 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6af3c0-3025-4d39-a11f-8f135e03aae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:20.776869 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6af3c0-3025-4d39-a11f-8f135e03aae0 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:20.777729 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6af3c0-3025-4d39-a11f-8f135e03aae0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:20.778110 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6af3c0-3025-4d39-a11f-8f135e03aae0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:20.779622 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6af3c0-3025-4d39-a11f-8f135e03aae0 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:20.792914 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 335/680] 10.222.0.16 () {56 vars in 1148 bytes} [Thu May 26 12:21:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:20.793810 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6af3c0-3025-4d39-a11f-8f135e03aae0 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:20.810923 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:20.881342 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ade2638-ae3a-4127-9a24-a0a13a6e5a17 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:20.902554 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6af3c0-3025-4d39-a11f-8f135e03aae0 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:20.917281 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740afd5d-fd28-4ea3-984b-2da5eda9bfef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:20.918162 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740afd5d-fd28-4ea3-984b-2da5eda9bfef None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:20.918455 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740afd5d-fd28-4ea3-984b-2da5eda9bfef None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:20.918732 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740afd5d-fd28-4ea3-984b-2da5eda9bfef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:20.929680 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740afd5d-fd28-4ea3-984b-2da5eda9bfef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:20.931132 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740afd5d-fd28-4ea3-984b-2da5eda9bfef None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:20.940188 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa2615-0412-4371-b63d-6b7681776a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:20.940870 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa2615-0412-4371-b63d-6b7681776a11 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:20.941158 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa2615-0412-4371-b63d-6b7681776a11 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:20.941434 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa2615-0412-4371-b63d-6b7681776a11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:20.942268 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aa2615-0412-4371-b63d-6b7681776a11 None admin] RBAC: Adding query filter params (role.id=2991da7c6ccc478bbfdc0ce47a959495, scope.project.id=42e6c693bd224d92b8a0fe4ad0cc586d, user.id=736554efeba94a0b9547d18c3fc84fec) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:20.942582 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aa2615-0412-4371-b63d-6b7681776a11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:20.944006 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aa2615-0412-4371-b63d-6b7681776a11 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:20.949207 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-740afd5d-fd28-4ea3-984b-2da5eda9bfef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:20.949207 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:20.949207 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:20.949207 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:20.949207 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:20.949207 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:20.949207 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:20.949207 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:20.949207 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:20.949207 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:20.949207 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:20.949207 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:20.949207 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:21:20.949207 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:21:20.949207 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:21:20.957154 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:21:20.957154 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:20.957154 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:20.957154 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:20.957154 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:20.957154 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:20.957154 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:20.957154 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:20.957154 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:20.957154 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:20.957154 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:20.957154 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:20.957154 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:20.957154 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:20.957154 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:20.957154 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:20.957154 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:20.958208 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:21:20.958208 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:21:20.958208 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:20.958208 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:20.958516 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 336/681] 10.222.0.16 () {56 vars in 1374 bytes} [Thu May 26 12:21:20 2022] GET /identity/v3/role_assignments?user.id=736554efeba94a0b9547d18c3fc84fec&scope.project.id=42e6c693bd224d92b8a0fe4ad0cc586d&role.id=2991da7c6ccc478bbfdc0ce47a959495 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:20.958597 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 346/682] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:21:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:20.958665 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa2615-0412-4371-b63d-6b7681776a11 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:20.958732 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740afd5d-fd28-4ea3-984b-2da5eda9bfef None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:20.995095 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:21.073668 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:21.094123 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740afd5d-fd28-4ea3-984b-2da5eda9bfef None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:21.103254 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa2615-0412-4371-b63d-6b7681776a11 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:21.134340 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa808f35-7090-4267-83c5-1058b95172f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:21.135145 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa808f35-7090-4267-83c5-1058b95172f9 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:21.135302 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa808f35-7090-4267-83c5-1058b95172f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:21.135526 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa808f35-7090-4267-83c5-1058b95172f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:21.136378 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa808f35-7090-4267-83c5-1058b95172f9 None admin] RBAC: Adding query filter params (role.id=2991da7c6ccc478bbfdc0ce47a959495, scope.project.id=42e6c693bd224d92b8a0fe4ad0cc586d, user.id=68033ffcafbc47bbadd008abd9e56c4b) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:21.136693 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa808f35-7090-4267-83c5-1058b95172f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:21.138204 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa808f35-7090-4267-83c5-1058b95172f9 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:21.152865 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 347/683] 10.222.0.16 () {56 vars in 1374 bytes} [Thu May 26 12:21:20 2022] GET /identity/v3/role_assignments?user.id=68033ffcafbc47bbadd008abd9e56c4b&scope.project.id=42e6c693bd224d92b8a0fe4ad0cc586d&role.id=2991da7c6ccc478bbfdc0ce47a959495 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:21.152865 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa808f35-7090-4267-83c5-1058b95172f9 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:21.165303 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a53fb-82b1-4e9d-80ba-2e33ae8518b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:21.166413 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a53fb-82b1-4e9d-80ba-2e33ae8518b7 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:21.166665 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a53fb-82b1-4e9d-80ba-2e33ae8518b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:21.167011 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a53fb-82b1-4e9d-80ba-2e33ae8518b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:21.179999 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4a53fb-82b1-4e9d-80ba-2e33ae8518b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:21:21.190595 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-4c4a53fb-82b1-4e9d-80ba-2e33ae8518b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:21:21.190595 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:21.190595 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:21.190595 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:21.190595 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:21.190595 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:21.190595 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:21.190595 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:21.190595 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:21.190595 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:21.190595 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:21.190595 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:21.190595 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:21:21.190595 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:21:21.190595 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:21:21.190595 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:21:21.191597 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:21:21.191597 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:21:21.191597 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:21:21.191597 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:21:21.191597 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:21.191597 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:21.191597 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:21.191597 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:21.191597 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:21.191597 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:21.191597 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:21.191597 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:21.191597 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:21.191597 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:21.191597 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:21.191597 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:21.192444 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:21.192444 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:21.192444 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:21.192444 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:21.192444 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:21:21.192444 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:21:21.192444 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:21:21.192444 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:21:21.192444 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:21:21.192444 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:21:21.192444 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:21:21.192444 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:21.193150 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 337/684] 10.222.0.16 () {56 vars in 1096 bytes} [Thu May 26 12:21:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:21.200285 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a53fb-82b1-4e9d-80ba-2e33ae8518b7 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:21.288732 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa808f35-7090-4267-83c5-1058b95172f9 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:21.331415 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:21.338640 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf5dd3-a0ca-4fc8-a6b9-9df9ac49bc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:21.339425 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf5dd3-a0ca-4fc8-a6b9-9df9ac49bc0e None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:21.339714 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf5dd3-a0ca-4fc8-a6b9-9df9ac49bc0e None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:21.339993 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf5dd3-a0ca-4fc8-a6b9-9df9ac49bc0e None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:21.340736 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf5dd3-a0ca-4fc8-a6b9-9df9ac49bc0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:21.341709 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf5dd3-a0ca-4fc8-a6b9-9df9ac49bc0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:21.343512 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf5dd3-a0ca-4fc8-a6b9-9df9ac49bc0e None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:21.358086 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a53fb-82b1-4e9d-80ba-2e33ae8518b7 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:21.358562 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 348/685] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:21:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:21.364212 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf5dd3-a0ca-4fc8-a6b9-9df9ac49bc0e None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:21.388202 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:21.407200 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6db3b-8811-4141-8440-348d6e5adb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:21.408257 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6db3b-8811-4141-8440-348d6e5adb46 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:21.409201 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6db3b-8811-4141-8440-348d6e5adb46 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:21.409981 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6db3b-8811-4141-8440-348d6e5adb46 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:21.411371 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed6db3b-8811-4141-8440-348d6e5adb46 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:21.412200 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed6db3b-8811-4141-8440-348d6e5adb46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:21.414262 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed6db3b-8811-4141-8440-348d6e5adb46 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:21.427176 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 338/686] 10.222.0.16 () {56 vars in 1099 bytes} [Thu May 26 12:21:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:21.432671 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6db3b-8811-4141-8440-348d6e5adb46 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:21.501912 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf5dd3-a0ca-4fc8-a6b9-9df9ac49bc0e None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:21.540057 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ddeee-da6f-42f2-9dfd-0d9b4f68f597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:21.540823 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ddeee-da6f-42f2-9dfd-0d9b4f68f597 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:21.541132 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ddeee-da6f-42f2-9dfd-0d9b4f68f597 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:21.541408 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ddeee-da6f-42f2-9dfd-0d9b4f68f597 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:21.550255 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607ddeee-da6f-42f2-9dfd-0d9b4f68f597 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:21.551771 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607ddeee-da6f-42f2-9dfd-0d9b4f68f597 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:21.569718 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-607ddeee-da6f-42f2-9dfd-0d9b4f68f597 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 12:21:21.569718 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:21.569718 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:21.569718 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:21.569718 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:21.569718 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:21.569718 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:21.569718 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:21.569718 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:21.569718 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:21.569718 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:21.569718 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:21.569718 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:21:21.569718 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:21:21.569718 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:21:21.569718 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:21:21.570716 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:21.570716 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:21.570716 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:21:21.570716 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:21:21.570716 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:21:21.570716 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:21:21.570716 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:21.570716 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:21.570716 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:21.570716 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:21.570716 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:21.570716 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:21.570716 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:21.570716 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:21.570716 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:21.570716 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:21.570716 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:21.570716 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:21.571661 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:21.571661 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:21.571661 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:21:21.571661 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:21:21.571661 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:21:21.571661 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:21:21.571661 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:21:21.571661 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:21:21.571661 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 12:21:21.571661 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:21.571661 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 349/687] 10.222.0.16 () {56 vars in 1096 bytes} [Thu May 26 12:21:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:21.573444 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6db3b-8811-4141-8440-348d6e5adb46 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:21.576676 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ddeee-da6f-42f2-9dfd-0d9b4f68f597 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:21.628400 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b43e854-a79d-448e-a3d6-6432dc4db5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:21.630363 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43e854-a79d-448e-a3d6-6432dc4db5c7 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:21.630656 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43e854-a79d-448e-a3d6-6432dc4db5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:21.630929 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43e854-a79d-448e-a3d6-6432dc4db5c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:21.657706 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b43e854-a79d-448e-a3d6-6432dc4db5c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:21.659167 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b43e854-a79d-448e-a3d6-6432dc4db5c7 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:21.665506 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:21.700964 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-7b43e854-a79d-448e-a3d6-6432dc4db5c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:21.700964 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:21.700964 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:21.700964 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:21.700964 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:21.700964 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:21.700964 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:21.700964 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:21.700964 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:21.700964 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:21.700964 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:21.700964 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:21.700964 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:21:21.700964 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:21:21.700964 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:21:21.701912 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:21:21.701912 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:21.701912 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:21.701912 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:21.701912 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:21.701912 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:21.701912 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:21.701912 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:21.701912 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:21.701912 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:21.701912 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:21.701912 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:21.701912 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:21.701912 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:21.701912 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:21.701912 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:21.701912 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:21.702808 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:21:21.702808 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:21:21.702808 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:21.702808 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:21.702808 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 339/688] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:21:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:21:21.708356 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b43e854-a79d-448e-a3d6-6432dc4db5c7 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:21.710437 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:21.731279 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ddeee-da6f-42f2-9dfd-0d9b4f68f597 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:21.784533 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d7e481-2de8-4ca3-9483-a981016c90a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:21.785318 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7e481-2de8-4ca3-9483-a981016c90a5 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:21.785647 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7e481-2de8-4ca3-9483-a981016c90a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:21.785922 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7e481-2de8-4ca3-9483-a981016c90a5 None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:21.786774 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d7e481-2de8-4ca3-9483-a981016c90a5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:21.787082 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d7e481-2de8-4ca3-9483-a981016c90a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:21.788513 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d7e481-2de8-4ca3-9483-a981016c90a5 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:21.815023 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 350/689] 10.222.0.16 () {56 vars in 1135 bytes} [Thu May 26 12:21:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:21:21.819705 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d7e481-2de8-4ca3-9483-a981016c90a5 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:21.853180 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b43e854-a79d-448e-a3d6-6432dc4db5c7 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:21.913131 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54337fd-df7c-445a-8696-69b68e307eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:21.914073 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54337fd-df7c-445a-8696-69b68e307eac None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:21.914505 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54337fd-df7c-445a-8696-69b68e307eac None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:21.914940 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54337fd-df7c-445a-8696-69b68e307eac None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:21.916921 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54337fd-df7c-445a-8696-69b68e307eac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:21.917381 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54337fd-df7c-445a-8696-69b68e307eac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:21.919121 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54337fd-df7c-445a-8696-69b68e307eac None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:21.933897 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 340/690] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:21:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:21:21.939951 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54337fd-df7c-445a-8696-69b68e307eac None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:22.025209 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:22.037417 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d7e481-2de8-4ca3-9483-a981016c90a5 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:22.076479 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:22.094459 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580ec4d-6943-4f54-ac16-f972e0e31f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:22.095124 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580ec4d-6943-4f54-ac16-f972e0e31f86 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:22.095409 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580ec4d-6943-4f54-ac16-f972e0e31f86 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:22.095687 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580ec4d-6943-4f54-ac16-f972e0e31f86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:22.097609 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54337fd-df7c-445a-8696-69b68e307eac None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:22.145211 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeda0e8-5f68-47ee-a95d-ceee4f85fab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:22.146689 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeda0e8-5f68-47ee-a95d-ceee4f85fab5 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:22.147025 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeda0e8-5f68-47ee-a95d-ceee4f85fab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:22.147372 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeda0e8-5f68-47ee-a95d-ceee4f85fab5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:22.164603 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeda0e8-5f68-47ee-a95d-ceee4f85fab5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:22.166382 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeda0e8-5f68-47ee-a95d-ceee4f85fab5 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:22.185841 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-bfeda0e8-5f68-47ee-a95d-ceee4f85fab5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 12:21:22.185841 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:22.185841 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:22.185841 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:22.185841 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:22.185841 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:22.185841 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:22.185841 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:22.185841 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:22.185841 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:22.185841 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:22.185841 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:22.185841 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:21:22.185841 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:21:22.185841 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:21:22.185841 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:21:22.186815 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:22.186815 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:22.186815 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:21:22.186815 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:21:22.186815 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:21:22.186815 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:21:22.186815 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:22.186815 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:22.186815 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:22.186815 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:22.186815 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:22.186815 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:22.186815 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:22.186815 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:22.186815 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:22.186815 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:22.186815 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:22.186815 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:22.187857 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:22.187857 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:22.187857 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:21:22.187857 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:21:22.187857 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:21:22.187857 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:21:22.187857 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:21:22.187857 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:21:22.187857 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 12:21:22.187857 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:22.191132 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 341/691] 10.222.0.16 () {56 vars in 1093 bytes} [Thu May 26 12:21:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:22.196311 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeda0e8-5f68-47ee-a95d-ceee4f85fab5 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:22.269903 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3580ec4d-6943-4f54-ac16-f972e0e31f86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:22.271606 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3580ec4d-6943-4f54-ac16-f972e0e31f86 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:22.311438 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeda0e8-5f68-47ee-a95d-ceee4f85fab5 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:22.341889 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:22.388091 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46cf11b-ec96-48dc-9c42-77b53c59e6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:22.388776 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46cf11b-ec96-48dc-9c42-77b53c59e6f3 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:22.389086 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46cf11b-ec96-48dc-9c42-77b53c59e6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:22.389365 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46cf11b-ec96-48dc-9c42-77b53c59e6f3 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:22.390217 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46cf11b-ec96-48dc-9c42-77b53c59e6f3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:22.390532 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46cf11b-ec96-48dc-9c42-77b53c59e6f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:22.392124 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46cf11b-ec96-48dc-9c42-77b53c59e6f3 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:22.415656 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 342/692] 10.222.0.16 () {56 vars in 1133 bytes} [Thu May 26 12:21:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:22.417302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46cf11b-ec96-48dc-9c42-77b53c59e6f3 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:22.433072 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 351/693] 10.222.0.16 () {58 vars in 1282 bytes} [Thu May 26 12:21:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 614 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 12:21:22.438417 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580ec4d-6943-4f54-ac16-f972e0e31f86 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:22.472358 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:22.561393 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580ec4d-6943-4f54-ac16-f972e0e31f86 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:22.594082 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46cf11b-ec96-48dc-9c42-77b53c59e6f3 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:22.609318 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e21220-1685-4bc4-a03c-64b34277e87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:22.611348 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e21220-1685-4bc4-a03c-64b34277e87b None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:22.611861 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e21220-1685-4bc4-a03c-64b34277e87b None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:22.612459 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e21220-1685-4bc4-a03c-64b34277e87b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:22.626365 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e21220-1685-4bc4-a03c-64b34277e87b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:22.628909 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e21220-1685-4bc4-a03c-64b34277e87b None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:22.636354 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16458b-c5b4-4e53-b2d0-ffed459cb76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:22.637193 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16458b-c5b4-4e53-b2d0-ffed459cb76a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:22.637552 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16458b-c5b4-4e53-b2d0-ffed459cb76a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:22.637900 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16458b-c5b4-4e53-b2d0-ffed459cb76a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:22.653717 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-b6e21220-1685-4bc4-a03c-64b34277e87b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:22.653717 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:22.653717 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:22.653717 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:22.653717 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:22.653717 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:22.653717 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:22.653717 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:22.653717 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:22.653717 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:22.653717 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:22.653717 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:22.653717 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:21:22.653717 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:21:22.653717 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:21:22.654671 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:21:22.654671 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:22.654671 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:22.654671 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:22.654671 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:22.654671 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:22.654671 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:22.654671 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:22.654671 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:22.654671 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:22.654671 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:22.654671 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:22.654671 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:22.654671 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:22.654671 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:22.654671 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:22.654671 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:22.655615 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:21:22.655615 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:21:22.655615 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:22.655615 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:22.658440 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 352/694] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:21:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:21:22.660445 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8dc8d4-9284-42dd-81a1-80587b794459 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:22.661038 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8dc8d4-9284-42dd-81a1-80587b794459 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:22.661559 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8dc8d4-9284-42dd-81a1-80587b794459 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:22.663351 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 353/695] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:21:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:21:22.664259 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8dc8d4-9284-42dd-81a1-80587b794459 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:22.701902 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:22.735402 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c16458b-c5b4-4e53-b2d0-ffed459cb76a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:22.736916 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c16458b-c5b4-4e53-b2d0-ffed459cb76a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:22.787524 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:22.815730 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8dc8d4-9284-42dd-81a1-80587b794459 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:22.854458 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 343/696] 10.222.0.16 () {58 vars in 1282 bytes} [Thu May 26 12:21:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:21:22.856367 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc60f55-9e5f-4cde-88e2-3a5804a5c5ce None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:22.856901 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc60f55-9e5f-4cde-88e2-3a5804a5c5ce None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:22.857398 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc60f55-9e5f-4cde-88e2-3a5804a5c5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:22.868684 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99558637-9fff-4b1d-9dba-e0d07ed61654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:22.869380 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99558637-9fff-4b1d-9dba-e0d07ed61654 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:22.869708 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99558637-9fff-4b1d-9dba-e0d07ed61654 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:22.870033 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99558637-9fff-4b1d-9dba-e0d07ed61654 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:22.870942 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99558637-9fff-4b1d-9dba-e0d07ed61654 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:22.871349 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99558637-9fff-4b1d-9dba-e0d07ed61654 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:22.872731 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99558637-9fff-4b1d-9dba-e0d07ed61654 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:22.875273 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-3fc60f55-9e5f-4cde-88e2-3a5804a5c5ce None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:21:22.876692 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3fc60f55-9e5f-4cde-88e2-3a5804a5c5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:21:22.887156 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 354/697] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:21:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:22.888132 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99558637-9fff-4b1d-9dba-e0d07ed61654 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:22.958314 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 344/698] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:21:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:21:22.959671 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc60f55-9e5f-4cde-88e2-3a5804a5c5ce None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:22.962733 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:23.021783 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99558637-9fff-4b1d-9dba-e0d07ed61654 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:23.065743 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eee576-4881-4917-83dd-e35388678338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:23.066540 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eee576-4881-4917-83dd-e35388678338 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:23.066826 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eee576-4881-4917-83dd-e35388678338 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:23.067108 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eee576-4881-4917-83dd-e35388678338 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:23.080136 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc60f55-9e5f-4cde-88e2-3a5804a5c5ce None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:23.081817 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eee576-4881-4917-83dd-e35388678338 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:23.084265 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eee576-4881-4917-83dd-e35388678338 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:23.086120 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:23.106697 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-70eee576-4881-4917-83dd-e35388678338 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:23.106697 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:23.106697 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:23.106697 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:23.106697 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:23.106697 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:23.106697 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:23.106697 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:23.106697 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:23.106697 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:23.106697 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:23.106697 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:23.106697 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:21:23.106697 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:21:23.106697 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:21:23.107632 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:21:23.107632 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:23.107632 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:23.107632 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:23.107632 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:23.107632 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:23.107632 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:23.107632 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:23.107632 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:23.107632 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:23.107632 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:23.107632 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:23.107632 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:23.107632 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:23.107632 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:23.107632 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:23.107632 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:23.108538 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:21:23.108538 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:21:23.108538 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:23.108538 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:23.112679 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 355/699] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:21:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:23.113833 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eee576-4881-4917-83dd-e35388678338 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:23.124166 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf1de66-4f37-4cf7-9a37-4551b2a76a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:23.125332 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1de66-4f37-4cf7-9a37-4551b2a76a24 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:23.126374 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1de66-4f37-4cf7-9a37-4551b2a76a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:23.126849 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1de66-4f37-4cf7-9a37-4551b2a76a24 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:23.134958 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf1de66-4f37-4cf7-9a37-4551b2a76a24 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:23.136712 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf1de66-4f37-4cf7-9a37-4551b2a76a24 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:23.152009 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-dcf1de66-4f37-4cf7-9a37-4551b2a76a24 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:21:23.152009 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:23.152009 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:23.152009 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:23.152009 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:23.152009 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:23.152009 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:23.152009 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:23.152009 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:23.152009 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:23.152009 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:23.152009 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:23.152009 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:21:23.152009 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:21:23.152009 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:21:23.152951 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:21:23.152951 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:23.152951 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:23.152951 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:23.152951 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:23.152951 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:23.152951 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:23.152951 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:23.152951 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:23.152951 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:23.152951 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:23.152951 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:23.152951 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:23.152951 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:23.152951 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:23.152951 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:23.152951 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:23.153845 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:21:23.153845 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:21:23.153845 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:21:23.153845 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:21:23.153845 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:21:23.153845 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:21:23.153845 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:21:23.153845 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:23.156325 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 345/700] 10.222.0.16 () {56 vars in 1111 bytes} [Thu May 26 12:21:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:23.157447 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf1de66-4f37-4cf7-9a37-4551b2a76a24 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:23.222568 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:23.237211 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eee576-4881-4917-83dd-e35388678338 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:23.267016 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf1de66-4f37-4cf7-9a37-4551b2a76a24 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:23.273256 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a6ab27-1b3f-4764-97d8-1c6e2d14bc6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:23.274065 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6ab27-1b3f-4764-97d8-1c6e2d14bc6e None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:23.274349 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6ab27-1b3f-4764-97d8-1c6e2d14bc6e None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:23.274623 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6ab27-1b3f-4764-97d8-1c6e2d14bc6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:23.286093 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a6ab27-1b3f-4764-97d8-1c6e2d14bc6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:23.287557 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a6ab27-1b3f-4764-97d8-1c6e2d14bc6e None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:23.304986 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01006ed-566c-4e73-926a-49ab35deb61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:23.305983 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-a2a6ab27-1b3f-4764-97d8-1c6e2d14bc6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:23.305983 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:23.305983 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:23.305983 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:23.305983 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:23.305983 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:23.305983 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:23.305983 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:23.305983 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:23.305983 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:23.305983 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:23.305983 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:23.305983 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:21:23.305983 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:21:23.305983 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:21:23.306878 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:21:23.306878 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:23.306878 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:23.306878 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:23.306878 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:23.306878 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:23.306878 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:23.306878 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:23.306878 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:23.306878 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:23.306878 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:23.306878 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:23.306878 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:23.306878 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:23.306878 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:23.306878 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:23.306878 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:23.307770 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:21:23.307770 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:21:23.307770 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:23.307770 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:23.308475 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01006ed-566c-4e73-926a-49ab35deb61c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:23.309005 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01006ed-566c-4e73-926a-49ab35deb61c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:23.309480 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01006ed-566c-4e73-926a-49ab35deb61c None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:23.310416 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01006ed-566c-4e73-926a-49ab35deb61c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:23.310945 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01006ed-566c-4e73-926a-49ab35deb61c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:23.311953 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 356/701] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:21:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:23.312742 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01006ed-566c-4e73-926a-49ab35deb61c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:23.312870 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a6ab27-1b3f-4764-97d8-1c6e2d14bc6e None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:23.327384 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 346/702] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:21:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:23.333626 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01006ed-566c-4e73-926a-49ab35deb61c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:23.363508 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:23.420606 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a6ab27-1b3f-4764-97d8-1c6e2d14bc6e None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:23.443564 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01006ed-566c-4e73-926a-49ab35deb61c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:23.461275 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8652e15b-f2f0-4f75-a5b1-6d2df77b8bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:23.462331 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652e15b-f2f0-4f75-a5b1-6d2df77b8bee None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:23.462795 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652e15b-f2f0-4f75-a5b1-6d2df77b8bee None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:23.463255 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652e15b-f2f0-4f75-a5b1-6d2df77b8bee None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:23.464267 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8652e15b-f2f0-4f75-a5b1-6d2df77b8bee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:23.464797 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8652e15b-f2f0-4f75-a5b1-6d2df77b8bee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:23.466522 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8652e15b-f2f0-4f75-a5b1-6d2df77b8bee None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:23.481994 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 357/703] 10.222.0.16 () {56 vars in 1148 bytes} [Thu May 26 12:21:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:23.483300 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8652e15b-f2f0-4f75-a5b1-6d2df77b8bee None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:23.595968 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:23.599508 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8652e15b-f2f0-4f75-a5b1-6d2df77b8bee None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:23.608880 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:23.612442 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01102cdf-2314-47cf-bc40-d7d2aeb42384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:23.613462 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01102cdf-2314-47cf-bc40-d7d2aeb42384 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:23.613626 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01102cdf-2314-47cf-bc40-d7d2aeb42384 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:23.613875 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01102cdf-2314-47cf-bc40-d7d2aeb42384 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:23.614682 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01102cdf-2314-47cf-bc40-d7d2aeb42384 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:23.615059 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01102cdf-2314-47cf-bc40-d7d2aeb42384 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:23.617389 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01102cdf-2314-47cf-bc40-d7d2aeb42384 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:23.631653 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 347/704] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:21:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:23.632854 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01102cdf-2314-47cf-bc40-d7d2aeb42384 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:23.641851 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91ee9e-aba5-453f-aeab-150b2ea9ba4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:23.642941 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91ee9e-aba5-453f-aeab-150b2ea9ba4b None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:23.643410 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91ee9e-aba5-453f-aeab-150b2ea9ba4b None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:23.643941 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91ee9e-aba5-453f-aeab-150b2ea9ba4b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:23.651311 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc91ee9e-aba5-453f-aeab-150b2ea9ba4b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:23.652767 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc91ee9e-aba5-453f-aeab-150b2ea9ba4b None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:23.667514 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-fc91ee9e-aba5-453f-aeab-150b2ea9ba4b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:21:23.667514 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:23.667514 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:23.667514 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:23.667514 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:23.667514 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:23.667514 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:23.667514 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:23.667514 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:23.667514 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:23.667514 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:23.667514 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:23.667514 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:21:23.667514 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:21:23.667514 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:21:23.668379 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:21:23.668379 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:23.668379 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:23.668379 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:23.668379 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:23.668379 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:23.668379 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:23.668379 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:23.668379 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:23.668379 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:23.668379 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:23.668379 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:23.668379 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:23.668379 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:23.668379 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:23.668379 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:23.668379 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:23.669788 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:21:23.669788 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:21:23.669788 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:21:23.669788 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:21:23.669788 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:21:23.669788 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:21:23.669788 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:21:23.669788 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:23.669788 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 358/705] 10.222.0.16 () {56 vars in 1111 bytes} [Thu May 26 12:21:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:23.669788 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91ee9e-aba5-453f-aeab-150b2ea9ba4b None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:23.745618 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01102cdf-2314-47cf-bc40-d7d2aeb42384 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:23.783422 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb8971-14ec-49fb-b675-268f0ca705fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:23.784070 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb8971-14ec-49fb-b675-268f0ca705fa None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:23.784354 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb8971-14ec-49fb-b675-268f0ca705fa None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:23.784449 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91ee9e-aba5-453f-aeab-150b2ea9ba4b None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:23.784632 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb8971-14ec-49fb-b675-268f0ca705fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:23.785495 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb8971-14ec-49fb-b675-268f0ca705fa None admin] RBAC: Adding query filter params (role.id=2991da7c6ccc478bbfdc0ce47a959495, scope.project.id=42e6c693bd224d92b8a0fe4ad0cc586d, user.id=02767dcbd1574e08a9e82a775ac2b289) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:23.785808 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb8971-14ec-49fb-b675-268f0ca705fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:23.787237 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb8971-14ec-49fb-b675-268f0ca705fa None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:23.792958 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 348/706] 10.222.0.16 () {56 vars in 1374 bytes} [Thu May 26 12:21:23 2022] GET /identity/v3/role_assignments?user.id=02767dcbd1574e08a9e82a775ac2b289&scope.project.id=42e6c693bd224d92b8a0fe4ad0cc586d&role.id=2991da7c6ccc478bbfdc0ce47a959495 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:23.794209 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0dc1e2-50fa-4438-b5ac-7d34fc7359c1 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:23.794495 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0dc1e2-50fa-4438-b5ac-7d34fc7359c1 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:23.794773 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0dc1e2-50fa-4438-b5ac-7d34fc7359c1 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:23.796011 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 349/707] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:21:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:21:23.798187 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0dc1e2-50fa-4438-b5ac-7d34fc7359c1 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:23.822943 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7d9e4c-7db6-44aa-baf7-7f030a188992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:23.823709 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d9e4c-7db6-44aa-baf7-7f030a188992 None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:23.824000 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d9e4c-7db6-44aa-baf7-7f030a188992 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:23.824275 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d9e4c-7db6-44aa-baf7-7f030a188992 None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:23.825038 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7d9e4c-7db6-44aa-baf7-7f030a188992 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:23.826546 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7d9e4c-7db6-44aa-baf7-7f030a188992 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:23.849850 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 359/708] 10.222.0.16 () {60 vars in 1132 bytes} [Thu May 26 12:21:23 2022] POST /identity/v3/users => generated 254 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:21:23.851248 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa17dc3-66b7-43f0-84ca-7d6a2ecb2fe0 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:23.851608 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa17dc3-66b7-43f0-84ca-7d6a2ecb2fe0 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:23.851866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa17dc3-66b7-43f0-84ca-7d6a2ecb2fe0 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:23.857028 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 360/709] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:21:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:21:23.857028 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa58573-15e6-44e8-b568-746d3f2a9f8b None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:23.857028 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa58573-15e6-44e8-b568-746d3f2a9f8b None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:23.857028 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa58573-15e6-44e8-b568-746d3f2a9f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:23.869351 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:23.881880 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-1aa58573-15e6-44e8-b568-746d3f2a9f8b None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:21:23.883871 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-1aa58573-15e6-44e8-b568-746d3f2a9f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:21:23.910873 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:23.952326 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0dc1e2-50fa-4438-b5ac-7d34fc7359c1 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:23.985005 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 361/710] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:21:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:21:23.987160 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04b914-4531-4759-9da0-b8c7a35c01e3 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:23.987523 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04b914-4531-4759-9da0-b8c7a35c01e3 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:23.987870 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04b914-4531-4759-9da0-b8c7a35c01e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:24.001727 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37417328-31ab-4c6d-a893-a43d7f9b4b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:24.002447 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37417328-31ab-4c6d-a893-a43d7f9b4b9c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:24.003011 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37417328-31ab-4c6d-a893-a43d7f9b4b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:24.003288 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37417328-31ab-4c6d-a893-a43d7f9b4b9c None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:24.004280 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37417328-31ab-4c6d-a893-a43d7f9b4b9c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:24.004633 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37417328-31ab-4c6d-a893-a43d7f9b4b9c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:24.006192 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37417328-31ab-4c6d-a893-a43d7f9b4b9c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:24.007230 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-fe04b914-4531-4759-9da0-b8c7a35c01e3 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:21:24.008518 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-fe04b914-4531-4759-9da0-b8c7a35c01e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:21:24.022499 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 350/711] 10.222.0.16 () {56 vars in 1148 bytes} [Thu May 26 12:21:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:24.023215 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37417328-31ab-4c6d-a893-a43d7f9b4b9c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:24.096013 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 362/712] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:21:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:21:24.097070 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04b914-4531-4759-9da0-b8c7a35c01e3 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:24.153121 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37417328-31ab-4c6d-a893-a43d7f9b4b9c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:24.164205 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:24.196063 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:24.205904 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01627a58-5d5b-4008-a373-070efb720feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:24.206714 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01627a58-5d5b-4008-a373-070efb720feb None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:24.206989 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01627a58-5d5b-4008-a373-070efb720feb None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:24.207258 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01627a58-5d5b-4008-a373-070efb720feb None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:24.207903 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01627a58-5d5b-4008-a373-070efb720feb None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:24.209298 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01627a58-5d5b-4008-a373-070efb720feb None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:24.223601 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04b914-4531-4759-9da0-b8c7a35c01e3 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:24.224275 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-01627a58-5d5b-4008-a373-070efb720feb None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 12:21:24.224275 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:24.224275 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:21:24.224275 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:21:24.224275 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:21:24.224275 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:21:24.224275 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:21:24.224275 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:21:24.224275 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 12:21:24.224275 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:24.224275 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:21:24.224275 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:24.224275 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:24.224275 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:24.224275 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:24.224275 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:24.225279 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:24.225279 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:24.225279 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:24.225279 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:24.225279 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:24.225279 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:24.225279 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:24.225279 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:21:24.225279 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:21:24.225279 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:21:24.225279 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:21:24.225279 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:24.225279 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:24.225279 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:24.225279 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:24.225279 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:24.226211 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:24.226211 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:24.226211 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:24.226211 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:24.226211 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:24.226211 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:24.226211 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:24.226211 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:24.226211 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:24.226211 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:24.226211 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:24.226211 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:21:24.226211 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:21:24.226211 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 12:21:24.226211 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:24.226211 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 351/713] 10.222.0.16 () {56 vars in 1129 bytes} [Thu May 26 12:21:24 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:24.227058 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01627a58-5d5b-4008-a373-070efb720feb None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:24.274400 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f2799-1750-48f6-a0a4-d2b0ae69f42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:24.275612 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f2799-1750-48f6-a0a4-d2b0ae69f42a None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:24.276060 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f2799-1750-48f6-a0a4-d2b0ae69f42a None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:24.276599 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f2799-1750-48f6-a0a4-d2b0ae69f42a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:24.277894 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f2799-1750-48f6-a0a4-d2b0ae69f42a None admin] RBAC: Adding query filter params (role.id=1a8e523ecbc84d818c2a9af0fb54da74, scope.project.id=42e6c693bd224d92b8a0fe4ad0cc586d, user.id=536f68ff77794352adf41aaacdc0645c) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:24.278410 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f2799-1750-48f6-a0a4-d2b0ae69f42a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:24.280737 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f2799-1750-48f6-a0a4-d2b0ae69f42a None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:24.289872 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 363/714] 10.222.0.16 () {56 vars in 1374 bytes} [Thu May 26 12:21:24 2022] GET /identity/v3/role_assignments?user.id=536f68ff77794352adf41aaacdc0645c&scope.project.id=42e6c693bd224d92b8a0fe4ad0cc586d&role.id=1a8e523ecbc84d818c2a9af0fb54da74 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:24.291119 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f2799-1750-48f6-a0a4-d2b0ae69f42a None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:24.346197 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01627a58-5d5b-4008-a373-070efb720feb None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:24.382924 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78043270-f69c-4c96-bcd3-28a661fe23e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:24.383992 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78043270-f69c-4c96-bcd3-28a661fe23e6 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:24.384520 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78043270-f69c-4c96-bcd3-28a661fe23e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:24.385051 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78043270-f69c-4c96-bcd3-28a661fe23e6 None admin] PATH_INFO: `/v3/services/network` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:24.385941 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78043270-f69c-4c96-bcd3-28a661fe23e6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:24.387556 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78043270-f69c-4c96-bcd3-28a661fe23e6 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:24.401046 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-78043270-f69c-4c96-bcd3-28a661fe23e6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 26 12:21:24.401046 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:24.401046 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:21:24.401046 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:21:24.401046 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:21:24.401046 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:21:24.401046 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:21:24.401046 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:21:24.401046 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 12:21:24.401046 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:24.401046 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:21:24.401046 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:24.401046 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:24.401046 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:24.401046 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:24.401046 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:24.401046 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:24.402135 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:24.402135 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:24.402135 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:24.402135 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:24.402135 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:24.402135 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:24.402135 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:21:24.402135 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:21:24.402135 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:21:24.402135 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:21:24.402135 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:24.402135 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:24.402135 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:24.402135 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:24.402135 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:24.402135 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:24.403001 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:24.403001 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:24.403001 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:24.403001 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:24.403001 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:24.403001 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:24.403001 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:24.403001 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:24.403001 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:24.403001 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:24.403001 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:21:24.403001 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:21:24.403001 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 12:21:24.403001 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:24.404439 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f2799-1750-48f6-a0a4-d2b0ae69f42a None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:24.406189 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 352/715] 10.222.0.16 () {56 vars in 1111 bytes} [Thu May 26 12:21:24 2022] GET /identity/v3/services/network => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:24.412985 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78043270-f69c-4c96-bcd3-28a661fe23e6 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:24.444624 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0647e5c5-6f11-4b72-bd06-bd4786ec655b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:24.445715 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647e5c5-6f11-4b72-bd06-bd4786ec655b None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:24.445715 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647e5c5-6f11-4b72-bd06-bd4786ec655b None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:24.445933 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647e5c5-6f11-4b72-bd06-bd4786ec655b None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:24.446678 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0647e5c5-6f11-4b72-bd06-bd4786ec655b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:24.447067 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0647e5c5-6f11-4b72-bd06-bd4786ec655b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:24.448390 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0647e5c5-6f11-4b72-bd06-bd4786ec655b None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:24.453119 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:24.454694 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 364/716] 10.222.0.16 () {56 vars in 1124 bytes} [Thu May 26 12:21:24 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:24.460453 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0647e5c5-6f11-4b72-bd06-bd4786ec655b None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:24.478712 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:24.568189 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78043270-f69c-4c96-bcd3-28a661fe23e6 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:24.578746 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0647e5c5-6f11-4b72-bd06-bd4786ec655b None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:24.605772 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ba9e41-e581-4475-b4e2-28a6025a3004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:24.606447 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba9e41-e581-4475-b4e2-28a6025a3004 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:24.606732 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba9e41-e581-4475-b4e2-28a6025a3004 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:24.607008 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba9e41-e581-4475-b4e2-28a6025a3004 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:24.607723 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ba9e41-e581-4475-b4e2-28a6025a3004 None admin] RBAC: Adding query filter params (name=network) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:24.608032 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ba9e41-e581-4475-b4e2-28a6025a3004 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:24.609581 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ba9e41-e581-4475-b4e2-28a6025a3004 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:24.614576 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 353/717] 10.222.0.16 () {56 vars in 1112 bytes} [Thu May 26 12:21:24 2022] GET /identity/v3/services?name=network => generated 124 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:24.617374 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e54813-1ce0-4619-8321-4da0f0b90e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:24.618284 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e54813-1ce0-4619-8321-4da0f0b90e33 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:24.618762 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e54813-1ce0-4619-8321-4da0f0b90e33 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:24.619239 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e54813-1ce0-4619-8321-4da0f0b90e33 None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:24.620140 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e54813-1ce0-4619-8321-4da0f0b90e33 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:24.620638 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e54813-1ce0-4619-8321-4da0f0b90e33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:24.621802 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ba9e41-e581-4475-b4e2-28a6025a3004 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:24.622479 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e54813-1ce0-4619-8321-4da0f0b90e33 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:24.629878 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 365/718] 10.222.0.16 () {56 vars in 1124 bytes} [Thu May 26 12:21:24 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:24.785307 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:24.791263 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ba9e41-e581-4475-b4e2-28a6025a3004 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:24.843412 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740f5e4e-c631-49b0-bfaa-66f129be113b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:24.844079 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f5e4e-c631-49b0-bfaa-66f129be113b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:24.844358 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f5e4e-c631-49b0-bfaa-66f129be113b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:24.844660 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f5e4e-c631-49b0-bfaa-66f129be113b None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:24.845403 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740f5e4e-c631-49b0-bfaa-66f129be113b None admin] RBAC: Adding query filter params (type=network) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:24.845702 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740f5e4e-c631-49b0-bfaa-66f129be113b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:24.847080 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740f5e4e-c631-49b0-bfaa-66f129be113b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:24.855186 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 354/719] 10.222.0.16 () {56 vars in 1112 bytes} [Thu May 26 12:21:24 2022] GET /identity/v3/services?type=network => generated 124 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:26.353251 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f0850-afe8-4568-b935-18549d23a15b None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:26.354303 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f0850-afe8-4568-b935-18549d23a15b None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:26.354813 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f0850-afe8-4568-b935-18549d23a15b None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:26.356680 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 366/720] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:21:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:21:26.362527 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ba759-ed41-42ca-9527-6984b6ad2197 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:26.363365 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ba759-ed41-42ca-9527-6984b6ad2197 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:26.363882 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ba759-ed41-42ca-9527-6984b6ad2197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:26.381296 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-f01ba759-ed41-42ca-9527-6984b6ad2197 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:21:26.382780 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f01ba759-ed41-42ca-9527-6984b6ad2197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:21:26.481291 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 355/721] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:21:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:21:26.521828 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f0850-afe8-4568-b935-18549d23a15b None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:26.613434 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3adbd-1f1f-492f-bf84-dfd7eee65ae6 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:26.613735 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3adbd-1f1f-492f-bf84-dfd7eee65ae6 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:26.613919 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3adbd-1f1f-492f-bf84-dfd7eee65ae6 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:26.615532 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 356/722] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:21:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:21:26.620756 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc489006-cd14-40e1-a3d0-aa296f57be90 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:26.621082 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc489006-cd14-40e1-a3d0-aa296f57be90 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:26.621347 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc489006-cd14-40e1-a3d0-aa296f57be90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:26.662126 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-dc489006-cd14-40e1-a3d0-aa296f57be90 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:21:26.670001 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-dc489006-cd14-40e1-a3d0-aa296f57be90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:21:26.756945 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:26.796998 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f0850-afe8-4568-b935-18549d23a15b None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:26.844052 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 357/723] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:21:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:21:26.850996 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b61e5-3056-4e70-8b37-f77d90e3e186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:26.851798 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b61e5-3056-4e70-8b37-f77d90e3e186 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:26.852082 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b61e5-3056-4e70-8b37-f77d90e3e186 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:26.852352 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b61e5-3056-4e70-8b37-f77d90e3e186 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:26.873766 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b61e5-3056-4e70-8b37-f77d90e3e186 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:21:26.881903 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-a94b61e5-3056-4e70-8b37-f77d90e3e186 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:21:26.881903 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:26.881903 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:26.881903 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:26.881903 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:26.881903 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:26.881903 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:26.881903 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:26.881903 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:26.881903 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:26.881903 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:26.881903 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:26.881903 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:21:26.881903 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:21:26.881903 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:21:26.881903 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:21:26.882830 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:21:26.882830 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:21:26.882830 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:21:26.882830 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:21:26.882830 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:26.882830 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:26.882830 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:26.882830 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:26.882830 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:26.882830 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:26.882830 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:26.882830 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:26.882830 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:26.882830 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:26.882830 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:26.882830 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:26.884284 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:26.884284 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:26.884284 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:26.884284 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:26.884284 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:21:26.884284 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:21:26.884284 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:21:26.884284 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:21:26.884284 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:21:26.884284 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:21:26.884284 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:21:26.884284 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:26.884284 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 367/724] 10.222.0.16 () {56 vars in 1096 bytes} [Thu May 26 12:21:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:26.890274 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc489006-cd14-40e1-a3d0-aa296f57be90 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:26.912869 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b61e5-3056-4e70-8b37-f77d90e3e186 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:26.928718 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:27.018178 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc489006-cd14-40e1-a3d0-aa296f57be90 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:27.039163 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b61e5-3056-4e70-8b37-f77d90e3e186 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:27.054687 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d21854f-42fa-4135-b3bd-024d03ae6eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:27.055358 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21854f-42fa-4135-b3bd-024d03ae6eeb None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:27.055640 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21854f-42fa-4135-b3bd-024d03ae6eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:27.055913 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21854f-42fa-4135-b3bd-024d03ae6eeb None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:27.056768 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d21854f-42fa-4135-b3bd-024d03ae6eeb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:27.057109 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d21854f-42fa-4135-b3bd-024d03ae6eeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:27.058602 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d21854f-42fa-4135-b3bd-024d03ae6eeb None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:27.068894 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 358/725] 10.222.0.16 () {56 vars in 1099 bytes} [Thu May 26 12:21:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:27.070451 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d08b58-2c5e-4831-baaf-450350dccefa None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:27.070730 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d08b58-2c5e-4831-baaf-450350dccefa None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:27.071004 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d08b58-2c5e-4831-baaf-450350dccefa None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:27.072565 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 359/726] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:21:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:21:27.073690 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d08b58-2c5e-4831-baaf-450350dccefa None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:27.079842 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e1172-9192-4532-8fa0-0b623f8a81cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:27.080639 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e1172-9192-4532-8fa0-0b623f8a81cd None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:27.080946 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e1172-9192-4532-8fa0-0b623f8a81cd None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:27.081216 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e1172-9192-4532-8fa0-0b623f8a81cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:27.083238 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:27.093237 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7e1172-9192-4532-8fa0-0b623f8a81cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:21:27.101665 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-fe7e1172-9192-4532-8fa0-0b623f8a81cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:21:27.101665 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:27.101665 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:27.101665 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:27.101665 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:27.101665 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:27.101665 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:27.101665 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:27.101665 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:27.101665 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:27.101665 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:27.101665 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:27.101665 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:21:27.101665 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:21:27.101665 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:21:27.101665 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:21:27.102836 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:21:27.102836 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:21:27.102836 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:21:27.102836 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:21:27.102836 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:27.102836 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:27.102836 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:27.102836 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:27.102836 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:27.102836 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:27.102836 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:27.102836 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:27.102836 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:27.102836 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:27.102836 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:27.102836 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:27.103887 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:27.103887 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:27.103887 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:27.103887 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:27.103887 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:21:27.103887 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:21:27.103887 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:21:27.103887 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:21:27.103887 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:21:27.103887 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:21:27.103887 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:21:27.103887 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:27.106737 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 368/727] 10.222.0.16 () {56 vars in 1102 bytes} [Thu May 26 12:21:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:21:27.108035 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf08f5d-f102-49e8-972b-6ded7ff90fd9 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:27.108418 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf08f5d-f102-49e8-972b-6ded7ff90fd9 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:27.108792 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf08f5d-f102-49e8-972b-6ded7ff90fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:27.127048 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-2cf08f5d-f102-49e8-972b-6ded7ff90fd9 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:21:27.128346 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-2cf08f5d-f102-49e8-972b-6ded7ff90fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:21:27.172262 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:27.192580 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d08b58-2c5e-4831-baaf-450350dccefa None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:27.209119 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 369/728] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:21:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:21:27.210280 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf08f5d-f102-49e8-972b-6ded7ff90fd9 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:27.228988 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d031453b-41cc-4400-8263-890f1b02b9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:27.230072 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031453b-41cc-4400-8263-890f1b02b9f7 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:27.230564 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031453b-41cc-4400-8263-890f1b02b9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:27.230985 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031453b-41cc-4400-8263-890f1b02b9f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:27.244428 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d031453b-41cc-4400-8263-890f1b02b9f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:27.246483 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d031453b-41cc-4400-8263-890f1b02b9f7 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:27.266795 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-d031453b-41cc-4400-8263-890f1b02b9f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:27.266795 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:27.266795 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:27.266795 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:27.266795 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:27.266795 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:27.266795 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:27.266795 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:27.266795 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:27.266795 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:27.266795 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:27.266795 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:27.266795 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:21:27.266795 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:21:27.266795 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:21:27.267732 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:21:27.267732 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:27.267732 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:27.267732 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:27.267732 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:27.267732 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:27.267732 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:27.267732 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:27.267732 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:27.267732 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:27.267732 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:27.267732 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:27.267732 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:27.267732 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:27.267732 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:27.267732 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:27.267732 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:27.268643 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:21:27.268643 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:21:27.268643 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:27.268643 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:27.271330 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 360/729] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:21:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:27.272571 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d031453b-41cc-4400-8263-890f1b02b9f7 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:27.335216 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf08f5d-f102-49e8-972b-6ded7ff90fd9 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:27.360969 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:27.373051 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ef72d0-f0d1-4df5-a0e6-421f1d7d2d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:27.374096 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef72d0-f0d1-4df5-a0e6-421f1d7d2d3f None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:27.374793 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef72d0-f0d1-4df5-a0e6-421f1d7d2d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:27.375066 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef72d0-f0d1-4df5-a0e6-421f1d7d2d3f None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:27.376379 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ef72d0-f0d1-4df5-a0e6-421f1d7d2d3f None admin] RBAC: Adding query filter params (name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:27.376820 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ef72d0-f0d1-4df5-a0e6-421f1d7d2d3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:27.378345 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ef72d0-f0d1-4df5-a0e6-421f1d7d2d3f None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:27.387255 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d031453b-41cc-4400-8263-890f1b02b9f7 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:27.387750 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 370/730] 10.222.0.16 () {56 vars in 1103 bytes} [Thu May 26 12:21:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:27.388203 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ef72d0-f0d1-4df5-a0e6-421f1d7d2d3f None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:27.426878 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e8f6d-8b68-4586-9c8f-3e58d1d7ae4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:27.428082 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e8f6d-8b68-4586-9c8f-3e58d1d7ae4b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:27.428605 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e8f6d-8b68-4586-9c8f-3e58d1d7ae4b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:27.429195 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e8f6d-8b68-4586-9c8f-3e58d1d7ae4b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:27.433100 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:27.444467 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99e8f6d-8b68-4586-9c8f-3e58d1d7ae4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:21:27.453619 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-f99e8f6d-8b68-4586-9c8f-3e58d1d7ae4b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:21:27.453619 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:27.453619 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:27.453619 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:27.453619 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:27.453619 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:27.453619 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:27.453619 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:27.453619 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:27.453619 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:27.453619 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:27.453619 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:27.453619 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:21:27.453619 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:21:27.453619 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:21:27.453619 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:21:27.454710 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:21:27.454710 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:21:27.454710 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:21:27.454710 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:21:27.454710 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:27.454710 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:27.454710 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:27.454710 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:27.454710 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:27.454710 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:27.454710 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:27.454710 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:27.454710 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:27.454710 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:27.454710 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:27.454710 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:27.455551 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:27.455551 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:27.455551 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:27.455551 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:27.455551 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:21:27.455551 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:21:27.455551 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:21:27.455551 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:21:27.455551 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:21:27.455551 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:21:27.455551 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:21:27.455551 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:27.455551 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 361/731] 10.222.0.16 () {56 vars in 1096 bytes} [Thu May 26 12:21:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:27.456243 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e8f6d-8b68-4586-9c8f-3e58d1d7ae4b None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:27.510624 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ef72d0-f0d1-4df5-a0e6-421f1d7d2d3f None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:27.546538 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3350a6-fc06-4b0d-ba3e-3ea0a1786a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:27.548245 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3350a6-fc06-4b0d-ba3e-3ea0a1786a1e None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:27.548806 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3350a6-fc06-4b0d-ba3e-3ea0a1786a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:27.549306 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3350a6-fc06-4b0d-ba3e-3ea0a1786a1e None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:27.550227 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3350a6-fc06-4b0d-ba3e-3ea0a1786a1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:27.550731 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3350a6-fc06-4b0d-ba3e-3ea0a1786a1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:27.552496 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3350a6-fc06-4b0d-ba3e-3ea0a1786a1e None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:27.566543 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 371/732] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:21:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:27.567677 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3350a6-fc06-4b0d-ba3e-3ea0a1786a1e None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:27.568456 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e8f6d-8b68-4586-9c8f-3e58d1d7ae4b None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:27.611426 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb07df-bd45-4df5-8a09-798f53aa2094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:27.612226 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb07df-bd45-4df5-8a09-798f53aa2094 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:27.612568 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb07df-bd45-4df5-8a09-798f53aa2094 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:27.612883 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb07df-bd45-4df5-8a09-798f53aa2094 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:27.624415 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:27.624794 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb07df-bd45-4df5-8a09-798f53aa2094 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:27.626509 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb07df-bd45-4df5-8a09-798f53aa2094 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:27.643958 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-34cb07df-bd45-4df5-8a09-798f53aa2094 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:27.643958 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:27.643958 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:27.643958 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:27.643958 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:27.643958 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:27.643958 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:27.643958 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:27.643958 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:27.643958 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:27.643958 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:27.643958 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:27.643958 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:21:27.643958 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:21:27.643958 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:21:27.644879 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:21:27.644879 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:27.644879 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:27.644879 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:27.644879 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:27.644879 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:27.644879 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:27.644879 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:27.644879 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:27.644879 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:27.644879 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:27.644879 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:27.644879 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:27.644879 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:27.644879 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:27.644879 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:27.644879 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:27.645818 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:21:27.645818 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:21:27.645818 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:27.645818 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:27.645818 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 362/733] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:21:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:27.646486 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb07df-bd45-4df5-8a09-798f53aa2094 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:27.690667 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3350a6-fc06-4b0d-ba3e-3ea0a1786a1e None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:27.701210 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:27.726167 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc71d24-7456-47a4-b061-68dc09f107c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:27.726835 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc71d24-7456-47a4-b061-68dc09f107c5 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:27.727118 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc71d24-7456-47a4-b061-68dc09f107c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:27.727394 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc71d24-7456-47a4-b061-68dc09f107c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:27.728139 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc71d24-7456-47a4-b061-68dc09f107c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:27.728446 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc71d24-7456-47a4-b061-68dc09f107c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:27.729855 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc71d24-7456-47a4-b061-68dc09f107c5 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:27.743176 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 372/734] 10.222.0.16 () {56 vars in 1099 bytes} [Thu May 26 12:21:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:27.743176 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e74393-9652-4efb-9819-59f09d77cbc9 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:27.743176 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e74393-9652-4efb-9819-59f09d77cbc9 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:27.743176 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e74393-9652-4efb-9819-59f09d77cbc9 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:27.743176 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 373/735] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:21:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:21:27.743176 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e74393-9652-4efb-9819-59f09d77cbc9 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:27.768445 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb07df-bd45-4df5-8a09-798f53aa2094 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:27.803622 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c59264-aaff-4823-8825-329a2acc5b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:27.804405 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c59264-aaff-4823-8825-329a2acc5b11 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:27.804688 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c59264-aaff-4823-8825-329a2acc5b11 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:27.804994 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c59264-aaff-4823-8825-329a2acc5b11 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:27.812378 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c59264-aaff-4823-8825-329a2acc5b11 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:27.813888 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c59264-aaff-4823-8825-329a2acc5b11 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:27.827446 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-d1c59264-aaff-4823-8825-329a2acc5b11 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 12:21:27.827446 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:27.827446 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:27.827446 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:27.827446 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:27.827446 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:27.827446 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:27.827446 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:27.827446 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:27.827446 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:27.827446 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:27.827446 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:27.827446 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:21:27.827446 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:21:27.827446 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:21:27.827446 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:21:27.828571 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:27.828571 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:27.828571 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:21:27.828571 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:21:27.828571 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:21:27.828571 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:21:27.828571 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:27.828571 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:27.828571 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:27.828571 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:27.828571 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:27.828571 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:27.828571 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:27.828571 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:27.828571 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:27.828571 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:27.828571 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:27.828571 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:27.829869 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:27.829869 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:27.829869 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:21:27.829869 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:21:27.829869 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:21:27.829869 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:21:27.829869 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:21:27.829869 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:21:27.829869 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 12:21:27.829869 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:27.829869 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 363/736] 10.222.0.16 () {56 vars in 1096 bytes} [Thu May 26 12:21:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:27.829869 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c59264-aaff-4823-8825-329a2acc5b11 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:27.852439 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e74393-9652-4efb-9819-59f09d77cbc9 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:27.862029 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:27.887873 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdaf574-1225-4950-a084-5e79694e5517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:27.888513 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdaf574-1225-4950-a084-5e79694e5517 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:27.888790 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdaf574-1225-4950-a084-5e79694e5517 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:27.889086 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdaf574-1225-4950-a084-5e79694e5517 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:27.889794 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdaf574-1225-4950-a084-5e79694e5517 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:27.890096 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdaf574-1225-4950-a084-5e79694e5517 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:27.891473 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdaf574-1225-4950-a084-5e79694e5517 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:27.902809 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 374/737] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:21:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:27.903754 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eadda5-813e-44e7-87c6-4fe04c4d7228 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:27.904037 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eadda5-813e-44e7-87c6-4fe04c4d7228 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:27.904309 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eadda5-813e-44e7-87c6-4fe04c4d7228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:27.920109 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-f5eadda5-813e-44e7-87c6-4fe04c4d7228 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:21:27.921290 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-f5eadda5-813e-44e7-87c6-4fe04c4d7228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:21:27.932016 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c59264-aaff-4823-8825-329a2acc5b11 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:27.941062 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:27.965871 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae02fb-6a81-4acc-b06b-91d8430d68a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:27.966659 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae02fb-6a81-4acc-b06b-91d8430d68a3 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:27.966945 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae02fb-6a81-4acc-b06b-91d8430d68a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:27.967228 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae02fb-6a81-4acc-b06b-91d8430d68a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:27.978227 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae02fb-6a81-4acc-b06b-91d8430d68a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:27.979699 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae02fb-6a81-4acc-b06b-91d8430d68a3 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:27.988604 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 375/738] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:21:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:21:27.989923 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53a9be-2790-4edf-b9de-bbd5a34b2606 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:27.990257 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53a9be-2790-4edf-b9de-bbd5a34b2606 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:27.990531 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53a9be-2790-4edf-b9de-bbd5a34b2606 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:27.991764 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 376/739] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:21:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:21:27.992434 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c53a9be-2790-4edf-b9de-bbd5a34b2606 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:28.005824 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-58ae02fb-6a81-4acc-b06b-91d8430d68a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:28.005824 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:28.005824 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:28.005824 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:28.005824 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:28.005824 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:28.005824 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:28.005824 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:28.005824 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:28.005824 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:28.005824 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:28.005824 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:28.005824 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:21:28.005824 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:21:28.005824 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:21:28.006739 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:21:28.006739 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:28.006739 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:28.006739 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:28.006739 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:28.006739 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:28.006739 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:28.006739 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:28.006739 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:28.006739 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:28.006739 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:28.006739 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:28.006739 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:28.006739 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:28.006739 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:28.006739 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:28.006739 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:28.007623 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:21:28.007623 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:21:28.007623 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:28.007623 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:28.007623 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 364/740] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:21:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:28.007930 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae02fb-6a81-4acc-b06b-91d8430d68a3 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:28.092829 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:28.100233 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c53a9be-2790-4edf-b9de-bbd5a34b2606 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:28.109001 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae02fb-6a81-4acc-b06b-91d8430d68a3 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:28.132667 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b41684-2aa9-4983-bccb-93b712e89ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:28.133344 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b41684-2aa9-4983-bccb-93b712e89ab6 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:28.133624 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b41684-2aa9-4983-bccb-93b712e89ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:28.133892 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b41684-2aa9-4983-bccb-93b712e89ab6 None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:28.134715 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b41684-2aa9-4983-bccb-93b712e89ab6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:28.135017 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b41684-2aa9-4983-bccb-93b712e89ab6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:28.136421 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b41684-2aa9-4983-bccb-93b712e89ab6 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:28.140695 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c4b11-f030-4c16-bdba-a15d84eb5a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:28.142027 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c4b11-f030-4c16-bdba-a15d84eb5a19 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:28.142300 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c4b11-f030-4c16-bdba-a15d84eb5a19 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:28.142574 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c4b11-f030-4c16-bdba-a15d84eb5a19 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:28.149829 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118c4b11-f030-4c16-bdba-a15d84eb5a19 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:28.151255 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118c4b11-f030-4c16-bdba-a15d84eb5a19 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:28.153651 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 377/741] 10.222.0.16 () {56 vars in 1135 bytes} [Thu May 26 12:21:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:28.154784 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16550f2d-024a-4fea-bf9c-c1e5109f3b40 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:28.155068 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16550f2d-024a-4fea-bf9c-c1e5109f3b40 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:28.155339 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16550f2d-024a-4fea-bf9c-c1e5109f3b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:28.170854 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-118c4b11-f030-4c16-bdba-a15d84eb5a19 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 12:21:28.170854 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:28.170854 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:28.170854 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:28.170854 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:28.170854 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:28.170854 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:28.170854 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:28.170854 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:28.170854 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:28.170854 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:28.170854 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:28.170854 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:21:28.170854 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:21:28.170854 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:21:28.170854 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:21:28.171807 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:28.171807 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:28.171807 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:21:28.171807 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:21:28.171807 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:21:28.171807 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:21:28.171807 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:28.171807 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:28.171807 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:28.171807 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:28.171807 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:28.171807 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:28.171807 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:28.171807 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:28.171807 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:28.171807 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:28.171807 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:28.171807 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:28.172802 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:28.172802 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:28.172802 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:21:28.172802 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:21:28.172802 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:21:28.172802 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:21:28.172802 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:21:28.172802 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:21:28.172802 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 12:21:28.172802 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:28.173941 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-16550f2d-024a-4fea-bf9c-c1e5109f3b40 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:21:28.174016 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 365/742] 10.222.0.16 () {56 vars in 1117 bytes} [Thu May 26 12:21:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:28.174100 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-16550f2d-024a-4fea-bf9c-c1e5109f3b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:21:28.174172 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c4b11-f030-4c16-bdba-a15d84eb5a19 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:28.196647 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:28.239915 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 378/743] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:21:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:21:28.240751 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16550f2d-024a-4fea-bf9c-c1e5109f3b40 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:28.273951 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c4b11-f030-4c16-bdba-a15d84eb5a19 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:28.307399 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d7f3e0-5f93-4b24-a2f0-815fa3184160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:28.308055 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7f3e0-5f93-4b24-a2f0-815fa3184160 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:28.308340 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7f3e0-5f93-4b24-a2f0-815fa3184160 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:28.308617 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7f3e0-5f93-4b24-a2f0-815fa3184160 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:28.309394 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d7f3e0-5f93-4b24-a2f0-815fa3184160 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:28.310777 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d7f3e0-5f93-4b24-a2f0-815fa3184160 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:28.325796 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 366/744] 10.222.0.16 () {60 vars in 1141 bytes} [Thu May 26 12:21:28 2022] POST /identity/v3/services => generated 251 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:21:28.326630 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d7f3e0-5f93-4b24-a2f0-815fa3184160 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:28.327426 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:28.344089 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16550f2d-024a-4fea-bf9c-c1e5109f3b40 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:28.402951 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9723bf7-65d1-43ed-a20f-43e1ba352a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:28.403626 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9723bf7-65d1-43ed-a20f-43e1ba352a68 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:28.403987 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9723bf7-65d1-43ed-a20f-43e1ba352a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:28.404218 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9723bf7-65d1-43ed-a20f-43e1ba352a68 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:28.404985 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9723bf7-65d1-43ed-a20f-43e1ba352a68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:28.405286 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9723bf7-65d1-43ed-a20f-43e1ba352a68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:28.406687 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9723bf7-65d1-43ed-a20f-43e1ba352a68 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:28.424219 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 379/745] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:21:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:28.424219 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9723bf7-65d1-43ed-a20f-43e1ba352a68 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:28.425292 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:28.453187 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d7f3e0-5f93-4b24-a2f0-815fa3184160 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:28.491727 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf761de-7903-4dea-9e00-7c3854f467b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:28.492392 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf761de-7903-4dea-9e00-7c3854f467b2 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:28.492677 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf761de-7903-4dea-9e00-7c3854f467b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:28.493014 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf761de-7903-4dea-9e00-7c3854f467b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:28.539000 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9723bf7-65d1-43ed-a20f-43e1ba352a68 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:28.572638 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf761de-7903-4dea-9e00-7c3854f467b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:28.574048 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592c5679-ebf2-44ec-b819-d03ee8c1b9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:28.574276 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf761de-7903-4dea-9e00-7c3854f467b2 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:28.574715 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c5679-ebf2-44ec-b819-d03ee8c1b9f7 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:28.574996 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c5679-ebf2-44ec-b819-d03ee8c1b9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:28.575271 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c5679-ebf2-44ec-b819-d03ee8c1b9f7 None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:28.576111 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592c5679-ebf2-44ec-b819-d03ee8c1b9f7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:28.576420 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592c5679-ebf2-44ec-b819-d03ee8c1b9f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:28.577927 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592c5679-ebf2-44ec-b819-d03ee8c1b9f7 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:28.594041 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:28.598078 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 380/746] 10.222.0.16 () {56 vars in 1149 bytes} [Thu May 26 12:21:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:28.599242 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592c5679-ebf2-44ec-b819-d03ee8c1b9f7 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:28.664062 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:28.684693 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 367/747] 10.222.0.16 () {58 vars in 1282 bytes} [Thu May 26 12:21:28 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:21:28.685765 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf761de-7903-4dea-9e00-7c3854f467b2 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:28.714605 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592c5679-ebf2-44ec-b819-d03ee8c1b9f7 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:28.754727 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9498ddd4-acef-40b8-9a82-76dd781ce5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:28.755398 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498ddd4-acef-40b8-9a82-76dd781ce5a0 None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:28.755855 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498ddd4-acef-40b8-9a82-76dd781ce5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:28.756144 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498ddd4-acef-40b8-9a82-76dd781ce5a0 None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:28.757275 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9498ddd4-acef-40b8-9a82-76dd781ce5a0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:28.759085 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9498ddd4-acef-40b8-9a82-76dd781ce5a0 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:28.780958 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 381/748] 10.222.0.16 () {60 vars in 1141 bytes} [Thu May 26 12:21:28 2022] POST /identity/v3/services => generated 240 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:21:28.780958 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9498ddd4-acef-40b8-9a82-76dd781ce5a0 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:28.803841 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf761de-7903-4dea-9e00-7c3854f467b2 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:28.857777 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f6304-4b0a-4f72-a1ff-c8efa9946baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:28.859385 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f6304-4b0a-4f72-a1ff-c8efa9946baa None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:28.859676 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f6304-4b0a-4f72-a1ff-c8efa9946baa None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:28.859998 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f6304-4b0a-4f72-a1ff-c8efa9946baa None admin] PATH_INFO: `/v3/users/nova` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:28.863306 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:28.876888 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0f6304-4b0a-4f72-a1ff-c8efa9946baa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:28.878646 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0f6304-4b0a-4f72-a1ff-c8efa9946baa None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:28.900505 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-bb0f6304-4b0a-4f72-a1ff-c8efa9946baa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 12:21:28.900505 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:28.900505 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:28.900505 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:28.900505 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:28.900505 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:28.900505 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:28.900505 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:28.900505 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:28.900505 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:28.900505 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:28.900505 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:28.900505 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:21:28.900505 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:21:28.900505 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:21:28.900505 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:21:28.901581 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:28.901581 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:28.901581 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:21:28.901581 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:21:28.901581 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:21:28.901581 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:21:28.901581 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:28.901581 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:28.901581 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:28.901581 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:28.901581 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:28.901581 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:28.901581 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:28.901581 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:28.901581 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:28.901581 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:28.901581 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:28.901581 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:28.902540 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:28.902540 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:28.902540 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:21:28.902540 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:21:28.902540 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:21:28.902540 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:21:28.902540 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:21:28.902540 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:21:28.902540 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 12:21:28.902540 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:28.902540 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 368/749] 10.222.0.16 () {56 vars in 1093 bytes} [Thu May 26 12:21:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:28.903631 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f6304-4b0a-4f72-a1ff-c8efa9946baa None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:28.914695 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9498ddd4-acef-40b8-9a82-76dd781ce5a0 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:28.950897 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:28.971750 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8258abe6-071f-4f20-9209-f799965b80ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:28.972410 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258abe6-071f-4f20-9209-f799965b80ca None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:28.972690 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258abe6-071f-4f20-9209-f799965b80ca None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:28.973076 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258abe6-071f-4f20-9209-f799965b80ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:29.043201 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f6304-4b0a-4f72-a1ff-c8efa9946baa None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:29.057282 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8258abe6-071f-4f20-9209-f799965b80ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:29.058826 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8258abe6-071f-4f20-9209-f799965b80ca None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:29.089457 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39eec07-2b28-4d53-a8d6-d981a05107b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:29.090498 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39eec07-2b28-4d53-a8d6-d981a05107b5 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:29.091170 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39eec07-2b28-4d53-a8d6-d981a05107b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:29.091458 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39eec07-2b28-4d53-a8d6-d981a05107b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:29.104669 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39eec07-2b28-4d53-a8d6-d981a05107b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:29.106614 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39eec07-2b28-4d53-a8d6-d981a05107b5 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:29.124379 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:29.131439 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-a39eec07-2b28-4d53-a8d6-d981a05107b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:29.131439 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:29.131439 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:29.131439 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:29.131439 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:29.131439 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:29.131439 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:29.131439 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:29.131439 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:29.131439 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:29.131439 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:29.131439 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:29.131439 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:21:29.131439 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:21:29.131439 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:21:29.132351 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:21:29.132351 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:29.132351 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:29.132351 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:29.132351 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:29.132351 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:29.132351 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:29.132351 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:29.132351 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:29.132351 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:29.132351 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:29.132351 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:29.132351 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:29.132351 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:29.132351 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:29.132351 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:29.132351 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:29.133881 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:21:29.133881 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:21:29.133881 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:29.133881 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:29.133881 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 369/750] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:21:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:29.133881 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39eec07-2b28-4d53-a8d6-d981a05107b5 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:29.174992 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 382/751] 10.222.0.16 () {58 vars in 1282 bytes} [Thu May 26 12:21:28 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:21:29.176156 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8258abe6-071f-4f20-9209-f799965b80ca None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:29.252695 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39eec07-2b28-4d53-a8d6-d981a05107b5 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:29.269250 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:29.289398 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a54d3b-1d81-415a-be88-3608884936c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:29.290204 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a54d3b-1d81-415a-be88-3608884936c7 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:29.290584 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a54d3b-1d81-415a-be88-3608884936c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:29.290949 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a54d3b-1d81-415a-be88-3608884936c7 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:29.291878 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a54d3b-1d81-415a-be88-3608884936c7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:29.292280 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a54d3b-1d81-415a-be88-3608884936c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:29.293836 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a54d3b-1d81-415a-be88-3608884936c7 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:29.302346 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8258abe6-071f-4f20-9209-f799965b80ca None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:29.316396 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 370/752] 10.222.0.16 () {56 vars in 1133 bytes} [Thu May 26 12:21:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:29.317423 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a54d3b-1d81-415a-be88-3608884936c7 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:29.348686 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d654a72-148a-4ecb-888d-fb44da6cfb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:29.349597 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d654a72-148a-4ecb-888d-fb44da6cfb01 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:29.350055 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d654a72-148a-4ecb-888d-fb44da6cfb01 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:29.350500 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d654a72-148a-4ecb-888d-fb44da6cfb01 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:29.352306 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d654a72-148a-4ecb-888d-fb44da6cfb01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:29.352767 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d654a72-148a-4ecb-888d-fb44da6cfb01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:29.354281 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d654a72-148a-4ecb-888d-fb44da6cfb01 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:29.370577 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 383/753] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:21:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:29.371671 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d654a72-148a-4ecb-888d-fb44da6cfb01 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:29.395541 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:29.425632 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a54d3b-1d81-415a-be88-3608884936c7 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:29.464798 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927db6cc-ccce-4217-a582-f84b95a40524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:29.465756 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927db6cc-ccce-4217-a582-f84b95a40524 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:29.466099 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927db6cc-ccce-4217-a582-f84b95a40524 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:29.466469 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927db6cc-ccce-4217-a582-f84b95a40524 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:29.480759 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d654a72-148a-4ecb-888d-fb44da6cfb01 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:29.481287 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927db6cc-ccce-4217-a582-f84b95a40524 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:29.482411 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927db6cc-ccce-4217-a582-f84b95a40524 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:29.491086 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:29.505694 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-927db6cc-ccce-4217-a582-f84b95a40524 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:29.505694 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:29.505694 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:29.505694 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:29.505694 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:29.505694 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:29.505694 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:29.505694 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:29.505694 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:29.505694 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:29.505694 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:29.505694 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:29.505694 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:21:29.505694 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:21:29.505694 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:21:29.506591 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:21:29.506591 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:29.506591 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:29.506591 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:29.506591 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:29.506591 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:29.506591 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:29.506591 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:29.506591 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:29.506591 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:29.506591 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:29.506591 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:29.506591 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:29.506591 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:29.506591 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:29.506591 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:29.506591 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:29.507793 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:21:29.507793 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:21:29.507793 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:29.507793 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:29.507793 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 371/754] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:21:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:29.508262 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927db6cc-ccce-4217-a582-f84b95a40524 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:29.521385 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125f34da-5cda-467a-aadf-cc687c2d9453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:29.522419 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f34da-5cda-467a-aadf-cc687c2d9453 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:29.522869 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f34da-5cda-467a-aadf-cc687c2d9453 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:29.523317 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f34da-5cda-467a-aadf-cc687c2d9453 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:29.534637 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125f34da-5cda-467a-aadf-cc687c2d9453 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:29.536290 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125f34da-5cda-467a-aadf-cc687c2d9453 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:29.554847 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-125f34da-5cda-467a-aadf-cc687c2d9453 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:29.554847 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:29.554847 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:29.554847 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:29.554847 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:29.554847 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:29.554847 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:29.554847 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:29.554847 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:29.554847 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:29.554847 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:29.554847 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:29.554847 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:21:29.554847 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:21:29.554847 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:21:29.555791 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:21:29.555791 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:29.555791 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:29.555791 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:29.555791 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:29.555791 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:29.555791 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:29.555791 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:29.555791 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:29.555791 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:29.555791 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:29.555791 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:29.555791 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:29.555791 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:29.555791 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:29.555791 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:29.555791 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:29.556754 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:21:29.556754 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:21:29.556754 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:29.556754 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:29.559152 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 384/755] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:21:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:29.560415 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125f34da-5cda-467a-aadf-cc687c2d9453 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:29.619906 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927db6cc-ccce-4217-a582-f84b95a40524 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:29.633347 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:29.660405 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e4324-d10f-46be-84f2-d29487127461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:29.661567 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e4324-d10f-46be-84f2-d29487127461 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:29.662060 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e4324-d10f-46be-84f2-d29487127461 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:29.662525 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e4324-d10f-46be-84f2-d29487127461 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:29.665245 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125f34da-5cda-467a-aadf-cc687c2d9453 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:29.670200 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9e4324-d10f-46be-84f2-d29487127461 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:29.671839 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9e4324-d10f-46be-84f2-d29487127461 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:29.687779 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-3e9e4324-d10f-46be-84f2-d29487127461 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:21:29.687779 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:29.687779 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:29.687779 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:29.687779 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:29.687779 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:29.687779 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:29.687779 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:29.687779 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:29.687779 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:29.687779 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:29.687779 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:29.687779 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:21:29.687779 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:21:29.687779 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:21:29.689432 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:21:29.689432 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:29.689432 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:29.689432 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:29.689432 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:29.689432 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:29.689432 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:29.689432 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:29.689432 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:29.689432 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:29.689432 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:29.689432 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:29.689432 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:29.689432 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:29.689432 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:29.689432 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:29.689432 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:29.690554 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:21:29.690554 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:21:29.690554 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:21:29.690554 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:21:29.690554 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:21:29.690554 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:21:29.690554 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:21:29.690554 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:29.692616 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 372/756] 10.222.0.16 () {56 vars in 1111 bytes} [Thu May 26 12:21:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:29.693821 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e4324-d10f-46be-84f2-d29487127461 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:29.704045 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb762f4-7a41-4422-9ca3-cf6cde38fed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:29.704869 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb762f4-7a41-4422-9ca3-cf6cde38fed9 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:29.705582 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb762f4-7a41-4422-9ca3-cf6cde38fed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:29.705582 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb762f4-7a41-4422-9ca3-cf6cde38fed9 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:29.706533 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb762f4-7a41-4422-9ca3-cf6cde38fed9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:29.707013 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb762f4-7a41-4422-9ca3-cf6cde38fed9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:29.708473 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb762f4-7a41-4422-9ca3-cf6cde38fed9 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:29.721714 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 385/757] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:21:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:29.722957 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb762f4-7a41-4422-9ca3-cf6cde38fed9 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:29.770227 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:29.818515 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e4324-d10f-46be-84f2-d29487127461 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:29.826094 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb762f4-7a41-4422-9ca3-cf6cde38fed9 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:29.855889 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfee1e7-7101-47ac-aa97-7190beea6888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:29.856779 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:29.857603 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfee1e7-7101-47ac-aa97-7190beea6888 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:29.857958 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfee1e7-7101-47ac-aa97-7190beea6888 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:29.858241 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfee1e7-7101-47ac-aa97-7190beea6888 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:29.859086 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfee1e7-7101-47ac-aa97-7190beea6888 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:29.859396 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfee1e7-7101-47ac-aa97-7190beea6888 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:29.861580 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfee1e7-7101-47ac-aa97-7190beea6888 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:29.862827 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db1925-0ec9-4293-8fa1-0c21151f78aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:29.863547 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db1925-0ec9-4293-8fa1-0c21151f78aa None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:29.863907 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db1925-0ec9-4293-8fa1-0c21151f78aa None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:29.864411 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db1925-0ec9-4293-8fa1-0c21151f78aa None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:29.865401 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14db1925-0ec9-4293-8fa1-0c21151f78aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:29.865890 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14db1925-0ec9-4293-8fa1-0c21151f78aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:29.867402 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14db1925-0ec9-4293-8fa1-0c21151f78aa None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:29.875650 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 373/758] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:21:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:29.876607 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfee1e7-7101-47ac-aa97-7190beea6888 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:29.880155 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 386/759] 10.222.0.16 () {56 vars in 1148 bytes} [Thu May 26 12:21:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:29.881204 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db1925-0ec9-4293-8fa1-0c21151f78aa None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:29.985995 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db1925-0ec9-4293-8fa1-0c21151f78aa None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:29.986398 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfee1e7-7101-47ac-aa97-7190beea6888 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:30.005807 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:30.021687 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957340d0-519c-47e6-82c3-ef430e2d4dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:30.022625 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957340d0-519c-47e6-82c3-ef430e2d4dcb None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:30.022971 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957340d0-519c-47e6-82c3-ef430e2d4dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:30.023420 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957340d0-519c-47e6-82c3-ef430e2d4dcb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:30.026841 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa19fcf-8397-45ee-924e-7ac5403729a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:30.027761 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa19fcf-8397-45ee-924e-7ac5403729a5 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:30.028049 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa19fcf-8397-45ee-924e-7ac5403729a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:30.028324 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa19fcf-8397-45ee-924e-7ac5403729a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:30.032887 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957340d0-519c-47e6-82c3-ef430e2d4dcb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:30.034441 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957340d0-519c-47e6-82c3-ef430e2d4dcb None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:30.036649 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa19fcf-8397-45ee-924e-7ac5403729a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:30.038246 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa19fcf-8397-45ee-924e-7ac5403729a5 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:30.050224 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-957340d0-519c-47e6-82c3-ef430e2d4dcb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:21:30.050224 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:30.050224 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:30.050224 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:30.050224 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:30.050224 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:30.050224 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:30.050224 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:30.050224 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:30.050224 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:30.050224 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:30.050224 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:30.050224 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:21:30.050224 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:21:30.050224 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:21:30.051962 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:21:30.051962 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:30.051962 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:30.051962 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:30.051962 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:30.051962 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:30.051962 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:30.051962 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:30.051962 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:30.051962 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:30.051962 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:30.051962 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:30.051962 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:30.051962 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:30.051962 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:30.051962 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:30.051962 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:30.054027 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:21:30.054027 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:21:30.054027 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:21:30.054027 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:21:30.054027 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:21:30.054027 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:21:30.054027 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:21:30.054027 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:30.054027 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 387/760] 10.222.0.16 () {56 vars in 1111 bytes} [Thu May 26 12:21:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:30.055034 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-3fa19fcf-8397-45ee-924e-7ac5403729a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:21:30.055034 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:30.055034 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:30.055034 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:30.055034 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:30.055034 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:30.055034 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:30.055034 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:30.055034 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:30.055034 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:30.055034 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:30.055034 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:30.055034 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:21:30.055034 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:21:30.055034 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:21:30.056085 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:21:30.056085 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:30.056085 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:30.056085 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:30.056085 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:30.056085 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:30.056085 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:30.056085 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:30.056085 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:30.056085 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:30.056085 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:30.056085 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:30.056085 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:30.056085 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:30.056085 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:30.056085 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:30.056085 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:30.057269 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:21:30.057269 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:21:30.057269 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:21:30.057269 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:21:30.057269 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:21:30.057269 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:21:30.057269 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:21:30.057269 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:30.057790 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957340d0-519c-47e6-82c3-ef430e2d4dcb None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:30.057880 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 374/761] 10.222.0.16 () {56 vars in 1111 bytes} [Thu May 26 12:21:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:30.068861 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa19fcf-8397-45ee-924e-7ac5403729a5 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:30.110766 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:30.159828 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957340d0-519c-47e6-82c3-ef430e2d4dcb None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:30.172497 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa19fcf-8397-45ee-924e-7ac5403729a5 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:30.202291 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2941972c-57ab-46d6-8dbb-88e487d2e468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:30.203286 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941972c-57ab-46d6-8dbb-88e487d2e468 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:30.203744 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941972c-57ab-46d6-8dbb-88e487d2e468 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:30.204715 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941972c-57ab-46d6-8dbb-88e487d2e468 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:30.205796 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2941972c-57ab-46d6-8dbb-88e487d2e468 None admin] RBAC: Adding query filter params (role.id=1a8e523ecbc84d818c2a9af0fb54da74, scope.project.id=42e6c693bd224d92b8a0fe4ad0cc586d, user.id=02767dcbd1574e08a9e82a775ac2b289) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:30.206281 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2941972c-57ab-46d6-8dbb-88e487d2e468 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:30.207961 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2941972c-57ab-46d6-8dbb-88e487d2e468 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:30.210350 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa3973f-b1a0-4da6-8c97-dc4cfe9e3dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:30.211019 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3973f-b1a0-4da6-8c97-dc4cfe9e3dcc None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:30.211672 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3973f-b1a0-4da6-8c97-dc4cfe9e3dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:30.211672 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3973f-b1a0-4da6-8c97-dc4cfe9e3dcc None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:30.212451 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa3973f-b1a0-4da6-8c97-dc4cfe9e3dcc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:30.212767 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa3973f-b1a0-4da6-8c97-dc4cfe9e3dcc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:30.214297 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa3973f-b1a0-4da6-8c97-dc4cfe9e3dcc None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:30.215505 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 388/762] 10.222.0.16 () {56 vars in 1374 bytes} [Thu May 26 12:21:30 2022] GET /identity/v3/role_assignments?user.id=02767dcbd1574e08a9e82a775ac2b289&scope.project.id=42e6c693bd224d92b8a0fe4ad0cc586d&role.id=1a8e523ecbc84d818c2a9af0fb54da74 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:30.216596 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2941972c-57ab-46d6-8dbb-88e487d2e468 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:30.229088 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 375/763] 10.222.0.16 () {56 vars in 1148 bytes} [Thu May 26 12:21:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:30.238314 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa3973f-b1a0-4da6-8c97-dc4cfe9e3dcc None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:30.327124 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:30.431081 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2941972c-57ab-46d6-8dbb-88e487d2e468 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:30.456278 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa3973f-b1a0-4da6-8c97-dc4cfe9e3dcc None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:30.472327 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:30.496092 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0775c75-f5c0-472e-809e-be7f596215f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:30.498138 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0775c75-f5c0-472e-809e-be7f596215f4 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:30.498640 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0775c75-f5c0-472e-809e-be7f596215f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:30.499125 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0775c75-f5c0-472e-809e-be7f596215f4 None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:30.500152 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0775c75-f5c0-472e-809e-be7f596215f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:30.500682 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0775c75-f5c0-472e-809e-be7f596215f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:30.503115 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0775c75-f5c0-472e-809e-be7f596215f4 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:30.518048 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 389/764] 10.222.0.16 () {56 vars in 1148 bytes} [Thu May 26 12:21:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:30.525111 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0775c75-f5c0-472e-809e-be7f596215f4 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:30.549555 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc830c6b-d108-4248-9984-d53164fbf6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:30.550224 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc830c6b-d108-4248-9984-d53164fbf6c9 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:30.550503 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc830c6b-d108-4248-9984-d53164fbf6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:30.550772 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc830c6b-d108-4248-9984-d53164fbf6c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:30.551606 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc830c6b-d108-4248-9984-d53164fbf6c9 None admin] RBAC: Adding query filter params (role.id=2991da7c6ccc478bbfdc0ce47a959495, scope.project.id=42e6c693bd224d92b8a0fe4ad0cc586d, user.id=512b4337083145f9ae57948a63444ced) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:30.551916 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc830c6b-d108-4248-9984-d53164fbf6c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:30.553389 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc830c6b-d108-4248-9984-d53164fbf6c9 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:30.564413 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 376/765] 10.222.0.16 () {56 vars in 1374 bytes} [Thu May 26 12:21:30 2022] GET /identity/v3/role_assignments?user.id=512b4337083145f9ae57948a63444ced&scope.project.id=42e6c693bd224d92b8a0fe4ad0cc586d&role.id=2991da7c6ccc478bbfdc0ce47a959495 => generated 259 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:30.644749 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0775c75-f5c0-472e-809e-be7f596215f4 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:30.656439 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f5cd7-647a-4b76-87eb-b98d185a02d8 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:30.656779 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f5cd7-647a-4b76-87eb-b98d185a02d8 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:30.657041 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f5cd7-647a-4b76-87eb-b98d185a02d8 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:30.662332 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 377/766] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:21:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:21:30.674423 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92961bd9-fb86-4070-9235-aaf9f780500c None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:30.674746 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92961bd9-fb86-4070-9235-aaf9f780500c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:30.674985 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92961bd9-fb86-4070-9235-aaf9f780500c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:30.693992 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52c314-f170-44bb-89de-ba5894aab247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:30.695294 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52c314-f170-44bb-89de-ba5894aab247 None admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:30.695801 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52c314-f170-44bb-89de-ba5894aab247 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:30.696415 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52c314-f170-44bb-89de-ba5894aab247 None admin] PATH_INFO: `/v3/projects/42e6c693bd224d92b8a0fe4ad0cc586d/users/536f68ff77794352adf41aaacdc0645c/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:30.702190 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb52c314-f170-44bb-89de-ba5894aab247 None admin] RBAC: Authorizing `identity:create_grant(project_id=42e6c693bd224d92b8a0fe4ad0cc586d, user_id=536f68ff77794352adf41aaacdc0645c, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:30.704882 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb52c314-f170-44bb-89de-ba5894aab247 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:30.711502 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-92961bd9-fb86-4070-9235-aaf9f780500c None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:21:30.713635 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-92961bd9-fb86-4070-9235-aaf9f780500c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:21:30.735312 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 390/767] 10.222.0.16 () {58 vars in 1439 bytes} [Thu May 26 12:21:30 2022] PUT /identity/v3/projects/42e6c693bd224d92b8a0fe4ad0cc586d/users/536f68ff77794352adf41aaacdc0645c/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:21:30.827584 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 378/768] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:21:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:21:30.851774 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52c314-f170-44bb-89de-ba5894aab247 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:30.895254 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:30.979868 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52c314-f170-44bb-89de-ba5894aab247 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:31.018132 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dda336-afa6-40da-abfe-e17320480303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:31.018884 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dda336-afa6-40da-abfe-e17320480303 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:31.019165 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dda336-afa6-40da-abfe-e17320480303 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:31.019439 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dda336-afa6-40da-abfe-e17320480303 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:31.020117 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dda336-afa6-40da-abfe-e17320480303 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:31.021663 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dda336-afa6-40da-abfe-e17320480303 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:31.038705 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-f2dda336-afa6-40da-abfe-e17320480303 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 12:21:31.038705 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:31.038705 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:21:31.038705 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:21:31.038705 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:21:31.038705 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:21:31.038705 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:21:31.038705 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:21:31.038705 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 12:21:31.038705 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:31.038705 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:21:31.038705 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:31.038705 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:31.038705 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:31.038705 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:31.038705 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:31.039698 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:31.039698 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:31.039698 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:31.039698 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:31.039698 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:31.039698 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:31.039698 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:31.039698 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:21:31.039698 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:21:31.039698 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:21:31.039698 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:21:31.039698 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:31.039698 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:31.039698 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:31.039698 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:31.039698 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:31.040565 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:31.040565 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:31.040565 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:31.040565 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:31.040565 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:31.040565 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:31.040565 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:31.040565 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:31.040565 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:31.040565 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:31.040565 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:31.040565 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:21:31.040565 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:21:31.040565 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 12:21:31.040565 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:31.040565 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 391/769] 10.222.0.16 () {56 vars in 1129 bytes} [Thu May 26 12:21:30 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:31.046778 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92961bd9-fb86-4070-9235-aaf9f780500c None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:31.081412 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:31.154550 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92961bd9-fb86-4070-9235-aaf9f780500c None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:31.189859 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c943d73f-03c0-4f18-be19-851b796b0a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:31.190531 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943d73f-03c0-4f18-be19-851b796b0a04 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:31.190812 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943d73f-03c0-4f18-be19-851b796b0a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:31.191087 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943d73f-03c0-4f18-be19-851b796b0a04 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:31.191805 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c943d73f-03c0-4f18-be19-851b796b0a04 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:31.192109 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c943d73f-03c0-4f18-be19-851b796b0a04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:31.193518 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c943d73f-03c0-4f18-be19-851b796b0a04 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:31.198758 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 379/770] 10.222.0.16 () {56 vars in 1124 bytes} [Thu May 26 12:21:31 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:31.204315 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dda336-afa6-40da-abfe-e17320480303 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:31.239905 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d540a-f5fc-49db-b2cf-6b15c8ab93fa None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:31.240233 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d540a-f5fc-49db-b2cf-6b15c8ab93fa None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:31.240461 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d540a-f5fc-49db-b2cf-6b15c8ab93fa None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:31.242166 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 380/771] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:21:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:21:31.246808 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d3672-d9f5-4ccd-ac74-448acad6e4bc None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:31.247094 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d3672-d9f5-4ccd-ac74-448acad6e4bc None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:31.247367 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d3672-d9f5-4ccd-ac74-448acad6e4bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:31.282934 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-0e3d3672-d9f5-4ccd-ac74-448acad6e4bc None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:21:31.284047 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0e3d3672-d9f5-4ccd-ac74-448acad6e4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:21:31.356785 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 381/772] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:21:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:21:31.360924 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:31.371112 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dda336-afa6-40da-abfe-e17320480303 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:31.409652 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d3672-d9f5-4ccd-ac74-448acad6e4bc None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:31.419867 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c2bda6-f50b-4087-bc1d-b9da0397c7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:31.420526 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2bda6-f50b-4087-bc1d-b9da0397c7b0 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:31.420806 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2bda6-f50b-4087-bc1d-b9da0397c7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:31.421139 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2bda6-f50b-4087-bc1d-b9da0397c7b0 None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:31.421849 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c2bda6-f50b-4087-bc1d-b9da0397c7b0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:31.422155 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c2bda6-f50b-4087-bc1d-b9da0397c7b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:31.424106 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c2bda6-f50b-4087-bc1d-b9da0397c7b0 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:31.429892 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 392/773] 10.222.0.16 () {56 vars in 1124 bytes} [Thu May 26 12:21:31 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:31.440496 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c2bda6-f50b-4087-bc1d-b9da0397c7b0 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:31.463209 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:31.564011 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c2bda6-f50b-4087-bc1d-b9da0397c7b0 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:31.618851 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d3672-d9f5-4ccd-ac74-448acad6e4bc None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:31.624875 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53713876-a3ae-48a6-9371-e788de29969f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:31.625548 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53713876-a3ae-48a6-9371-e788de29969f None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:31.625867 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53713876-a3ae-48a6-9371-e788de29969f None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:31.626143 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53713876-a3ae-48a6-9371-e788de29969f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:31.626944 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53713876-a3ae-48a6-9371-e788de29969f None admin] RBAC: Adding query filter params (interface=public, service_id=3cc81640b2c443078859487a3a75c9d3, region_id=RegionOne) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:31.627251 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53713876-a3ae-48a6-9371-e788de29969f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:31.628605 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53713876-a3ae-48a6-9371-e788de29969f None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:31.650779 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 393/774] 10.222.0.16 () {56 vars in 1251 bytes} [Thu May 26 12:21:31 2022] GET /identity/v3/endpoints?service_id=3cc81640b2c443078859487a3a75c9d3&interface=public®ion_id=RegionOne => generated 194 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:31.655994 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53713876-a3ae-48a6-9371-e788de29969f None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:31.656538 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544dd164-90c2-47ab-9adc-244c66d7cd2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:31.658177 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544dd164-90c2-47ab-9adc-244c66d7cd2c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:31.658611 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544dd164-90c2-47ab-9adc-244c66d7cd2c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:31.659035 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544dd164-90c2-47ab-9adc-244c66d7cd2c None admin] PATH_INFO: `/v3/services/network` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:31.659841 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544dd164-90c2-47ab-9adc-244c66d7cd2c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:31.661410 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544dd164-90c2-47ab-9adc-244c66d7cd2c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:31.674270 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-544dd164-90c2-47ab-9adc-244c66d7cd2c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 26 12:21:31.674270 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:31.674270 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:21:31.674270 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:21:31.674270 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:21:31.674270 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:21:31.674270 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:21:31.674270 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:21:31.674270 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 12:21:31.674270 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:31.674270 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:21:31.674270 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:31.674270 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:31.674270 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:31.674270 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:31.674270 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:31.674270 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:31.675543 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:31.675543 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:31.675543 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:31.675543 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:31.675543 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:31.675543 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:31.675543 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:21:31.675543 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:21:31.675543 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:21:31.675543 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:21:31.675543 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:31.675543 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:31.675543 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:31.675543 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:31.675543 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:31.675543 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:31.676571 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:31.676571 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:31.676571 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:31.676571 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:31.676571 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:31.676571 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:31.676571 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:31.676571 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:31.676571 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:31.676571 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:31.676571 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:21:31.676571 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:21:31.676571 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 12:21:31.676571 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:31.679075 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 382/775] 10.222.0.16 () {56 vars in 1111 bytes} [Thu May 26 12:21:31 2022] GET /identity/v3/services/network => generated 88 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:31.685446 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544dd164-90c2-47ab-9adc-244c66d7cd2c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:31.713621 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:31.792114 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:31.798027 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53713876-a3ae-48a6-9371-e788de29969f None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:31.804603 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544dd164-90c2-47ab-9adc-244c66d7cd2c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:31.832892 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1802626-3604-42ff-8b85-bb622040ef3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:31.833669 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1802626-3604-42ff-8b85-bb622040ef3a None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:31.834025 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1802626-3604-42ff-8b85-bb622040ef3a None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:31.834395 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1802626-3604-42ff-8b85-bb622040ef3a None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:31.835169 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1802626-3604-42ff-8b85-bb622040ef3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:31.836688 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1802626-3604-42ff-8b85-bb622040ef3a None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:31.842408 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 394/776] 10.222.0.16 () {56 vars in 1087 bytes} [Thu May 26 12:21:31 2022] GET /identity/v3/services => generated 772 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:31.867132 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3137d3-9b08-4aef-b14d-89b479af8071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:31.867818 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3137d3-9b08-4aef-b14d-89b479af8071 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:31.868099 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3137d3-9b08-4aef-b14d-89b479af8071 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:31.868375 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3137d3-9b08-4aef-b14d-89b479af8071 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:31.869143 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3137d3-9b08-4aef-b14d-89b479af8071 None admin] RBAC: Adding query filter params (name=network) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:31.869450 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3137d3-9b08-4aef-b14d-89b479af8071 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:31.871033 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3137d3-9b08-4aef-b14d-89b479af8071 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:31.877108 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 383/777] 10.222.0.16 () {56 vars in 1112 bytes} [Thu May 26 12:21:31 2022] GET /identity/v3/services?name=network => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:31.882822 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1802626-3604-42ff-8b85-bb622040ef3a None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:31.989238 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:31.997676 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1802626-3604-42ff-8b85-bb622040ef3a None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:32.035022 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be6cb3-683e-4c18-a2a5-834399a3943b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:32.035688 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be6cb3-683e-4c18-a2a5-834399a3943b None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:32.035964 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be6cb3-683e-4c18-a2a5-834399a3943b None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:32.036237 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be6cb3-683e-4c18-a2a5-834399a3943b None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:32.037056 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94be6cb3-683e-4c18-a2a5-834399a3943b None admin] RBAC: Adding query filter params (type=network) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:32.037391 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94be6cb3-683e-4c18-a2a5-834399a3943b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:32.038762 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94be6cb3-683e-4c18-a2a5-834399a3943b None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:32.044395 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 395/778] 10.222.0.16 () {56 vars in 1112 bytes} [Thu May 26 12:21:31 2022] GET /identity/v3/services?type=network => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:32.050048 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3137d3-9b08-4aef-b14d-89b479af8071 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:32.158064 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3137d3-9b08-4aef-b14d-89b479af8071 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:32.193471 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7008ac0-44e1-45d4-a625-3072d5d020ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:32.194153 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7008ac0-44e1-45d4-a625-3072d5d020ac None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:32.194436 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7008ac0-44e1-45d4-a625-3072d5d020ac None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:32.194708 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7008ac0-44e1-45d4-a625-3072d5d020ac None admin] PATH_INFO: `/v3/endpoints` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:32.195532 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7008ac0-44e1-45d4-a625-3072d5d020ac None admin] RBAC: Adding query filter params (interface=public, service_id=b02403120a1844e1ad80f89bb2369d21, region_id=RegionOne) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:32.195842 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7008ac0-44e1-45d4-a625-3072d5d020ac None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:32.197785 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7008ac0-44e1-45d4-a625-3072d5d020ac None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:32.207200 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 384/779] 10.222.0.16 () {56 vars in 1251 bytes} [Thu May 26 12:21:32 2022] GET /identity/v3/endpoints?service_id=b02403120a1844e1ad80f89bb2369d21&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:32.212721 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be6cb3-683e-4c18-a2a5-834399a3943b None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:32.319224 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be6cb3-683e-4c18-a2a5-834399a3943b None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:32.354997 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399658d1-ca2a-4f00-ac11-8dc52e640dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:32.355653 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399658d1-ca2a-4f00-ac11-8dc52e640dbb None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:32.355932 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399658d1-ca2a-4f00-ac11-8dc52e640dbb None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:32.356204 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399658d1-ca2a-4f00-ac11-8dc52e640dbb None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:32.356924 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399658d1-ca2a-4f00-ac11-8dc52e640dbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:32.358416 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399658d1-ca2a-4f00-ac11-8dc52e640dbb None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:32.364802 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 396/780] 10.222.0.16 () {56 vars in 1087 bytes} [Thu May 26 12:21:32 2022] GET /identity/v3/services => generated 772 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:33.047795 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f59523-e8e5-4f76-9045-183469b6e711 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:33.048745 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f59523-e8e5-4f76-9045-183469b6e711 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:33.049258 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f59523-e8e5-4f76-9045-183469b6e711 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:33.051064 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 385/781] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:21:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:21:33.056362 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17be096-0bd5-4260-98e4-70c534d89fef None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:33.057279 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17be096-0bd5-4260-98e4-70c534d89fef None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:33.057765 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17be096-0bd5-4260-98e4-70c534d89fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:33.081833 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-a17be096-0bd5-4260-98e4-70c534d89fef None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:21:33.083369 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-a17be096-0bd5-4260-98e4-70c534d89fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:21:33.099861 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:33.171461 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 397/782] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:21:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:21:33.215601 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f59523-e8e5-4f76-9045-183469b6e711 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:33.241411 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:33.346492 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f59523-e8e5-4f76-9045-183469b6e711 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:33.390719 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9f21a2-e637-4201-ae1d-2900141b3ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:33.392447 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f21a2-e637-4201-ae1d-2900141b3ab1 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:33.392955 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f21a2-e637-4201-ae1d-2900141b3ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:33.393444 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f21a2-e637-4201-ae1d-2900141b3ab1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:33.409036 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9f21a2-e637-4201-ae1d-2900141b3ab1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:21:33.417127 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-9a9f21a2-e637-4201-ae1d-2900141b3ab1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:21:33.417127 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:33.417127 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:33.417127 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:33.417127 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:33.417127 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:33.417127 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:33.417127 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:33.417127 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:33.417127 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:33.417127 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:33.417127 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:33.417127 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:21:33.417127 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:21:33.417127 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:21:33.417127 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:21:33.418064 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:21:33.418064 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:21:33.418064 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:21:33.418064 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:21:33.418064 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:33.418064 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:33.418064 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:33.418064 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:33.418064 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:33.418064 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:33.418064 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:33.418064 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:33.418064 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:33.418064 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:33.418064 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:33.418064 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:33.418905 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:33.418905 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:33.418905 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:33.418905 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:33.418905 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:21:33.418905 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:21:33.418905 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:21:33.418905 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:21:33.418905 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:21:33.418905 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:21:33.418905 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:21:33.418905 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:33.425230 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 386/783] 10.222.0.16 () {56 vars in 1096 bytes} [Thu May 26 12:21:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:33.431179 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17be096-0bd5-4260-98e4-70c534d89fef None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:33.558306 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17be096-0bd5-4260-98e4-70c534d89fef None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:33.600235 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee621d3-4ccd-4a2e-a792-906494c15141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:33.601283 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee621d3-4ccd-4a2e-a792-906494c15141 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:33.603144 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d329dc-1a17-4c01-acbe-ef0452631e31 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:33.603591 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d329dc-1a17-4c01-acbe-ef0452631e31 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:33.604057 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d329dc-1a17-4c01-acbe-ef0452631e31 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:33.605693 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 387/784] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:21:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:21:33.605985 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee621d3-4ccd-4a2e-a792-906494c15141 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:33.606488 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee621d3-4ccd-4a2e-a792-906494c15141 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:33.607528 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee621d3-4ccd-4a2e-a792-906494c15141 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:33.608030 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee621d3-4ccd-4a2e-a792-906494c15141 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:33.610746 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004bcf9-7103-4712-ae76-1931e82030ab None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:33.611285 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004bcf9-7103-4712-ae76-1931e82030ab None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:33.611781 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004bcf9-7103-4712-ae76-1931e82030ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:33.616014 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee621d3-4ccd-4a2e-a792-906494c15141 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:33.639110 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 398/785] 10.222.0.16 () {56 vars in 1099 bytes} [Thu May 26 12:21:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:33.640444 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-6004bcf9-7103-4712-ae76-1931e82030ab None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:21:33.642509 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6004bcf9-7103-4712-ae76-1931e82030ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:21:33.644906 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee621d3-4ccd-4a2e-a792-906494c15141 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:33.669275 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:33.732699 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 388/786] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:21:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:21:33.734507 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66866d12-b8d7-4bd6-a9ec-94e02a1a7307 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:33.735034 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66866d12-b8d7-4bd6-a9ec-94e02a1a7307 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:33.735547 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66866d12-b8d7-4bd6-a9ec-94e02a1a7307 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:33.737312 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 389/787] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:21:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:21:33.755513 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd1d958-aafb-4e88-83f1-4cb499b3c4d1 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:33.756018 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd1d958-aafb-4e88-83f1-4cb499b3c4d1 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:33.756568 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd1d958-aafb-4e88-83f1-4cb499b3c4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:33.775722 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-9bd1d958-aafb-4e88-83f1-4cb499b3c4d1 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:21:33.777656 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9bd1d958-aafb-4e88-83f1-4cb499b3c4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:21:33.780869 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:33.805371 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee621d3-4ccd-4a2e-a792-906494c15141 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:33.841050 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d968268c-2774-42c9-a1a7-058061720bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:33.841858 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968268c-2774-42c9-a1a7-058061720bc4 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:33.842149 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968268c-2774-42c9-a1a7-058061720bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:33.842428 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968268c-2774-42c9-a1a7-058061720bc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:33.854610 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d968268c-2774-42c9-a1a7-058061720bc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:33.855829 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 390/788] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:21:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:21:33.856059 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d968268c-2774-42c9-a1a7-058061720bc4 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:33.861721 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd1d958-aafb-4e88-83f1-4cb499b3c4d1 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:33.880960 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-d968268c-2774-42c9-a1a7-058061720bc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:33.880960 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:33.880960 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:33.880960 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:33.880960 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:33.880960 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:33.880960 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:33.880960 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:33.880960 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:33.880960 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:33.880960 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:33.880960 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:33.880960 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:21:33.880960 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:21:33.880960 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:21:33.881992 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:21:33.881992 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:33.881992 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:33.881992 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:33.881992 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:33.881992 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:33.881992 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:33.881992 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:33.881992 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:33.881992 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:33.881992 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:33.881992 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:33.881992 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:33.881992 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:33.881992 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:33.881992 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:33.881992 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:33.882901 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:21:33.882901 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:21:33.882901 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:33.882901 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:33.886777 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 399/789] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:21:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:21:33.887959 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d968268c-2774-42c9-a1a7-058061720bc4 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:33.955970 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:33.995385 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd1d958-aafb-4e88-83f1-4cb499b3c4d1 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:34.009879 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d968268c-2774-42c9-a1a7-058061720bc4 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:34.036346 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db38e3-ea10-4ac6-9290-2ddc4aa0eece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:34.037170 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db38e3-ea10-4ac6-9290-2ddc4aa0eece None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:34.037454 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db38e3-ea10-4ac6-9290-2ddc4aa0eece None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:34.037731 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db38e3-ea10-4ac6-9290-2ddc4aa0eece None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:34.047571 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db38e3-ea10-4ac6-9290-2ddc4aa0eece None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:21:34.053141 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf3f129-acaa-4972-89d8-ade56b1fa122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:34.053799 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3f129-acaa-4972-89d8-ade56b1fa122 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:34.054091 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3f129-acaa-4972-89d8-ade56b1fa122 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:34.054365 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3f129-acaa-4972-89d8-ade56b1fa122 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:34.055093 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf3f129-acaa-4972-89d8-ade56b1fa122 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:34.055400 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf3f129-acaa-4972-89d8-ade56b1fa122 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:34.056762 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf3f129-acaa-4972-89d8-ade56b1fa122 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:34.057312 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:34.060125 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-b4db38e3-ea10-4ac6-9290-2ddc4aa0eece None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:21:34.060125 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:34.060125 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:34.060125 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:34.060125 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:34.060125 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:34.060125 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:34.060125 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:34.060125 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:34.060125 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:34.060125 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:34.060125 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:34.060125 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:21:34.060125 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:21:34.060125 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:21:34.060125 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:21:34.061193 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:21:34.061193 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:21:34.061193 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:21:34.061193 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:21:34.061193 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:34.061193 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:34.061193 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:34.061193 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:34.061193 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:34.061193 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:34.061193 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:34.061193 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:34.061193 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:34.061193 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:34.061193 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:34.061193 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:34.062023 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:34.062023 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:34.062023 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:34.062023 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:34.062023 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:21:34.062023 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:21:34.062023 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:21:34.062023 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:21:34.062023 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:21:34.062023 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:21:34.062023 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:21:34.062023 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:34.069937 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 391/790] 10.222.0.16 () {56 vars in 1096 bytes} [Thu May 26 12:21:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:34.071151 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db38e3-ea10-4ac6-9290-2ddc4aa0eece None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:34.074809 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 400/791] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:21:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:21:34.076624 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf3f129-acaa-4972-89d8-ade56b1fa122 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:34.185821 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db38e3-ea10-4ac6-9290-2ddc4aa0eece None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:34.206629 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf3f129-acaa-4972-89d8-ade56b1fa122 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:34.226027 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529c4d1a-b1f9-4d8e-aecc-0eee95170f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:34.227529 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c4d1a-b1f9-4d8e-aecc-0eee95170f55 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:34.228019 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c4d1a-b1f9-4d8e-aecc-0eee95170f55 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:34.228490 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c4d1a-b1f9-4d8e-aecc-0eee95170f55 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:34.233873 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:34.246551 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529c4d1a-b1f9-4d8e-aecc-0eee95170f55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:21:34.247498 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65ead12-36b7-46e7-9174-57c2f45bf299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:34.248170 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ead12-36b7-46e7-9174-57c2f45bf299 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:34.248459 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ead12-36b7-46e7-9174-57c2f45bf299 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:34.248737 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ead12-36b7-46e7-9174-57c2f45bf299 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:34.249536 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65ead12-36b7-46e7-9174-57c2f45bf299 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:34.249845 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65ead12-36b7-46e7-9174-57c2f45bf299 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:34.251789 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65ead12-36b7-46e7-9174-57c2f45bf299 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:34.258412 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-529c4d1a-b1f9-4d8e-aecc-0eee95170f55 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:21:34.258412 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:34.258412 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:34.258412 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:34.258412 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:34.258412 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:34.258412 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:34.258412 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:34.258412 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:34.258412 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:34.258412 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:34.258412 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:34.258412 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:21:34.258412 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:21:34.258412 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:21:34.258412 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:21:34.259446 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:21:34.259446 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:21:34.259446 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:21:34.259446 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:21:34.259446 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:34.259446 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:34.259446 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:34.259446 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:34.259446 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:34.259446 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:34.259446 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:34.259446 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:34.259446 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:34.259446 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:34.259446 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:34.259446 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:34.260289 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:34.260289 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:34.260289 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:34.260289 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:34.260289 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:21:34.260289 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:21:34.260289 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:21:34.260289 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:21:34.260289 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:21:34.260289 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:21:34.260289 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:21:34.260289 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:34.267695 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 392/792] 10.222.0.16 () {56 vars in 1102 bytes} [Thu May 26 12:21:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:34.267695 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529c4d1a-b1f9-4d8e-aecc-0eee95170f55 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:34.270354 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 401/793] 10.222.0.16 () {56 vars in 1099 bytes} [Thu May 26 12:21:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:34.271332 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65ead12-36b7-46e7-9174-57c2f45bf299 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:34.351443 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:34.391310 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65ead12-36b7-46e7-9174-57c2f45bf299 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:34.408471 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529c4d1a-b1f9-4d8e-aecc-0eee95170f55 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:34.433499 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2109e25d-ef66-434e-80c7-a7afc922df64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:34.434512 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109e25d-ef66-434e-80c7-a7afc922df64 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:34.435077 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109e25d-ef66-434e-80c7-a7afc922df64 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:34.436112 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109e25d-ef66-434e-80c7-a7afc922df64 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:34.437383 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2109e25d-ef66-434e-80c7-a7afc922df64 None admin] RBAC: Adding query filter params (name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:34.437892 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2109e25d-ef66-434e-80c7-a7afc922df64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:34.440394 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2109e25d-ef66-434e-80c7-a7afc922df64 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:34.450543 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95951d44-759b-4df7-a79b-edfe27d97f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:34.451386 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95951d44-759b-4df7-a79b-edfe27d97f33 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:34.451673 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95951d44-759b-4df7-a79b-edfe27d97f33 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:34.451948 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95951d44-759b-4df7-a79b-edfe27d97f33 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:34.457499 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 402/794] 10.222.0.16 () {56 vars in 1103 bytes} [Thu May 26 12:21:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:34.457858 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2109e25d-ef66-434e-80c7-a7afc922df64 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:34.464484 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95951d44-759b-4df7-a79b-edfe27d97f33 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:34.465995 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95951d44-759b-4df7-a79b-edfe27d97f33 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:34.482067 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-95951d44-759b-4df7-a79b-edfe27d97f33 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 12:21:34.482067 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:34.482067 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:34.482067 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:34.482067 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:34.482067 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:34.482067 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:34.482067 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:34.482067 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:34.482067 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:34.482067 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:34.482067 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:34.482067 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:21:34.482067 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:21:34.482067 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:21:34.482067 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:21:34.483048 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:34.483048 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:34.483048 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:21:34.483048 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:21:34.483048 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:21:34.483048 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:21:34.483048 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:34.483048 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:34.483048 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:34.483048 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:34.483048 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:34.483048 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:34.483048 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:34.483048 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:34.483048 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:34.483048 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:34.483048 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:34.483048 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:34.483997 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:34.483997 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:34.483997 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:21:34.483997 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:21:34.483997 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:21:34.483997 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:21:34.483997 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:21:34.483997 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:21:34.483997 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 12:21:34.483997 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:34.483997 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 393/795] 10.222.0.16 () {56 vars in 1096 bytes} [Thu May 26 12:21:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:34.486156 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6b983-2b61-410c-ba23-c88d3530c1c9 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:34.486156 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6b983-2b61-410c-ba23-c88d3530c1c9 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:34.486156 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6b983-2b61-410c-ba23-c88d3530c1c9 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:34.487142 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 394/796] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:21:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:21:34.489858 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6b983-2b61-410c-ba23-c88d3530c1c9 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:34.517247 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:34.573193 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2109e25d-ef66-434e-80c7-a7afc922df64 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:34.604156 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6b983-2b61-410c-ba23-c88d3530c1c9 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:34.608677 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca9f51a-4737-4053-90d5-b66741dd14be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:34.609507 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9f51a-4737-4053-90d5-b66741dd14be None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:34.609794 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9f51a-4737-4053-90d5-b66741dd14be None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:34.610069 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9f51a-4737-4053-90d5-b66741dd14be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:34.622724 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:34.622873 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca9f51a-4737-4053-90d5-b66741dd14be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:34.624232 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca9f51a-4737-4053-90d5-b66741dd14be None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:34.640683 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f41ca5-fe93-4a99-b8ac-b7f1148e5c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:34.641549 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f41ca5-fe93-4a99-b8ac-b7f1148e5c32 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:34.641829 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f41ca5-fe93-4a99-b8ac-b7f1148e5c32 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:34.642097 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f41ca5-fe93-4a99-b8ac-b7f1148e5c32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:34.643011 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-dca9f51a-4737-4053-90d5-b66741dd14be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:34.643011 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:34.643011 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:34.643011 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:34.643011 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:34.643011 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:34.643011 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:34.643011 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:34.643011 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:34.643011 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:34.643011 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:34.643011 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:34.643011 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:21:34.643011 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:21:34.643011 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:21:34.643877 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:21:34.643877 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:34.643877 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:34.643877 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:34.643877 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:34.643877 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:34.643877 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:34.643877 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:34.643877 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:34.643877 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:34.643877 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:34.643877 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:34.643877 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:34.643877 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:34.643877 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:34.643877 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:34.643877 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:34.644778 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:21:34.644778 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:21:34.644778 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:34.644778 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:34.644778 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 403/797] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:21:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:34.645137 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca9f51a-4737-4053-90d5-b66741dd14be None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:34.658653 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f41ca5-fe93-4a99-b8ac-b7f1148e5c32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:34.660107 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f41ca5-fe93-4a99-b8ac-b7f1148e5c32 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:34.678195 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-16f41ca5-fe93-4a99-b8ac-b7f1148e5c32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:34.678195 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:34.678195 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:34.678195 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:34.678195 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:34.678195 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:34.678195 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:34.678195 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:34.678195 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:34.678195 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:34.678195 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:34.678195 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:34.678195 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:21:34.678195 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:21:34.678195 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:21:34.679107 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:21:34.679107 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:34.679107 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:34.679107 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:34.679107 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:34.679107 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:34.679107 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:34.679107 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:34.679107 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:34.679107 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:34.679107 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:34.679107 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:34.679107 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:34.679107 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:34.679107 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:34.679107 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:34.679107 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:34.680051 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:21:34.680051 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:21:34.680051 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:34.680051 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:34.684047 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 395/798] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:21:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:34.685325 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92c75e-6875-4f50-93cd-8feec0e0bfca None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:34.685606 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92c75e-6875-4f50-93cd-8feec0e0bfca None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:34.685876 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92c75e-6875-4f50-93cd-8feec0e0bfca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:34.703707 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-7b92c75e-6875-4f50-93cd-8feec0e0bfca None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:21:34.705411 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7b92c75e-6875-4f50-93cd-8feec0e0bfca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:21:34.758329 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:34.761685 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca9f51a-4737-4053-90d5-b66741dd14be None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:34.785747 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 396/799] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:21:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:21:34.787322 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b92c75e-6875-4f50-93cd-8feec0e0bfca None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:34.802461 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ea839-ff6a-4875-8dd5-be6b4eec41a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:34.803238 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ea839-ff6a-4875-8dd5-be6b4eec41a7 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:34.803966 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ea839-ff6a-4875-8dd5-be6b4eec41a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:34.804252 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ea839-ff6a-4875-8dd5-be6b4eec41a7 None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:34.805137 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5ea839-ff6a-4875-8dd5-be6b4eec41a7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:34.805445 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5ea839-ff6a-4875-8dd5-be6b4eec41a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:34.806863 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5ea839-ff6a-4875-8dd5-be6b4eec41a7 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:34.832801 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 404/800] 10.222.0.16 () {56 vars in 1135 bytes} [Thu May 26 12:21:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:34.832801 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ea839-ff6a-4875-8dd5-be6b4eec41a7 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:34.903711 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:34.908530 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b92c75e-6875-4f50-93cd-8feec0e0bfca None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:34.935074 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ea839-ff6a-4875-8dd5-be6b4eec41a7 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:34.945473 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb943def-0bdb-4d93-bd5c-b1a4e748fbcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:34.946134 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb943def-0bdb-4d93-bd5c-b1a4e748fbcc None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:34.946425 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb943def-0bdb-4d93-bd5c-b1a4e748fbcc None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:34.946724 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb943def-0bdb-4d93-bd5c-b1a4e748fbcc None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:34.947424 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb943def-0bdb-4d93-bd5c-b1a4e748fbcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:34.947795 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb943def-0bdb-4d93-bd5c-b1a4e748fbcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:34.949232 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb943def-0bdb-4d93-bd5c-b1a4e748fbcc None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:34.962101 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 397/801] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:21:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:34.962850 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb943def-0bdb-4d93-bd5c-b1a4e748fbcc None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:34.971662 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa1b1c-5b5d-429c-b924-e7f3ef16efe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:34.972314 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa1b1c-5b5d-429c-b924-e7f3ef16efe4 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:34.972593 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa1b1c-5b5d-429c-b924-e7f3ef16efe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:34.972883 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa1b1c-5b5d-429c-b924-e7f3ef16efe4 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:34.973595 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aa1b1c-5b5d-429c-b924-e7f3ef16efe4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:34.973896 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aa1b1c-5b5d-429c-b924-e7f3ef16efe4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:34.975238 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aa1b1c-5b5d-429c-b924-e7f3ef16efe4 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:34.986289 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 405/802] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:21:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:34.987121 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa1b1c-5b5d-429c-b924-e7f3ef16efe4 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:35.006318 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:35.061273 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb943def-0bdb-4d93-bd5c-b1a4e748fbcc None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:35.087020 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa1b1c-5b5d-429c-b924-e7f3ef16efe4 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:35.095247 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336fea3d-c1db-4a67-a767-3fd771b6c2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:35.096052 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336fea3d-c1db-4a67-a767-3fd771b6c2ce None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:35.096438 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336fea3d-c1db-4a67-a767-3fd771b6c2ce None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:35.096717 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336fea3d-c1db-4a67-a767-3fd771b6c2ce None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:35.097403 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336fea3d-c1db-4a67-a767-3fd771b6c2ce None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:35.098776 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336fea3d-c1db-4a67-a767-3fd771b6c2ce None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:35.110698 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-336fea3d-c1db-4a67-a767-3fd771b6c2ce None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 12:21:35.110698 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:35.110698 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:21:35.110698 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:21:35.110698 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:21:35.110698 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:21:35.110698 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:21:35.110698 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:21:35.110698 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 12:21:35.110698 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:35.110698 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:21:35.110698 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:35.110698 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:35.110698 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:35.110698 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:35.110698 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:35.111684 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:35.111684 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:35.111684 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:35.111684 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:35.111684 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:35.111684 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:35.111684 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:35.111684 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:21:35.111684 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:21:35.111684 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:21:35.111684 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:21:35.111684 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:35.111684 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:35.111684 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:35.111684 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:35.111684 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:35.117887 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:35.117887 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:35.117887 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:35.117887 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:35.117887 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:35.117887 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:35.117887 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:35.117887 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:35.117887 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:35.117887 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:35.117887 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:35.117887 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:21:35.117887 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:21:35.117887 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 12:21:35.117887 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:35.117887 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 398/803] 10.222.0.16 () {56 vars in 1129 bytes} [Thu May 26 12:21:34 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:35.118751 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec1786-68fc-4a2a-875f-fd69ea976155 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:35.118751 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec1786-68fc-4a2a-875f-fd69ea976155 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:35.118751 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec1786-68fc-4a2a-875f-fd69ea976155 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:35.118751 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 399/804] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:21:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:21:35.118751 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec1786-68fc-4a2a-875f-fd69ea976155 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:35.122628 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9febc93c-03cd-4c94-b1ee-9552025972ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:35.123420 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febc93c-03cd-4c94-b1ee-9552025972ad None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:35.123703 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febc93c-03cd-4c94-b1ee-9552025972ad None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:35.123979 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febc93c-03cd-4c94-b1ee-9552025972ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:35.135218 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9febc93c-03cd-4c94-b1ee-9552025972ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:35.136665 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9febc93c-03cd-4c94-b1ee-9552025972ad None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:35.142074 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:35.154818 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-9febc93c-03cd-4c94-b1ee-9552025972ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:35.154818 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:35.154818 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:35.154818 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:35.154818 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:35.154818 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:35.154818 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:35.154818 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:35.154818 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:35.154818 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:35.154818 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:35.154818 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:35.154818 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:21:35.154818 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:21:35.154818 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:21:35.155743 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:21:35.155743 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:35.155743 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:35.155743 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:35.155743 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:35.155743 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:35.155743 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:35.155743 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:35.155743 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:35.155743 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:35.155743 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:35.155743 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:35.155743 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:35.155743 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:35.155743 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:35.155743 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:35.155743 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:35.156624 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:21:35.156624 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:21:35.156624 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:35.156624 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:35.156624 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 406/805] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:21:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:35.157242 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9febc93c-03cd-4c94-b1ee-9552025972ad None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:35.221076 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec1786-68fc-4a2a-875f-fd69ea976155 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:35.227991 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:35.254176 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff407d-697f-4acd-afee-1118cbb17ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:35.254960 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff407d-697f-4acd-afee-1118cbb17ae6 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:35.255246 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff407d-697f-4acd-afee-1118cbb17ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:35.255522 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff407d-697f-4acd-afee-1118cbb17ae6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:35.258881 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9febc93c-03cd-4c94-b1ee-9552025972ad None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:35.262821 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caff407d-697f-4acd-afee-1118cbb17ae6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:35.264285 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caff407d-697f-4acd-afee-1118cbb17ae6 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:35.278458 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-caff407d-697f-4acd-afee-1118cbb17ae6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 12:21:35.278458 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:35.278458 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:35.278458 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:35.278458 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:35.278458 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:35.278458 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:35.278458 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:35.278458 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:35.278458 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:35.278458 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:35.278458 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:35.278458 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:21:35.278458 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:21:35.278458 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:21:35.278458 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:21:35.279400 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:35.279400 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:35.279400 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:21:35.279400 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:21:35.279400 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:21:35.279400 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:21:35.279400 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:35.279400 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:35.279400 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:35.279400 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:35.279400 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:35.279400 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:35.279400 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:35.279400 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:35.279400 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:35.279400 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:35.279400 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:35.279400 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:35.280369 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:35.280369 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:35.280369 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:21:35.280369 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:21:35.280369 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:21:35.280369 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:21:35.280369 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:21:35.280369 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:21:35.280369 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 12:21:35.280369 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:35.280369 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 400/806] 10.222.0.16 () {56 vars in 1093 bytes} [Thu May 26 12:21:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:35.280369 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff407d-697f-4acd-afee-1118cbb17ae6 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:35.296688 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6cdbef-16a1-4565-8d75-f59611fac5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:35.297514 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6cdbef-16a1-4565-8d75-f59611fac5a5 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:35.297843 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6cdbef-16a1-4565-8d75-f59611fac5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:35.298118 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6cdbef-16a1-4565-8d75-f59611fac5a5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:35.305485 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6cdbef-16a1-4565-8d75-f59611fac5a5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:35.306972 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6cdbef-16a1-4565-8d75-f59611fac5a5 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:35.321672 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-dc6cdbef-16a1-4565-8d75-f59611fac5a5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 12:21:35.321672 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:35.321672 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:35.321672 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:35.321672 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:35.321672 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:35.321672 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:35.321672 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:35.321672 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:35.321672 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:35.321672 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:35.321672 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:35.321672 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:21:35.321672 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:21:35.321672 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:21:35.321672 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:21:35.322773 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:35.322773 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:35.322773 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:21:35.322773 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:21:35.322773 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:21:35.322773 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:21:35.322773 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:35.322773 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:35.322773 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:35.322773 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:35.322773 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:35.322773 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:35.322773 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:35.322773 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:35.322773 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:35.322773 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:35.322773 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:35.322773 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:35.328421 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:35.328421 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:35.328421 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:21:35.328421 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:21:35.328421 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:21:35.328421 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:21:35.328421 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:21:35.328421 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:21:35.328421 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 12:21:35.328421 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:35.328421 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 407/807] 10.222.0.16 () {56 vars in 1117 bytes} [Thu May 26 12:21:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:35.328421 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42a117-838e-470d-80f1-e3ced4520f61 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:35.328421 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42a117-838e-470d-80f1-e3ced4520f61 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:35.330047 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42a117-838e-470d-80f1-e3ced4520f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:35.342212 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-3e42a117-838e-470d-80f1-e3ced4520f61 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:21:35.343636 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-3e42a117-838e-470d-80f1-e3ced4520f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:21:35.365931 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:35.381671 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff407d-697f-4acd-afee-1118cbb17ae6 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:35.408278 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 408/808] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:21:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:21:35.409122 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e42a117-838e-470d-80f1-e3ced4520f61 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:35.417241 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd7cff-b506-4090-9bc4-8b8dac47f8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:35.417908 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd7cff-b506-4090-9bc4-8b8dac47f8c0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:35.418224 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd7cff-b506-4090-9bc4-8b8dac47f8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:35.418938 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd7cff-b506-4090-9bc4-8b8dac47f8c0 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:35.419657 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafd7cff-b506-4090-9bc4-8b8dac47f8c0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:35.420367 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafd7cff-b506-4090-9bc4-8b8dac47f8c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:35.422040 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafd7cff-b506-4090-9bc4-8b8dac47f8c0 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:35.433026 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 401/809] 10.222.0.16 () {56 vars in 1124 bytes} [Thu May 26 12:21:35 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:35.433026 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd7cff-b506-4090-9bc4-8b8dac47f8c0 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:35.466640 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:35.508174 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e42a117-838e-470d-80f1-e3ced4520f61 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:35.528607 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd7cff-b506-4090-9bc4-8b8dac47f8c0 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:35.541016 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e490f2-974d-456a-9c80-9cb1bed7c4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:35.541675 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e490f2-974d-456a-9c80-9cb1bed7c4d2 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:35.541959 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e490f2-974d-456a-9c80-9cb1bed7c4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:35.542234 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e490f2-974d-456a-9c80-9cb1bed7c4d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:35.542960 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e490f2-974d-456a-9c80-9cb1bed7c4d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:35.543269 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e490f2-974d-456a-9c80-9cb1bed7c4d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:35.544620 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e490f2-974d-456a-9c80-9cb1bed7c4d2 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:35.556220 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 409/810] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:21:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:35.557255 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e490f2-974d-456a-9c80-9cb1bed7c4d2 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:35.564317 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f365d-e457-4cce-885a-a1e3b9f81e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:35.565010 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f365d-e457-4cce-885a-a1e3b9f81e26 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:35.565294 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f365d-e457-4cce-885a-a1e3b9f81e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:35.565565 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f365d-e457-4cce-885a-a1e3b9f81e26 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:35.566403 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946f365d-e457-4cce-885a-a1e3b9f81e26 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:35.566713 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946f365d-e457-4cce-885a-a1e3b9f81e26 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:35.568145 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946f365d-e457-4cce-885a-a1e3b9f81e26 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:35.585132 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 402/811] 10.222.0.16 () {56 vars in 1133 bytes} [Thu May 26 12:21:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:35.585919 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f365d-e457-4cce-885a-a1e3b9f81e26 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:35.594097 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:35.666911 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e490f2-974d-456a-9c80-9cb1bed7c4d2 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:35.682556 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f365d-e457-4cce-885a-a1e3b9f81e26 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:35.686133 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:35.700949 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a77141-1cac-4033-8aea-cc7a10dbc241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:35.701605 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a77141-1cac-4033-8aea-cc7a10dbc241 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:35.701882 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a77141-1cac-4033-8aea-cc7a10dbc241 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:35.702151 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a77141-1cac-4033-8aea-cc7a10dbc241 None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:35.702976 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a77141-1cac-4033-8aea-cc7a10dbc241 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:35.703280 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a77141-1cac-4033-8aea-cc7a10dbc241 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:35.704688 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a77141-1cac-4033-8aea-cc7a10dbc241 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:35.715846 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c54bf2-9717-4bf8-86bf-9b2d623834a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:35.716647 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c54bf2-9717-4bf8-86bf-9b2d623834a5 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:35.716970 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c54bf2-9717-4bf8-86bf-9b2d623834a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:35.717240 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c54bf2-9717-4bf8-86bf-9b2d623834a5 None admin] PATH_INFO: `/v3/services/network` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:35.717879 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c54bf2-9717-4bf8-86bf-9b2d623834a5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:35.719482 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c54bf2-9717-4bf8-86bf-9b2d623834a5 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:35.721587 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 410/812] 10.222.0.16 () {56 vars in 1149 bytes} [Thu May 26 12:21:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:35.722426 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a77141-1cac-4033-8aea-cc7a10dbc241 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:35.735910 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-b2c54bf2-9717-4bf8-86bf-9b2d623834a5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 26 12:21:35.735910 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:35.735910 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:21:35.735910 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:21:35.735910 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:21:35.735910 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:21:35.735910 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:21:35.735910 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:21:35.735910 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 12:21:35.735910 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:35.735910 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:21:35.735910 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:35.735910 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:35.735910 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:35.735910 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:35.735910 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:35.735910 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:35.737151 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:35.737151 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:35.737151 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:35.737151 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:35.737151 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:35.737151 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:35.737151 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:21:35.737151 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:21:35.737151 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:21:35.737151 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:21:35.737151 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:35.737151 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:35.737151 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:35.737151 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:35.737151 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:35.737151 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:35.737987 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:35.737987 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:35.737987 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:35.737987 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:35.737987 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:35.737987 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:35.737987 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:35.737987 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:35.737987 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:35.737987 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:35.737987 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:21:35.737987 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:21:35.737987 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 12:21:35.737987 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:35.737987 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 403/813] 10.222.0.16 () {56 vars in 1111 bytes} [Thu May 26 12:21:35 2022] GET /identity/v3/services/network => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:35.738783 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c54bf2-9717-4bf8-86bf-9b2d623834a5 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:35.807454 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:35.824823 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a77141-1cac-4033-8aea-cc7a10dbc241 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:35.838270 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c54bf2-9717-4bf8-86bf-9b2d623834a5 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:35.859141 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56408525-eaac-49ba-8a4a-3ab258e4e3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:35.859866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56408525-eaac-49ba-8a4a-3ab258e4e3bc None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:35.860166 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56408525-eaac-49ba-8a4a-3ab258e4e3bc None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:35.861012 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56408525-eaac-49ba-8a4a-3ab258e4e3bc None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:35.861711 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56408525-eaac-49ba-8a4a-3ab258e4e3bc None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:35.862022 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56408525-eaac-49ba-8a4a-3ab258e4e3bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:35.863366 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56408525-eaac-49ba-8a4a-3ab258e4e3bc None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:35.867990 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 411/814] 10.222.0.16 () {56 vars in 1124 bytes} [Thu May 26 12:21:35 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:35.868746 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56408525-eaac-49ba-8a4a-3ab258e4e3bc None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:35.872597 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1274f924-608a-4965-8623-492157999619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:35.873560 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274f924-608a-4965-8623-492157999619 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:35.873844 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274f924-608a-4965-8623-492157999619 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:35.874118 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274f924-608a-4965-8623-492157999619 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:35.881085 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1274f924-608a-4965-8623-492157999619 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:35.882648 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1274f924-608a-4965-8623-492157999619 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:35.896614 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-1274f924-608a-4965-8623-492157999619 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:21:35.896614 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:35.896614 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:35.896614 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:35.896614 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:35.896614 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:35.896614 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:35.896614 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:35.896614 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:35.896614 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:35.896614 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:35.896614 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:35.896614 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:21:35.896614 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:21:35.896614 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:21:35.897558 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:21:35.897558 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:35.897558 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:35.897558 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:35.897558 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:35.897558 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:35.897558 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:35.897558 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:35.897558 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:35.897558 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:35.897558 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:35.897558 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:35.897558 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:35.897558 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:35.897558 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:35.897558 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:35.897558 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:35.898469 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:21:35.898469 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:21:35.898469 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:21:35.898469 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:21:35.898469 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:21:35.898469 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:21:35.898469 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:21:35.898469 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:35.898469 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 404/815] 10.222.0.16 () {56 vars in 1111 bytes} [Thu May 26 12:21:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:35.898972 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1274f924-608a-4965-8623-492157999619 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:35.914139 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:35.968992 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56408525-eaac-49ba-8a4a-3ab258e4e3bc None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:35.998180 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1274f924-608a-4965-8623-492157999619 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:36.002612 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddac346-6a4c-43ca-a4c6-980a384c41bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:36.003246 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddac346-6a4c-43ca-a4c6-980a384c41bd None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:36.003524 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddac346-6a4c-43ca-a4c6-980a384c41bd None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:36.003796 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddac346-6a4c-43ca-a4c6-980a384c41bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:36.026092 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:36.032708 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d12e82-3b8d-4bf6-a0db-f64ded7c47c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:36.033521 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d12e82-3b8d-4bf6-a0db-f64ded7c47c1 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:36.033806 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d12e82-3b8d-4bf6-a0db-f64ded7c47c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:36.034091 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d12e82-3b8d-4bf6-a0db-f64ded7c47c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:36.043879 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d12e82-3b8d-4bf6-a0db-f64ded7c47c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:36.045381 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d12e82-3b8d-4bf6-a0db-f64ded7c47c1 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:36.063331 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-07d12e82-3b8d-4bf6-a0db-f64ded7c47c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:36.063331 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:36.063331 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:36.063331 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:36.063331 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:36.063331 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:36.063331 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:36.063331 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:36.063331 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:36.063331 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:36.063331 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:36.063331 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:36.063331 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:21:36.063331 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:21:36.063331 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:21:36.064793 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:21:36.064793 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:36.064793 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:36.064793 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:36.064793 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:36.064793 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:36.064793 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:36.064793 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:36.064793 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:36.064793 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:36.064793 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:36.064793 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:36.064793 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:36.064793 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:36.064793 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:36.064793 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:36.064793 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:36.066272 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:21:36.066272 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:21:36.066272 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:36.066272 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:36.066272 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 405/816] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:21:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:36.066272 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d12e82-3b8d-4bf6-a0db-f64ded7c47c1 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:36.073843 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddac346-6a4c-43ca-a4c6-980a384c41bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:36.075287 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddac346-6a4c-43ca-a4c6-980a384c41bd None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:36.117431 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:36.161946 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d12e82-3b8d-4bf6-a0db-f64ded7c47c1 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:36.174265 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 412/817] 10.222.0.16 () {58 vars in 1282 bytes} [Thu May 26 12:21:35 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:21:36.175063 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddac346-6a4c-43ca-a4c6-980a384c41bd None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:36.199030 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a783bc7e-9978-4617-ba74-1429962c0cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:36.199679 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783bc7e-9978-4617-ba74-1429962c0cb3 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:36.199956 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783bc7e-9978-4617-ba74-1429962c0cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:36.200224 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783bc7e-9978-4617-ba74-1429962c0cb3 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:36.200949 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a783bc7e-9978-4617-ba74-1429962c0cb3 None admin] RBAC: Adding query filter params (name=network) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:36.201252 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a783bc7e-9978-4617-ba74-1429962c0cb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:36.202605 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a783bc7e-9978-4617-ba74-1429962c0cb3 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:36.207448 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 406/818] 10.222.0.16 () {56 vars in 1112 bytes} [Thu May 26 12:21:36 2022] GET /identity/v3/services?name=network => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:36.208194 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a783bc7e-9978-4617-ba74-1429962c0cb3 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:36.252503 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:36.276283 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddac346-6a4c-43ca-a4c6-980a384c41bd None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:36.304698 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a783bc7e-9978-4617-ba74-1429962c0cb3 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:36.309510 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c8e3e-6463-4681-82f9-6e462b3a4c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:36.310155 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c8e3e-6463-4681-82f9-6e462b3a4c5c None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:36.310438 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c8e3e-6463-4681-82f9-6e462b3a4c5c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:36.310708 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c8e3e-6463-4681-82f9-6e462b3a4c5c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:36.311437 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797c8e3e-6463-4681-82f9-6e462b3a4c5c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:36.312787 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797c8e3e-6463-4681-82f9-6e462b3a4c5c None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:36.326967 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:36.334438 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 413/819] 10.222.0.16 () {60 vars in 1144 bytes} [Thu May 26 12:21:36 2022] POST /identity/v3/endpoints => generated 346 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:21:36.335261 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c8e3e-6463-4681-82f9-6e462b3a4c5c None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:36.351423 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e1cb6f-7c06-4a5e-9d6e-f00584e833fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:36.352342 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1cb6f-7c06-4a5e-9d6e-f00584e833fd None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:36.352342 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1cb6f-7c06-4a5e-9d6e-f00584e833fd None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:36.352649 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1cb6f-7c06-4a5e-9d6e-f00584e833fd None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:36.353468 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e1cb6f-7c06-4a5e-9d6e-f00584e833fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:36.353777 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e1cb6f-7c06-4a5e-9d6e-f00584e833fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:36.355267 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e1cb6f-7c06-4a5e-9d6e-f00584e833fd None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:36.374462 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 407/820] 10.222.0.16 () {56 vars in 1148 bytes} [Thu May 26 12:21:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:36.375490 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e1cb6f-7c06-4a5e-9d6e-f00584e833fd None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:36.453069 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c8e3e-6463-4681-82f9-6e462b3a4c5c None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:36.484961 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e1cb6f-7c06-4a5e-9d6e-f00584e833fd None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:36.486816 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:36.499241 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af96a9-2241-46df-9801-0eea28897693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:36.500013 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af96a9-2241-46df-9801-0eea28897693 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:36.500302 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af96a9-2241-46df-9801-0eea28897693 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:36.500577 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af96a9-2241-46df-9801-0eea28897693 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:36.501394 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af96a9-2241-46df-9801-0eea28897693 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:36.501696 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af96a9-2241-46df-9801-0eea28897693 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:36.503087 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af96a9-2241-46df-9801-0eea28897693 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:36.515525 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 414/821] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:21:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:36.516290 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af96a9-2241-46df-9801-0eea28897693 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:36.526569 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d086c-a474-491f-bae0-483b740ed202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:36.527368 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d086c-a474-491f-bae0-483b740ed202 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:36.527655 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d086c-a474-491f-bae0-483b740ed202 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:36.527929 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d086c-a474-491f-bae0-483b740ed202 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:36.540157 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095d086c-a474-491f-bae0-483b740ed202 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:36.542089 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095d086c-a474-491f-bae0-483b740ed202 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:36.561833 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-095d086c-a474-491f-bae0-483b740ed202 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:36.561833 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:36.561833 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:36.561833 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:36.561833 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:36.561833 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:36.561833 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:36.561833 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:36.561833 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:36.561833 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:36.561833 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:36.561833 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:36.561833 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:21:36.561833 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:21:36.561833 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:21:36.562768 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:21:36.562768 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:36.562768 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:36.562768 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:36.562768 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:36.562768 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:36.562768 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:36.562768 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:36.562768 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:36.562768 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:36.562768 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:36.562768 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:36.562768 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:36.562768 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:36.562768 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:36.562768 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:36.562768 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:36.564465 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:21:36.564465 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:21:36.564465 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:36.564465 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:36.564465 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 408/822] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:21:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:36.564465 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d086c-a474-491f-bae0-483b740ed202 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:36.585844 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:36.635645 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af96a9-2241-46df-9801-0eea28897693 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:36.671433 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d086c-a474-491f-bae0-483b740ed202 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:36.674255 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f27d48-9344-4c86-8a46-bb3f39351184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:36.675000 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f27d48-9344-4c86-8a46-bb3f39351184 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:36.675289 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f27d48-9344-4c86-8a46-bb3f39351184 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:36.675564 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f27d48-9344-4c86-8a46-bb3f39351184 None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:36.676267 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f27d48-9344-4c86-8a46-bb3f39351184 None admin] RBAC: Adding query filter params (type=network) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:36.676573 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f27d48-9344-4c86-8a46-bb3f39351184 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:36.677964 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f27d48-9344-4c86-8a46-bb3f39351184 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:36.682984 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 415/823] 10.222.0.16 () {56 vars in 1112 bytes} [Thu May 26 12:21:36 2022] GET /identity/v3/services?type=network => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:36.683801 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f27d48-9344-4c86-8a46-bb3f39351184 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:36.712704 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac6f3c-ec7f-48d5-886d-3690ed777894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:36.713559 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac6f3c-ec7f-48d5-886d-3690ed777894 None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:36.713844 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac6f3c-ec7f-48d5-886d-3690ed777894 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:36.714116 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac6f3c-ec7f-48d5-886d-3690ed777894 None admin] PATH_INFO: `/v3/projects/42e6c693bd224d92b8a0fe4ad0cc586d/users/02767dcbd1574e08a9e82a775ac2b289/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:36.716091 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcac6f3c-ec7f-48d5-886d-3690ed777894 None admin] RBAC: Authorizing `identity:create_grant(project_id=42e6c693bd224d92b8a0fe4ad0cc586d, user_id=02767dcbd1574e08a9e82a775ac2b289, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:36.717564 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcac6f3c-ec7f-48d5-886d-3690ed777894 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:36.732932 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 409/824] 10.222.0.16 () {58 vars in 1439 bytes} [Thu May 26 12:21:36 2022] PUT /identity/v3/projects/42e6c693bd224d92b8a0fe4ad0cc586d/users/02767dcbd1574e08a9e82a775ac2b289/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:21:36.733785 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac6f3c-ec7f-48d5-886d-3690ed777894 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:36.764767 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:36.833087 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f27d48-9344-4c86-8a46-bb3f39351184 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:36.867994 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:36.871859 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac6f3c-ec7f-48d5-886d-3690ed777894 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:36.883089 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5597ab0a-fadc-4f7f-a788-d94a4fafdb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:36.883902 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597ab0a-fadc-4f7f-a788-d94a4fafdb07 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:36.884190 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597ab0a-fadc-4f7f-a788-d94a4fafdb07 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:36.884470 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597ab0a-fadc-4f7f-a788-d94a4fafdb07 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:36.893393 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5597ab0a-fadc-4f7f-a788-d94a4fafdb07 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:36.894870 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5597ab0a-fadc-4f7f-a788-d94a4fafdb07 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:36.911502 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-5597ab0a-fadc-4f7f-a788-d94a4fafdb07 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:21:36.911502 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:36.911502 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:36.911502 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:36.911502 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:36.911502 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:36.911502 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:36.911502 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:36.911502 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:36.911502 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:36.911502 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:36.911502 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:36.911502 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:21:36.911502 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:21:36.911502 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:21:36.912512 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:21:36.912512 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:36.912512 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:36.912512 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:36.912512 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:36.912512 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:36.912512 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:36.912512 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:36.912512 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:36.912512 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:36.912512 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:36.912512 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:36.912512 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:36.912512 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:36.912512 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:36.912512 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:36.912512 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:36.913465 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:21:36.913465 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:21:36.913465 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:21:36.913465 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:21:36.913465 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:21:36.913465 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:21:36.913465 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:21:36.913465 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:36.917640 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 416/825] 10.222.0.16 () {56 vars in 1111 bytes} [Thu May 26 12:21:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:36.918452 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ba7b6-6159-40d0-9569-a8e11f7d37ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:36.918605 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5597ab0a-fadc-4f7f-a788-d94a4fafdb07 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:36.919607 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ba7b6-6159-40d0-9569-a8e11f7d37ac None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:36.920121 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ba7b6-6159-40d0-9569-a8e11f7d37ac None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:36.920626 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ba7b6-6159-40d0-9569-a8e11f7d37ac None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:36.921720 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38ba7b6-6159-40d0-9569-a8e11f7d37ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:36.922414 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38ba7b6-6159-40d0-9569-a8e11f7d37ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:36.924626 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38ba7b6-6159-40d0-9569-a8e11f7d37ac None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:36.938351 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 410/826] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:21:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:36.940033 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ba7b6-6159-40d0-9569-a8e11f7d37ac None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:37.033713 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:37.057488 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5597ab0a-fadc-4f7f-a788-d94a4fafdb07 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:37.062081 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ba7b6-6159-40d0-9569-a8e11f7d37ac None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:37.099248 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eefabc-e68d-4e7b-a4d9-0654a9021f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:37.100762 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eefabc-e68d-4e7b-a4d9-0654a9021f18 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:37.101321 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eefabc-e68d-4e7b-a4d9-0654a9021f18 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:37.101867 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eefabc-e68d-4e7b-a4d9-0654a9021f18 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:37.103022 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eefabc-e68d-4e7b-a4d9-0654a9021f18 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:37.103441 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a856b-f4c7-4eba-9a7e-271543c825ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:37.103657 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eefabc-e68d-4e7b-a4d9-0654a9021f18 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:37.104287 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a856b-f4c7-4eba-9a7e-271543c825ab None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:37.104672 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a856b-f4c7-4eba-9a7e-271543c825ab None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:37.105074 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a856b-f4c7-4eba-9a7e-271543c825ab None admin] PATH_INFO: `/v3/endpoints` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:37.105752 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eefabc-e68d-4e7b-a4d9-0654a9021f18 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:37.106026 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a856b-f4c7-4eba-9a7e-271543c825ab None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:37.107481 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a856b-f4c7-4eba-9a7e-271543c825ab None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:37.120136 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 411/827] 10.222.0.16 () {56 vars in 1148 bytes} [Thu May 26 12:21:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:37.121462 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eefabc-e68d-4e7b-a4d9-0654a9021f18 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:37.136928 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 417/828] 10.222.0.16 () {60 vars in 1144 bytes} [Thu May 26 12:21:36 2022] POST /identity/v3/endpoints => generated 327 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:21:37.138508 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a856b-f4c7-4eba-9a7e-271543c825ab None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:37.216391 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:37.298267 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eefabc-e68d-4e7b-a4d9-0654a9021f18 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:37.336709 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:37.343931 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af2abd5-ef70-4488-b1de-362f22c183c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:37.345829 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2abd5-ef70-4488-b1de-362f22c183c2 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:37.346350 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2abd5-ef70-4488-b1de-362f22c183c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:37.346835 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2abd5-ef70-4488-b1de-362f22c183c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:37.350060 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a856b-f4c7-4eba-9a7e-271543c825ab None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:37.355790 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af2abd5-ef70-4488-b1de-362f22c183c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:37.357604 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af2abd5-ef70-4488-b1de-362f22c183c2 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:37.374085 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-8af2abd5-ef70-4488-b1de-362f22c183c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:21:37.374085 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:37.374085 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:37.374085 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:37.374085 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:37.374085 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:37.374085 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:37.374085 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:37.374085 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:37.374085 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:37.374085 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:37.374085 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:37.374085 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:21:37.374085 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:21:37.374085 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:21:37.375078 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:21:37.375078 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:37.375078 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:37.375078 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:37.375078 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:37.375078 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:37.375078 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:37.375078 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:37.375078 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:37.375078 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:37.375078 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:37.375078 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:37.375078 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:37.375078 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:37.375078 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:37.375078 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:37.375078 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:37.376006 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:21:37.376006 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:21:37.376006 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:21:37.376006 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:21:37.376006 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:21:37.376006 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:21:37.376006 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:21:37.376006 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:37.378523 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 412/829] 10.222.0.16 () {56 vars in 1111 bytes} [Thu May 26 12:21:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:37.384425 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af2abd5-ef70-4488-b1de-362f22c183c2 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:37.386293 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4284f2-d444-485d-ac3e-d027e4d209c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:37.387189 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4284f2-d444-485d-ac3e-d027e4d209c5 None admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:37.387598 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4284f2-d444-485d-ac3e-d027e4d209c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:37.387788 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4284f2-d444-485d-ac3e-d027e4d209c5 None admin] PATH_INFO: `/v3/projects/42e6c693bd224d92b8a0fe4ad0cc586d/users/512b4337083145f9ae57948a63444ced/roles/2991da7c6ccc478bbfdc0ce47a959495` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:37.403593 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4284f2-d444-485d-ac3e-d027e4d209c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=42e6c693bd224d92b8a0fe4ad0cc586d, user_id=512b4337083145f9ae57948a63444ced, role_id=2991da7c6ccc478bbfdc0ce47a959495)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:37.405068 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4284f2-d444-485d-ac3e-d027e4d209c5 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:37.424099 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 418/830] 10.222.0.16 () {58 vars in 1439 bytes} [Thu May 26 12:21:37 2022] PUT /identity/v3/projects/42e6c693bd224d92b8a0fe4ad0cc586d/users/512b4337083145f9ae57948a63444ced/roles/2991da7c6ccc478bbfdc0ce47a959495 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:21:37.519684 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af2abd5-ef70-4488-b1de-362f22c183c2 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:37.562902 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1995c240-65e7-47e2-93ee-1d8c3a80ee0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:37.563618 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995c240-65e7-47e2-93ee-1d8c3a80ee0c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:37.563903 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995c240-65e7-47e2-93ee-1d8c3a80ee0c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:37.564178 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995c240-65e7-47e2-93ee-1d8c3a80ee0c None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:37.565019 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1995c240-65e7-47e2-93ee-1d8c3a80ee0c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:37.565336 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1995c240-65e7-47e2-93ee-1d8c3a80ee0c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:37.566936 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1995c240-65e7-47e2-93ee-1d8c3a80ee0c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:37.581154 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 413/831] 10.222.0.16 () {56 vars in 1148 bytes} [Thu May 26 12:21:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:21:37.589261 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4284f2-d444-485d-ac3e-d027e4d209c5 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:37.699421 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:37.712059 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4284f2-d444-485d-ac3e-d027e4d209c5 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:37.754836 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926309af-6565-4b6c-b3a8-892a25507fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:37.755499 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926309af-6565-4b6c-b3a8-892a25507fa6 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:37.755780 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926309af-6565-4b6c-b3a8-892a25507fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:37.756053 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926309af-6565-4b6c-b3a8-892a25507fa6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:37.756912 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926309af-6565-4b6c-b3a8-892a25507fa6 None admin] RBAC: Adding query filter params (role.id=1a8e523ecbc84d818c2a9af0fb54da74, scope.project.id=42e6c693bd224d92b8a0fe4ad0cc586d, user.id=536f68ff77794352adf41aaacdc0645c) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:37.757224 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926309af-6565-4b6c-b3a8-892a25507fa6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:37.758644 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926309af-6565-4b6c-b3a8-892a25507fa6 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:37.765563 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 419/832] 10.222.0.16 () {56 vars in 1374 bytes} [Thu May 26 12:21:37 2022] GET /identity/v3/role_assignments?user.id=536f68ff77794352adf41aaacdc0645c&scope.project.id=42e6c693bd224d92b8a0fe4ad0cc586d&role.id=1a8e523ecbc84d818c2a9af0fb54da74 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:38.667138 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3201f41e-00e0-41dd-bae3-49748074200f None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:38.667661 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3201f41e-00e0-41dd-bae3-49748074200f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:38.667767 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3201f41e-00e0-41dd-bae3-49748074200f None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:38.669417 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 414/833] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:21:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:21:38.675194 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04330edf-3051-453e-a18c-f03a0a0cfd67 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:38.675585 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04330edf-3051-453e-a18c-f03a0a0cfd67 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:38.675746 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04330edf-3051-453e-a18c-f03a0a0cfd67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:38.693817 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-04330edf-3051-453e-a18c-f03a0a0cfd67 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:21:38.695008 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-04330edf-3051-453e-a18c-f03a0a0cfd67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:21:38.767460 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 420/834] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:21:38 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:21:38.788959 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3201f41e-00e0-41dd-bae3-49748074200f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:38.845406 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:38.902091 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3201f41e-00e0-41dd-bae3-49748074200f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:38.944694 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb4ae0-0996-442e-b965-c8fc517f1065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:38.945623 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb4ae0-0996-442e-b965-c8fc517f1065 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:38.945912 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb4ae0-0996-442e-b965-c8fc517f1065 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:38.946188 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb4ae0-0996-442e-b965-c8fc517f1065 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:38.946863 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeb4ae0-0996-442e-b965-c8fc517f1065 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:38.948270 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeb4ae0-0996-442e-b965-c8fc517f1065 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:38.961097 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-feeb4ae0-0996-442e-b965-c8fc517f1065 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 12:21:38.961097 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:38.961097 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:21:38.961097 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:21:38.961097 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:21:38.961097 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:21:38.961097 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:21:38.961097 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:21:38.961097 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 12:21:38.961097 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:38.961097 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:21:38.961097 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:38.961097 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:38.961097 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:38.961097 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:38.961097 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:38.961097 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:38.962106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:38.962106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:38.962106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:38.962106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:38.962106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:38.962106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:38.962106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:21:38.962106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:21:38.962106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:21:38.962106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:21:38.962106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:38.962106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:38.962106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:38.962106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:38.962106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:38.962106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:38.962937 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:38.962937 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:38.962937 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:38.962937 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:38.962937 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:38.962937 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:38.962937 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:38.962937 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:38.962937 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:38.962937 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:38.962937 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:21:38.962937 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:21:38.962937 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 12:21:38.962937 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:38.962937 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 415/835] 10.222.0.16 () {56 vars in 1114 bytes} [Thu May 26 12:21:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:38.968724 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04330edf-3051-453e-a18c-f03a0a0cfd67 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:39.053802 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:39.073988 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04330edf-3051-453e-a18c-f03a0a0cfd67 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:39.109161 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4617fc0-4c23-443e-bcb9-df402b79f13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:39.109817 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4617fc0-4c23-443e-bcb9-df402b79f13d None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:39.110096 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4617fc0-4c23-443e-bcb9-df402b79f13d None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:39.110941 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4617fc0-4c23-443e-bcb9-df402b79f13d None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:39.111645 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4617fc0-4c23-443e-bcb9-df402b79f13d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:39.111948 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4617fc0-4c23-443e-bcb9-df402b79f13d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:39.113340 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4617fc0-4c23-443e-bcb9-df402b79f13d None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:39.118280 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 421/836] 10.222.0.16 () {56 vars in 1114 bytes} [Thu May 26 12:21:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:39.123408 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb4ae0-0996-442e-b965-c8fc517f1065 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:39.143513 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbefa0f-f775-4313-9c70-4d014fa0e4a2 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:39.143801 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbefa0f-f775-4313-9c70-4d014fa0e4a2 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:39.144362 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbefa0f-f775-4313-9c70-4d014fa0e4a2 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:39.146023 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 422/837] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:21:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:21:39.152473 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ea8fc-8897-4427-901e-8fc0e82bc565 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:39.152754 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ea8fc-8897-4427-901e-8fc0e82bc565 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:39.153061 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ea8fc-8897-4427-901e-8fc0e82bc565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:39.175560 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-584ea8fc-8897-4427-901e-8fc0e82bc565 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:21:39.177040 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-584ea8fc-8897-4427-901e-8fc0e82bc565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:21:39.235104 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb4ae0-0996-442e-b965-c8fc517f1065 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:39.253982 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:39.274210 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 423/838] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:21:39 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:21:39.281658 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff35112e-a345-4e57-9beb-19320cf72172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:39.282886 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35112e-a345-4e57-9beb-19320cf72172 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:39.283170 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35112e-a345-4e57-9beb-19320cf72172 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:39.283444 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35112e-a345-4e57-9beb-19320cf72172 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:39.284152 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff35112e-a345-4e57-9beb-19320cf72172 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:39.284456 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff35112e-a345-4e57-9beb-19320cf72172 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:39.285862 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff35112e-a345-4e57-9beb-19320cf72172 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:39.290871 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 416/839] 10.222.0.16 () {56 vars in 1114 bytes} [Thu May 26 12:21:39 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:39.297651 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584ea8fc-8897-4427-901e-8fc0e82bc565 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:39.392520 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:39.418748 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584ea8fc-8897-4427-901e-8fc0e82bc565 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:39.457445 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2392a39-4dbb-40cc-aad1-84b138e2a88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:39.458660 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2392a39-4dbb-40cc-aad1-84b138e2a88d None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:39.459184 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2392a39-4dbb-40cc-aad1-84b138e2a88d None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:39.459676 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2392a39-4dbb-40cc-aad1-84b138e2a88d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:39.473101 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2392a39-4dbb-40cc-aad1-84b138e2a88d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:21:39.481281 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-d2392a39-4dbb-40cc-aad1-84b138e2a88d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:21:39.481281 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:39.481281 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:39.481281 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:39.481281 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:39.481281 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:39.481281 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:39.481281 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:39.481281 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:39.481281 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:39.481281 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:39.481281 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:39.481281 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:21:39.481281 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:21:39.481281 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:21:39.481281 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:21:39.482311 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:21:39.482311 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:21:39.482311 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:21:39.482311 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:21:39.482311 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:39.482311 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:39.482311 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:39.482311 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:39.482311 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:39.482311 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:39.482311 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:39.482311 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:39.482311 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:39.482311 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:39.482311 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:39.482311 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:39.483147 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:39.483147 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:39.483147 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:39.483147 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:39.483147 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:21:39.483147 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:21:39.483147 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:21:39.483147 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:21:39.483147 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:21:39.483147 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:21:39.483147 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:21:39.483147 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:39.488983 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 424/840] 10.222.0.16 () {56 vars in 1096 bytes} [Thu May 26 12:21:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:39.492323 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff35112e-a345-4e57-9beb-19320cf72172 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:39.609212 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff35112e-a345-4e57-9beb-19320cf72172 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:39.644723 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5644321a-4531-45e1-8fcc-67fdb02afcf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:39.645425 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644321a-4531-45e1-8fcc-67fdb02afcf4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:39.645710 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644321a-4531-45e1-8fcc-67fdb02afcf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:39.645985 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644321a-4531-45e1-8fcc-67fdb02afcf4 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:39.646733 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5644321a-4531-45e1-8fcc-67fdb02afcf4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:39.647038 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5644321a-4531-45e1-8fcc-67fdb02afcf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:39.648419 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5644321a-4531-45e1-8fcc-67fdb02afcf4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:39.657256 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 417/841] 10.222.0.16 () {56 vars in 1099 bytes} [Thu May 26 12:21:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:39.662917 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2392a39-4dbb-40cc-aad1-84b138e2a88d None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:39.713160 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed3f4c-cbbd-4cfc-a159-be6f72646301 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:39.713785 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed3f4c-cbbd-4cfc-a159-be6f72646301 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:39.713785 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed3f4c-cbbd-4cfc-a159-be6f72646301 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:39.715291 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 418/842] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:21:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:21:39.721952 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d2760-8058-466d-b1d6-a431bfc05eda None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:39.722233 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d2760-8058-466d-b1d6-a431bfc05eda None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:39.722508 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d2760-8058-466d-b1d6-a431bfc05eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:39.741978 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-916d2760-8058-466d-b1d6-a431bfc05eda None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:21:39.743091 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-916d2760-8058-466d-b1d6-a431bfc05eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:21:39.773948 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2392a39-4dbb-40cc-aad1-84b138e2a88d None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:39.797560 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:39.813997 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0d685-d1d3-4bea-82ed-fba0590f498a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:39.815322 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0d685-d1d3-4bea-82ed-fba0590f498a None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:39.815812 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0d685-d1d3-4bea-82ed-fba0590f498a None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:39.816295 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0d685-d1d3-4bea-82ed-fba0590f498a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:39.820318 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:39.832105 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e0d685-d1d3-4bea-82ed-fba0590f498a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:39.834142 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e0d685-d1d3-4bea-82ed-fba0590f498a None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:39.845838 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 419/843] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:21:39 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:21:39.857408 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-f1e0d685-d1d3-4bea-82ed-fba0590f498a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:39.857408 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:39.857408 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:39.857408 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:39.857408 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:39.857408 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:39.857408 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:39.857408 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:39.857408 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:39.857408 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:39.857408 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:39.857408 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:39.857408 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:21:39.857408 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:21:39.857408 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:21:39.858386 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:21:39.858386 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:39.858386 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:39.858386 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:39.858386 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:39.858386 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:39.858386 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:39.858386 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:39.858386 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:39.858386 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:39.858386 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:39.858386 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:39.858386 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:39.858386 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:39.858386 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:39.858386 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:39.858386 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:39.859278 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:21:39.859278 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:21:39.859278 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:39.859278 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:39.865767 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 425/844] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:21:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:39.867280 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0d685-d1d3-4bea-82ed-fba0590f498a None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:39.867392 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d2760-8058-466d-b1d6-a431bfc05eda None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:39.978886 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0d685-d1d3-4bea-82ed-fba0590f498a None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:39.985558 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d2760-8058-466d-b1d6-a431bfc05eda None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:40.016403 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e5db0f-f477-4294-8a0a-21a2e821e53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:40.017572 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e5db0f-f477-4294-8a0a-21a2e821e53f None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:40.017849 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e5db0f-f477-4294-8a0a-21a2e821e53f None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:40.018119 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e5db0f-f477-4294-8a0a-21a2e821e53f None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:40.018843 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e5db0f-f477-4294-8a0a-21a2e821e53f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:40.019143 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e5db0f-f477-4294-8a0a-21a2e821e53f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:40.020533 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e5db0f-f477-4294-8a0a-21a2e821e53f None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:40.023342 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e066df-5b57-4a67-9401-ee746d5d0c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:40.024134 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e066df-5b57-4a67-9401-ee746d5d0c09 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:40.024414 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e066df-5b57-4a67-9401-ee746d5d0c09 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:40.024702 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e066df-5b57-4a67-9401-ee746d5d0c09 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:40.033297 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 426/845] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:21:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:21:40.037836 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4432b8-24ea-4e84-a4ea-a6ba999ca2bd None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:40.037836 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4432b8-24ea-4e84-a4ea-a6ba999ca2bd None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:40.037836 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4432b8-24ea-4e84-a4ea-a6ba999ca2bd None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:40.037836 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 427/846] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:21:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:21:40.038815 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4432b8-24ea-4e84-a4ea-a6ba999ca2bd None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:40.041990 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e066df-5b57-4a67-9401-ee746d5d0c09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:21:40.049679 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-b9e066df-5b57-4a67-9401-ee746d5d0c09 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:21:40.049679 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:40.049679 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:40.049679 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:40.049679 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:40.049679 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:40.049679 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:40.049679 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:40.049679 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:40.049679 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:40.049679 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:40.049679 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:40.049679 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:21:40.049679 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:21:40.049679 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:21:40.049679 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:21:40.050622 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:21:40.050622 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:21:40.050622 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:21:40.050622 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:21:40.050622 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:40.050622 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:40.050622 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:40.050622 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:40.050622 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:40.050622 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:40.050622 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:40.050622 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:40.050622 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:40.050622 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:40.050622 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:40.050622 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:40.051476 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:40.051476 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:40.051476 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:40.051476 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:40.051476 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:21:40.051476 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:21:40.051476 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:21:40.051476 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:21:40.051476 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:21:40.051476 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:21:40.051476 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:21:40.051476 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:40.053065 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 420/847] 10.222.0.16 () {56 vars in 1102 bytes} [Thu May 26 12:21:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:40.055517 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d7d88-65dc-42b6-bd26-bee151c06e40 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:40.056172 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d7d88-65dc-42b6-bd26-bee151c06e40 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:40.056712 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d7d88-65dc-42b6-bd26-bee151c06e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:40.075547 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-461d7d88-65dc-42b6-bd26-bee151c06e40 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:21:40.076731 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-461d7d88-65dc-42b6-bd26-bee151c06e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:21:40.096469 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:40.103043 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:40.148976 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 421/848] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:21:40 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:21:40.150143 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d7d88-65dc-42b6-bd26-bee151c06e40 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:40.154816 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4432b8-24ea-4e84-a4ea-a6ba999ca2bd None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:40.196292 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee54b5-4cc9-4d37-b5fd-870e0c75938b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:40.197689 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee54b5-4cc9-4d37-b5fd-870e0c75938b None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:40.198305 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee54b5-4cc9-4d37-b5fd-870e0c75938b None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:40.198780 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee54b5-4cc9-4d37-b5fd-870e0c75938b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:40.207933 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ee54b5-4cc9-4d37-b5fd-870e0c75938b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:40.210907 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ee54b5-4cc9-4d37-b5fd-870e0c75938b None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:40.229500 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-92ee54b5-4cc9-4d37-b5fd-870e0c75938b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 12:21:40.229500 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:40.229500 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:40.229500 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:40.229500 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:40.229500 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:40.229500 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:40.229500 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:40.229500 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:40.229500 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:40.229500 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:40.229500 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:40.229500 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:21:40.229500 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:21:40.229500 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:21:40.229500 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:21:40.230532 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:40.230532 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:40.230532 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:21:40.230532 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:21:40.230532 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:21:40.230532 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:21:40.230532 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:40.230532 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:40.230532 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:40.230532 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:40.230532 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:40.230532 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:40.230532 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:40.230532 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:40.230532 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:40.230532 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:40.230532 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:40.230532 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:40.231483 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:40.231483 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:40.231483 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:21:40.231483 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:21:40.231483 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:21:40.231483 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:21:40.231483 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:21:40.231483 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:21:40.231483 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 12:21:40.231483 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:40.236070 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 428/849] 10.222.0.16 () {56 vars in 1096 bytes} [Thu May 26 12:21:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:21:40.236964 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee54b5-4cc9-4d37-b5fd-870e0c75938b None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:40.261112 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d7d88-65dc-42b6-bd26-bee151c06e40 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:40.298181 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2a0fff-4045-4bb6-8e75-45bb188291a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:40.298770 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a0fff-4045-4bb6-8e75-45bb188291a8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:40.299049 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a0fff-4045-4bb6-8e75-45bb188291a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:40.299322 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a0fff-4045-4bb6-8e75-45bb188291a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:40.300058 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2a0fff-4045-4bb6-8e75-45bb188291a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:40.300362 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2a0fff-4045-4bb6-8e75-45bb188291a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:40.301766 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2a0fff-4045-4bb6-8e75-45bb188291a8 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:40.310837 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 422/850] 10.222.0.16 () {56 vars in 1103 bytes} [Thu May 26 12:21:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:40.311733 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2a0fff-4045-4bb6-8e75-45bb188291a8 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:40.336663 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:40.363352 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee54b5-4cc9-4d37-b5fd-870e0c75938b None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:40.376587 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:40.404350 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd369c47-0b94-41c3-9c61-9c3ca0a70ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:40.405182 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd369c47-0b94-41c3-9c61-9c3ca0a70ff0 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:40.405460 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd369c47-0b94-41c3-9c61-9c3ca0a70ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:40.405728 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd369c47-0b94-41c3-9c61-9c3ca0a70ff0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:40.406383 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd369c47-0b94-41c3-9c61-9c3ca0a70ff0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:40.407762 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd369c47-0b94-41c3-9c61-9c3ca0a70ff0 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:40.419707 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-bd369c47-0b94-41c3-9c61-9c3ca0a70ff0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 12:21:40.419707 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:40.419707 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:21:40.419707 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:21:40.419707 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:21:40.419707 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:21:40.419707 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:21:40.419707 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:21:40.419707 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 12:21:40.419707 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:40.419707 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:21:40.419707 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:40.419707 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:40.419707 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:40.419707 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:40.419707 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:40.420633 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:40.420633 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:40.420633 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:40.420633 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:40.420633 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:40.420633 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:40.420633 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:40.420633 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:21:40.420633 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:21:40.420633 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:21:40.420633 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:21:40.420633 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:40.420633 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:40.420633 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:40.420633 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:40.420633 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:40.421823 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:40.421823 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:40.421823 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:40.421823 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:40.421823 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:40.421823 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:40.421823 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:40.421823 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:40.421823 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:40.421823 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:40.421823 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:40.421823 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:21:40.421823 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:21:40.421823 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 12:21:40.421823 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:40.421823 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 429/851] 10.222.0.16 () {56 vars in 1132 bytes} [Thu May 26 12:21:40 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:40.422726 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd369c47-0b94-41c3-9c61-9c3ca0a70ff0 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:40.431747 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2a0fff-4045-4bb6-8e75-45bb188291a8 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:40.472794 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320034d2-2a58-4a36-8a0c-2af1d75e2418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:40.473507 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320034d2-2a58-4a36-8a0c-2af1d75e2418 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:40.473795 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320034d2-2a58-4a36-8a0c-2af1d75e2418 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:40.474072 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320034d2-2a58-4a36-8a0c-2af1d75e2418 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:40.474953 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320034d2-2a58-4a36-8a0c-2af1d75e2418 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:40.475240 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320034d2-2a58-4a36-8a0c-2af1d75e2418 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:40.476726 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320034d2-2a58-4a36-8a0c-2af1d75e2418 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:40.504029 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 423/852] 10.222.0.16 () {56 vars in 1135 bytes} [Thu May 26 12:21:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:40.504029 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320034d2-2a58-4a36-8a0c-2af1d75e2418 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:40.542055 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd369c47-0b94-41c3-9c61-9c3ca0a70ff0 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:40.583128 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54db1a23-90d8-4418-b70a-7950e2535731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:40.583898 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db1a23-90d8-4418-b70a-7950e2535731 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:40.584184 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db1a23-90d8-4418-b70a-7950e2535731 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:40.584463 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db1a23-90d8-4418-b70a-7950e2535731 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:40.595693 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54db1a23-90d8-4418-b70a-7950e2535731 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:40.597205 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54db1a23-90d8-4418-b70a-7950e2535731 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:40.604301 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:40.614277 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-54db1a23-90d8-4418-b70a-7950e2535731 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:40.614277 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:40.614277 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:40.614277 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:40.614277 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:40.614277 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:40.614277 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:40.614277 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:40.614277 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:40.614277 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:40.614277 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:40.614277 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:40.614277 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:21:40.614277 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:21:40.614277 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:21:40.615173 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:21:40.615173 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:40.615173 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:40.615173 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:40.615173 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:40.615173 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:40.615173 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:40.615173 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:40.615173 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:40.615173 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:40.615173 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:40.615173 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:40.615173 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:40.615173 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:40.615173 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:40.615173 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:40.615173 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:40.616055 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:21:40.616055 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:21:40.616055 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:40.616055 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:40.616055 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 430/853] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:21:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:40.616336 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54db1a23-90d8-4418-b70a-7950e2535731 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:40.631591 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320034d2-2a58-4a36-8a0c-2af1d75e2418 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:40.645747 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:40.668534 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86098997-f91b-4f68-88bf-a9b6ab073d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:40.669216 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86098997-f91b-4f68-88bf-a9b6ab073d5b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:40.669496 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86098997-f91b-4f68-88bf-a9b6ab073d5b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:40.669765 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86098997-f91b-4f68-88bf-a9b6ab073d5b None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:40.670459 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86098997-f91b-4f68-88bf-a9b6ab073d5b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:40.670758 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86098997-f91b-4f68-88bf-a9b6ab073d5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:40.672127 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86098997-f91b-4f68-88bf-a9b6ab073d5b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:40.677757 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 424/854] 10.222.0.16 () {56 vars in 1126 bytes} [Thu May 26 12:21:40 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:40.678322 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86098997-f91b-4f68-88bf-a9b6ab073d5b None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:40.729628 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54db1a23-90d8-4418-b70a-7950e2535731 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:40.769842 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca60855-eb4a-4219-adf8-84a401d3a91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:40.770498 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca60855-eb4a-4219-adf8-84a401d3a91f None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:40.770785 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca60855-eb4a-4219-adf8-84a401d3a91f None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:40.771063 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca60855-eb4a-4219-adf8-84a401d3a91f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:40.786122 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86098997-f91b-4f68-88bf-a9b6ab073d5b None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:40.822833 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7589ba-1774-426b-a028-c32a1c7b447d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:40.823497 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7589ba-1774-426b-a028-c32a1c7b447d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:40.823770 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7589ba-1774-426b-a028-c32a1c7b447d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:40.824045 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7589ba-1774-426b-a028-c32a1c7b447d None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:40.824892 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7589ba-1774-426b-a028-c32a1c7b447d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:40.825295 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7589ba-1774-426b-a028-c32a1c7b447d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:40.826696 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7589ba-1774-426b-a028-c32a1c7b447d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:40.837715 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca60855-eb4a-4219-adf8-84a401d3a91f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:40.839107 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca60855-eb4a-4219-adf8-84a401d3a91f None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:40.842926 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 425/855] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:21:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:40.844041 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7589ba-1774-426b-a028-c32a1c7b447d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:40.848609 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:40.864826 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:40.955721 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 431/856] 10.222.0.16 () {58 vars in 1282 bytes} [Thu May 26 12:21:40 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:21:40.955721 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca60855-eb4a-4219-adf8-84a401d3a91f None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:40.955975 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7589ba-1774-426b-a028-c32a1c7b447d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:40.995120 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1682626-70f9-481b-8e1f-b5a946dca1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:40.995790 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1682626-70f9-481b-8e1f-b5a946dca1cf None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:40.996073 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1682626-70f9-481b-8e1f-b5a946dca1cf None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:40.996613 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1682626-70f9-481b-8e1f-b5a946dca1cf None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:40.997131 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1682626-70f9-481b-8e1f-b5a946dca1cf None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:40.997443 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1682626-70f9-481b-8e1f-b5a946dca1cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:40.998820 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1682626-70f9-481b-8e1f-b5a946dca1cf None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:41.012864 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 426/857] 10.222.0.16 () {56 vars in 1126 bytes} [Thu May 26 12:21:40 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:41.012864 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1682626-70f9-481b-8e1f-b5a946dca1cf None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:41.063342 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca60855-eb4a-4219-adf8-84a401d3a91f None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:41.094363 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:41.107614 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1998ce-d974-414d-95a5-0818894ef071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:41.108587 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1998ce-d974-414d-95a5-0818894ef071 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:41.109017 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1998ce-d974-414d-95a5-0818894ef071 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:41.109387 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1998ce-d974-414d-95a5-0818894ef071 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:41.118386 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1998ce-d974-414d-95a5-0818894ef071 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:41.120027 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1998ce-d974-414d-95a5-0818894ef071 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:41.121058 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:41.137052 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-3c1998ce-d974-414d-95a5-0818894ef071 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 12:21:41.137052 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:41.137052 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:41.137052 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:41.137052 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:41.137052 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:41.137052 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:41.137052 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:41.137052 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:41.137052 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:41.137052 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:41.137052 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:41.137052 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:21:41.137052 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:21:41.137052 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:21:41.137052 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:21:41.138255 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:41.138255 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:41.138255 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:21:41.138255 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:21:41.138255 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:21:41.138255 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:21:41.138255 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:41.138255 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:41.138255 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:41.138255 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:41.138255 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:41.138255 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:41.138255 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:41.138255 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:41.138255 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:41.138255 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:41.138255 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:41.138255 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:41.139444 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:41.139444 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:41.139444 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:21:41.139444 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:21:41.139444 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:21:41.139444 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:21:41.139444 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:21:41.139444 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:21:41.139444 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 12:21:41.139444 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:41.141615 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 432/858] 10.222.0.16 () {56 vars in 1117 bytes} [Thu May 26 12:21:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:41.149893 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1998ce-d974-414d-95a5-0818894ef071 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:41.167242 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1682626-70f9-481b-8e1f-b5a946dca1cf None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:41.217567 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e14527a-b414-41ab-8463-895c5c419a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:41.218375 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14527a-b414-41ab-8463-895c5c419a61 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:41.218928 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14527a-b414-41ab-8463-895c5c419a61 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:41.219230 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14527a-b414-41ab-8463-895c5c419a61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:41.234327 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e14527a-b414-41ab-8463-895c5c419a61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:41.235952 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e14527a-b414-41ab-8463-895c5c419a61 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:41.255664 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-5e14527a-b414-41ab-8463-895c5c419a61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:41.255664 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:41.255664 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:41.255664 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:41.255664 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:41.255664 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:41.255664 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:41.255664 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:41.255664 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:41.255664 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:41.255664 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:41.255664 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:41.255664 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:21:41.255664 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:21:41.255664 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:21:41.256619 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:21:41.256619 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:41.256619 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:41.256619 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:41.256619 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:41.256619 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:41.256619 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:41.256619 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:41.256619 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:41.256619 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:41.256619 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:41.256619 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:41.256619 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:41.256619 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:41.256619 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:41.256619 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:41.256619 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:41.257737 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:21:41.257737 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:21:41.257737 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:41.257737 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:41.257737 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 427/859] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:21:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:41.262962 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e14527a-b414-41ab-8463-895c5c419a61 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:41.288941 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1998ce-d974-414d-95a5-0818894ef071 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:41.328241 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f9e73-c5f0-4c82-a354-d2e6aa200260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:41.329879 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f9e73-c5f0-4c82-a354-d2e6aa200260 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:41.330366 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f9e73-c5f0-4c82-a354-d2e6aa200260 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:41.330909 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f9e73-c5f0-4c82-a354-d2e6aa200260 None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:41.331959 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323f9e73-c5f0-4c82-a354-d2e6aa200260 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:41.332525 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323f9e73-c5f0-4c82-a354-d2e6aa200260 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:41.334483 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323f9e73-c5f0-4c82-a354-d2e6aa200260 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:41.358811 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 433/860] 10.222.0.16 () {56 vars in 1149 bytes} [Thu May 26 12:21:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:41.364433 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f9e73-c5f0-4c82-a354-d2e6aa200260 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:41.388364 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e14527a-b414-41ab-8463-895c5c419a61 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:41.413344 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:41.414444 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:41.439319 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a8dfed-ee77-4790-986c-404ba14f1c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:41.440418 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8dfed-ee77-4790-986c-404ba14f1c96 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:41.440942 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8dfed-ee77-4790-986c-404ba14f1c96 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:41.441417 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8dfed-ee77-4790-986c-404ba14f1c96 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:41.442691 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a8dfed-ee77-4790-986c-404ba14f1c96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:41.444105 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a8dfed-ee77-4790-986c-404ba14f1c96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:41.446128 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a8dfed-ee77-4790-986c-404ba14f1c96 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:41.464923 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 428/861] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:21:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:41.470895 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a8dfed-ee77-4790-986c-404ba14f1c96 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:41.489245 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f9e73-c5f0-4c82-a354-d2e6aa200260 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:41.527348 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5372ebe3-58f9-4848-8791-e6c2cacc533c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:41.528000 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372ebe3-58f9-4848-8791-e6c2cacc533c None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:41.528284 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372ebe3-58f9-4848-8791-e6c2cacc533c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:41.528560 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372ebe3-58f9-4848-8791-e6c2cacc533c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:41.606941 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5372ebe3-58f9-4848-8791-e6c2cacc533c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:41.608425 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5372ebe3-58f9-4848-8791-e6c2cacc533c None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:41.609432 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a8dfed-ee77-4790-986c-404ba14f1c96 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:41.648256 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ea530-50cc-4d97-a122-8abce60a271b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:41.649078 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ea530-50cc-4d97-a122-8abce60a271b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:41.649361 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ea530-50cc-4d97-a122-8abce60a271b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:41.649633 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ea530-50cc-4d97-a122-8abce60a271b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:41.653751 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:41.656485 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17ea530-50cc-4d97-a122-8abce60a271b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:41.658572 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17ea530-50cc-4d97-a122-8abce60a271b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:41.672302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-e17ea530-50cc-4d97-a122-8abce60a271b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:21:41.672302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:41.672302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:41.672302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:41.672302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:41.672302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:41.672302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:41.672302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:41.672302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:41.672302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:41.672302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:41.672302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:41.672302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:21:41.672302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:21:41.672302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:21:41.673983 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:21:41.673983 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:41.673983 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:41.673983 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:41.673983 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:41.673983 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:41.673983 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:41.673983 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:41.673983 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:41.673983 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:41.673983 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:41.673983 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:41.673983 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:41.673983 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:41.673983 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:41.673983 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:41.673983 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:41.675007 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:21:41.675007 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:21:41.675007 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:21:41.675007 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:21:41.675007 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:21:41.675007 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:21:41.675007 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:21:41.675007 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:41.675007 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 429/862] 10.222.0.16 () {56 vars in 1111 bytes} [Thu May 26 12:21:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:21:41.679859 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b03437-5d06-4178-a687-a81c8ad36afa None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:41.680150 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b03437-5d06-4178-a687-a81c8ad36afa None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:41.680425 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b03437-5d06-4178-a687-a81c8ad36afa None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:41.685352 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 430/863] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:21:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:21:41.685352 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b03437-5d06-4178-a687-a81c8ad36afa None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:41.722989 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 434/864] 10.222.0.16 () {58 vars in 1282 bytes} [Thu May 26 12:21:41 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:21:41.724247 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429ca88-9f76-4d34-9df4-504b68d712f2 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:41.724601 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429ca88-9f76-4d34-9df4-504b68d712f2 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:41.724968 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429ca88-9f76-4d34-9df4-504b68d712f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:41.735575 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:41.742149 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-d429ca88-9f76-4d34-9df4-504b68d712f2 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:21:41.743390 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-d429ca88-9f76-4d34-9df4-504b68d712f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:21:41.800011 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b03437-5d06-4178-a687-a81c8ad36afa None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:41.815345 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 435/865] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:21:41 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:21:41.816388 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d429ca88-9f76-4d34-9df4-504b68d712f2 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:41.850092 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7135c5a-41b9-4f5c-a7dd-03a020b974ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:41.851081 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7135c5a-41b9-4f5c-a7dd-03a020b974ca None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:41.851670 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7135c5a-41b9-4f5c-a7dd-03a020b974ca None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:41.852933 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7135c5a-41b9-4f5c-a7dd-03a020b974ca None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:41.853919 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7135c5a-41b9-4f5c-a7dd-03a020b974ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:41.854429 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7135c5a-41b9-4f5c-a7dd-03a020b974ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:41.856052 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7135c5a-41b9-4f5c-a7dd-03a020b974ca None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:41.872291 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 431/866] 10.222.0.16 () {56 vars in 1148 bytes} [Thu May 26 12:21:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:41.873949 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7135c5a-41b9-4f5c-a7dd-03a020b974ca None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:41.889169 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:41.921359 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d429ca88-9f76-4d34-9df4-504b68d712f2 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:41.958365 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef75423-efec-4fac-85a6-c9b176a6a3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:41.959273 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef75423-efec-4fac-85a6-c9b176a6a3fd None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:41.959460 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef75423-efec-4fac-85a6-c9b176a6a3fd None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:41.959734 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef75423-efec-4fac-85a6-c9b176a6a3fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:41.970284 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef75423-efec-4fac-85a6-c9b176a6a3fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:41.971819 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef75423-efec-4fac-85a6-c9b176a6a3fd None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:41.980961 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:41.983879 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7135c5a-41b9-4f5c-a7dd-03a020b974ca None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:41.990754 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-5ef75423-efec-4fac-85a6-c9b176a6a3fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:41.990754 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:41.990754 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:41.990754 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:41.990754 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:41.990754 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:41.990754 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:41.990754 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:41.990754 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:41.990754 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:41.990754 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:41.990754 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:41.990754 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:21:41.990754 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:21:41.990754 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:21:41.991693 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:21:41.991693 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:41.991693 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:41.991693 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:41.991693 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:41.991693 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:41.991693 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:41.991693 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:41.991693 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:41.991693 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:41.991693 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:41.991693 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:41.991693 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:41.991693 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:41.991693 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:41.991693 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:41.991693 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:41.992609 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:21:41.992609 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:21:41.992609 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:41.992609 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:41.996530 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 436/867] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:21:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:41.997342 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef75423-efec-4fac-85a6-c9b176a6a3fd None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:42.022594 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e44f297-061f-42ce-a135-708b6d137803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:42.023785 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44f297-061f-42ce-a135-708b6d137803 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:42.024260 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44f297-061f-42ce-a135-708b6d137803 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:42.024536 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44f297-061f-42ce-a135-708b6d137803 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:42.025288 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e44f297-061f-42ce-a135-708b6d137803 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:42.026676 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e44f297-061f-42ce-a135-708b6d137803 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:42.039926 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 432/868] 10.222.0.16 () {60 vars in 1141 bytes} [Thu May 26 12:21:41 2022] POST /identity/v3/services => generated 251 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:21:42.040898 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e44f297-061f-42ce-a135-708b6d137803 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:42.123413 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef75423-efec-4fac-85a6-c9b176a6a3fd None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:42.154744 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:42.179741 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a218f8-fa9c-44d6-85ad-fd067e028478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:42.180533 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a218f8-fa9c-44d6-85ad-fd067e028478 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:42.180892 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a218f8-fa9c-44d6-85ad-fd067e028478 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:42.181265 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a218f8-fa9c-44d6-85ad-fd067e028478 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:42.182185 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a218f8-fa9c-44d6-85ad-fd067e028478 None admin] RBAC: Adding query filter params (role.id=1a8e523ecbc84d818c2a9af0fb54da74, scope.project.id=42e6c693bd224d92b8a0fe4ad0cc586d, user.id=02767dcbd1574e08a9e82a775ac2b289) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:42.182675 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a218f8-fa9c-44d6-85ad-fd067e028478 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:42.184357 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a218f8-fa9c-44d6-85ad-fd067e028478 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:42.194581 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e44f297-061f-42ce-a135-708b6d137803 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:42.197308 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 437/869] 10.222.0.16 () {56 vars in 1374 bytes} [Thu May 26 12:21:41 2022] GET /identity/v3/role_assignments?user.id=02767dcbd1574e08a9e82a775ac2b289&scope.project.id=42e6c693bd224d92b8a0fe4ad0cc586d&role.id=1a8e523ecbc84d818c2a9af0fb54da74 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:42.237639 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b717d949-88a7-482f-a06c-bc5e06357fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:42.238786 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b717d949-88a7-482f-a06c-bc5e06357fbf None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:42.239333 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b717d949-88a7-482f-a06c-bc5e06357fbf None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:42.239840 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b717d949-88a7-482f-a06c-bc5e06357fbf None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:42.240828 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b717d949-88a7-482f-a06c-bc5e06357fbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:42.241415 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b717d949-88a7-482f-a06c-bc5e06357fbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:42.243115 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b717d949-88a7-482f-a06c-bc5e06357fbf None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:42.262746 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 433/870] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:21:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:42.264433 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a218f8-fa9c-44d6-85ad-fd067e028478 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:42.378836 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a218f8-fa9c-44d6-85ad-fd067e028478 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:42.414532 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d684f0c-382d-4b1f-b980-9e17e1ecfa1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:42.415706 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d684f0c-382d-4b1f-b980-9e17e1ecfa1d None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:42.416195 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d684f0c-382d-4b1f-b980-9e17e1ecfa1d None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:42.416688 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d684f0c-382d-4b1f-b980-9e17e1ecfa1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:42.424452 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d684f0c-382d-4b1f-b980-9e17e1ecfa1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:42.426174 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d684f0c-382d-4b1f-b980-9e17e1ecfa1d None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:42.441301 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-3d684f0c-382d-4b1f-b980-9e17e1ecfa1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:21:42.441301 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:42.441301 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:42.441301 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:42.441301 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:42.441301 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:42.441301 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:42.441301 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:42.441301 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:42.441301 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:42.441301 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:42.441301 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:42.441301 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:21:42.441301 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:21:42.441301 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:21:42.442215 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:21:42.442215 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:42.442215 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:42.442215 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:42.442215 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:42.442215 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:42.442215 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:42.442215 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:42.442215 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:42.442215 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:42.442215 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:42.442215 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:42.442215 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:42.442215 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:42.442215 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:42.442215 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:42.442215 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:42.443095 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:21:42.443095 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:21:42.443095 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:21:42.443095 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:21:42.443095 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:21:42.443095 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:21:42.443095 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:21:42.443095 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:42.446804 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 438/871] 10.222.0.16 () {56 vars in 1111 bytes} [Thu May 26 12:21:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:42.452007 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b717d949-88a7-482f-a06c-bc5e06357fbf None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:42.475319 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:42.558120 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b717d949-88a7-482f-a06c-bc5e06357fbf None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:42.593012 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e495893c-65fb-446d-b8ca-5401df0b9a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:42.593949 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e495893c-65fb-446d-b8ca-5401df0b9a4c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:42.594234 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e495893c-65fb-446d-b8ca-5401df0b9a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:42.594507 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e495893c-65fb-446d-b8ca-5401df0b9a4c None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:42.595839 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e495893c-65fb-446d-b8ca-5401df0b9a4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:42.596148 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e495893c-65fb-446d-b8ca-5401df0b9a4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:42.597633 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e495893c-65fb-446d-b8ca-5401df0b9a4c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:42.611104 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 434/872] 10.222.0.16 () {56 vars in 1148 bytes} [Thu May 26 12:21:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:42.617740 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d684f0c-382d-4b1f-b980-9e17e1ecfa1d None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:42.673426 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:42.729647 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d684f0c-382d-4b1f-b980-9e17e1ecfa1d None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:42.765381 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f53bf9-8a0a-4d58-812a-2e3b4b722723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:42.766119 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f53bf9-8a0a-4d58-812a-2e3b4b722723 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:42.766404 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f53bf9-8a0a-4d58-812a-2e3b4b722723 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:42.766718 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f53bf9-8a0a-4d58-812a-2e3b4b722723 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:42.767558 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f53bf9-8a0a-4d58-812a-2e3b4b722723 None admin] RBAC: Adding query filter params (role.id=2991da7c6ccc478bbfdc0ce47a959495, scope.project.id=42e6c693bd224d92b8a0fe4ad0cc586d, user.id=512b4337083145f9ae57948a63444ced) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:42.767873 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f53bf9-8a0a-4d58-812a-2e3b4b722723 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:42.769380 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f53bf9-8a0a-4d58-812a-2e3b4b722723 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:42.775965 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 439/873] 10.222.0.16 () {56 vars in 1374 bytes} [Thu May 26 12:21:42 2022] GET /identity/v3/role_assignments?user.id=512b4337083145f9ae57948a63444ced&scope.project.id=42e6c693bd224d92b8a0fe4ad0cc586d&role.id=2991da7c6ccc478bbfdc0ce47a959495 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:43.354308 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52d678-3bc9-4712-a327-52bfba7f5e9f None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:43.354834 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52d678-3bc9-4712-a327-52bfba7f5e9f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:43.354913 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52d678-3bc9-4712-a327-52bfba7f5e9f None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:43.356491 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 435/874] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:21:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:21:43.362094 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf217623-ee59-4a2d-b865-3692dff60bb5 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:43.362497 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf217623-ee59-4a2d-b865-3692dff60bb5 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:43.362680 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf217623-ee59-4a2d-b865-3692dff60bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:43.381491 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-cf217623-ee59-4a2d-b865-3692dff60bb5 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:21:43.382740 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-cf217623-ee59-4a2d-b865-3692dff60bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:21:43.456948 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 440/875] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:21:43 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:21:43.476013 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b52d678-3bc9-4712-a327-52bfba7f5e9f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:43.564978 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:43.585229 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b52d678-3bc9-4712-a327-52bfba7f5e9f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:43.619490 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac5473-7dff-4f73-8bd8-76165ab9e297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:43.620078 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac5473-7dff-4f73-8bd8-76165ab9e297 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:43.620363 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac5473-7dff-4f73-8bd8-76165ab9e297 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:43.620641 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac5473-7dff-4f73-8bd8-76165ab9e297 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:43.621391 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ac5473-7dff-4f73-8bd8-76165ab9e297 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:43.622772 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ac5473-7dff-4f73-8bd8-76165ab9e297 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:43.639627 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 436/876] 10.222.0.16 () {60 vars in 1141 bytes} [Thu May 26 12:21:43 2022] POST /identity/v3/services => generated 269 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:21:44.375859 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea609c-7afd-4e96-aff7-18d80e4bc58d None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:44.376488 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea609c-7afd-4e96-aff7-18d80e4bc58d None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:44.376488 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea609c-7afd-4e96-aff7-18d80e4bc58d None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:44.378116 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 441/877] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:21:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:21:44.383456 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4367ae-f58d-4f9e-88a7-15ca0a2c4b80 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:44.384026 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4367ae-f58d-4f9e-88a7-15ca0a2c4b80 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:44.384026 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4367ae-f58d-4f9e-88a7-15ca0a2c4b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:44.401062 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-4a4367ae-f58d-4f9e-88a7-15ca0a2c4b80 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:21:44.402249 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4a4367ae-f58d-4f9e-88a7-15ca0a2c4b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:21:44.484557 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 437/878] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:21:44 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:21:44.496179 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0420522a-e7f2-47b7-98e4-d95ae664cdc2 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:44.496464 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0420522a-e7f2-47b7-98e4-d95ae664cdc2 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:44.496740 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0420522a-e7f2-47b7-98e4-d95ae664cdc2 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:44.498413 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 442/879] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:21:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:21:44.503679 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53322a91-a5cf-4fc3-8d0d-12003a3d5ecc None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:44.503968 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53322a91-a5cf-4fc3-8d0d-12003a3d5ecc None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:44.504249 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53322a91-a5cf-4fc3-8d0d-12003a3d5ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:44.506836 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0420522a-e7f2-47b7-98e4-d95ae664cdc2 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:44.521871 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-53322a91-a5cf-4fc3-8d0d-12003a3d5ecc None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:21:44.523050 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-53322a91-a5cf-4fc3-8d0d-12003a3d5ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:21:44.551312 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:44.586699 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:44.597326 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 438/880] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:21:44 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:21:44.622874 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53322a91-a5cf-4fc3-8d0d-12003a3d5ecc None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:44.628009 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0420522a-e7f2-47b7-98e4-d95ae664cdc2 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:44.665903 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9546b-82f0-43a0-86b8-cee5796d02fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:44.666698 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9546b-82f0-43a0-86b8-cee5796d02fb None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:44.666980 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9546b-82f0-43a0-86b8-cee5796d02fb None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:44.667258 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9546b-82f0-43a0-86b8-cee5796d02fb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:44.667912 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a9546b-82f0-43a0-86b8-cee5796d02fb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:44.669315 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a9546b-82f0-43a0-86b8-cee5796d02fb None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:44.683165 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-24a9546b-82f0-43a0-86b8-cee5796d02fb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 12:21:44.683165 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:44.683165 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:21:44.683165 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:21:44.683165 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:21:44.683165 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:21:44.683165 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:21:44.683165 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:21:44.683165 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 12:21:44.683165 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:44.683165 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:21:44.683165 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:44.683165 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:44.683165 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:44.683165 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:44.683165 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:44.683165 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:44.684279 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:44.684279 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:44.684279 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:44.684279 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:44.684279 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:44.684279 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:44.684279 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:21:44.684279 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:21:44.684279 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:21:44.684279 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:21:44.684279 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:44.684279 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:44.684279 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:44.684279 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:44.684279 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:44.684279 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:44.685266 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:44.685266 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:44.685266 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:44.685266 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:44.685266 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:44.685266 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:44.685266 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:44.685266 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:44.685266 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:44.685266 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:44.685266 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:21:44.685266 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:21:44.685266 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 12:21:44.685266 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:44.688938 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 443/881] 10.222.0.16 () {56 vars in 1114 bytes} [Thu May 26 12:21:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:21:44.690644 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9546b-82f0-43a0-86b8-cee5796d02fb None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:44.747011 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53322a91-a5cf-4fc3-8d0d-12003a3d5ecc None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:44.789893 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f0442-0366-4b88-8875-1f8b8f29875b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:44.791337 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f0442-0366-4b88-8875-1f8b8f29875b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:44.791854 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f0442-0366-4b88-8875-1f8b8f29875b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:44.792344 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f0442-0366-4b88-8875-1f8b8f29875b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:44.793327 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4f0442-0366-4b88-8875-1f8b8f29875b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:44.794956 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4f0442-0366-4b88-8875-1f8b8f29875b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:44.805371 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9546b-82f0-43a0-86b8-cee5796d02fb None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:44.807323 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:44.810381 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-2d4f0442-0366-4b88-8875-1f8b8f29875b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:21:44.810381 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:44.810381 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:21:44.810381 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:21:44.810381 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:21:44.810381 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:21:44.810381 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:21:44.810381 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:21:44.810381 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:21:44.810381 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:44.810381 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:21:44.810381 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:44.810381 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:44.810381 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:44.810381 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:44.810381 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:44.810381 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:44.811366 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:44.811366 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:44.811366 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:44.811366 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:44.811366 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:44.811366 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:44.811366 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:21:44.811366 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:21:44.811366 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:21:44.811366 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:21:44.811366 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:44.811366 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:44.811366 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:44.811366 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:44.811366 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:44.811366 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:44.812222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:44.812222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:44.812222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:44.812222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:44.812222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:44.812222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:44.812222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:44.812222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:44.812222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:44.812222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:44.812222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:21:44.812222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:21:44.812222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:21:44.812222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:44.815984 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 439/882] 10.222.0.16 () {56 vars in 1126 bytes} [Thu May 26 12:21:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:21:44.821486 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f0442-0366-4b88-8875-1f8b8f29875b None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:44.850657 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55101707-52b5-4feb-8ae7-f9a00292df0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:44.852048 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55101707-52b5-4feb-8ae7-f9a00292df0c None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:44.852579 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55101707-52b5-4feb-8ae7-f9a00292df0c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:44.853101 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55101707-52b5-4feb-8ae7-f9a00292df0c None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:44.854045 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55101707-52b5-4feb-8ae7-f9a00292df0c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:44.854555 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55101707-52b5-4feb-8ae7-f9a00292df0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:44.856343 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55101707-52b5-4feb-8ae7-f9a00292df0c None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:44.862075 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 444/883] 10.222.0.16 () {56 vars in 1114 bytes} [Thu May 26 12:21:44 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:44.870919 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55101707-52b5-4feb-8ae7-f9a00292df0c None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:44.887230 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:44.938222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f0442-0366-4b88-8875-1f8b8f29875b None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:44.988628 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a597e87f-911f-4751-a61f-f2613ff7d181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:44.989575 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597e87f-911f-4751-a61f-f2613ff7d181 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:44.989712 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597e87f-911f-4751-a61f-f2613ff7d181 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:44.989877 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597e87f-911f-4751-a61f-f2613ff7d181 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:44.990650 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a597e87f-911f-4751-a61f-f2613ff7d181 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:44.990957 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a597e87f-911f-4751-a61f-f2613ff7d181 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:44.992444 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a597e87f-911f-4751-a61f-f2613ff7d181 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:44.999197 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 440/884] 10.222.0.16 () {56 vars in 1122 bytes} [Thu May 26 12:21:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:21:45.004946 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a597e87f-911f-4751-a61f-f2613ff7d181 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:45.008060 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55101707-52b5-4feb-8ae7-f9a00292df0c None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:45.053696 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb781bac-6aab-49f8-a524-1d38601eadff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:45.054860 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb781bac-6aab-49f8-a524-1d38601eadff None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:45.055776 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb781bac-6aab-49f8-a524-1d38601eadff None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:45.056238 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb781bac-6aab-49f8-a524-1d38601eadff None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:45.057454 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb781bac-6aab-49f8-a524-1d38601eadff None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:45.058190 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb781bac-6aab-49f8-a524-1d38601eadff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:45.060105 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb781bac-6aab-49f8-a524-1d38601eadff None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:45.068026 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 445/885] 10.222.0.16 () {56 vars in 1114 bytes} [Thu May 26 12:21:44 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:45.075730 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb781bac-6aab-49f8-a524-1d38601eadff None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:45.105965 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:45.119267 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a597e87f-911f-4751-a61f-f2613ff7d181 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:45.145659 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:45.157992 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1fbe30-0c2e-4f91-9444-ed56d3b9ee44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:45.158657 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1fbe30-0c2e-4f91-9444-ed56d3b9ee44 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:45.158939 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1fbe30-0c2e-4f91-9444-ed56d3b9ee44 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:45.159223 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1fbe30-0c2e-4f91-9444-ed56d3b9ee44 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:45.159918 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1fbe30-0c2e-4f91-9444-ed56d3b9ee44 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:45.160233 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1fbe30-0c2e-4f91-9444-ed56d3b9ee44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:45.161635 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1fbe30-0c2e-4f91-9444-ed56d3b9ee44 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:45.166265 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 441/886] 10.222.0.16 () {56 vars in 1122 bytes} [Thu May 26 12:21:45 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:45.167634 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa692e-e285-4f0b-a22d-338eee9ba48f None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:45.167925 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa692e-e285-4f0b-a22d-338eee9ba48f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:45.168201 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa692e-e285-4f0b-a22d-338eee9ba48f None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:45.169738 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 442/887] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:21:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:21:45.179188 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b063a08-8bd5-4301-bee4-7e9149d0c7cd None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:45.179641 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b063a08-8bd5-4301-bee4-7e9149d0c7cd None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:45.180015 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b063a08-8bd5-4301-bee4-7e9149d0c7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:45.189044 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb781bac-6aab-49f8-a524-1d38601eadff None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:45.202900 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-3b063a08-8bd5-4301-bee4-7e9149d0c7cd None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:21:45.204328 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3b063a08-8bd5-4301-bee4-7e9149d0c7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:21:45.229437 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc7c67-2a98-432c-988c-3f50b549cc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:45.230395 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc7c67-2a98-432c-988c-3f50b549cc34 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:45.230826 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc7c67-2a98-432c-988c-3f50b549cc34 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:45.231254 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc7c67-2a98-432c-988c-3f50b549cc34 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:45.232230 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bc7c67-2a98-432c-988c-3f50b549cc34 None admin] RBAC: Adding query filter params (interface=public, service_id=d58fcec289a64d19bc4e1a75022aabd4, region_id=RegionOne) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:45.232797 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bc7c67-2a98-432c-988c-3f50b549cc34 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:45.234226 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bc7c67-2a98-432c-988c-3f50b549cc34 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:45.245448 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 446/888] 10.222.0.16 () {56 vars in 1251 bytes} [Thu May 26 12:21:45 2022] GET /identity/v3/endpoints?service_id=d58fcec289a64d19bc4e1a75022aabd4&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:21:45.246304 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc7c67-2a98-432c-988c-3f50b549cc34 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:45.296869 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 443/889] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:21:45 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:21:45.322280 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b063a08-8bd5-4301-bee4-7e9149d0c7cd None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:45.359030 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:45.368080 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc7c67-2a98-432c-988c-3f50b549cc34 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:45.412911 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204df0b2-b525-4630-9f2e-17df09826d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:45.413529 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204df0b2-b525-4630-9f2e-17df09826d82 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:45.413783 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204df0b2-b525-4630-9f2e-17df09826d82 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:45.414057 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204df0b2-b525-4630-9f2e-17df09826d82 None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:45.414753 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204df0b2-b525-4630-9f2e-17df09826d82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:45.416130 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204df0b2-b525-4630-9f2e-17df09826d82 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:45.423349 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 447/890] 10.222.0.16 () {56 vars in 1087 bytes} [Thu May 26 12:21:45 2022] GET /identity/v3/services => generated 1268 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:21:45.460460 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b063a08-8bd5-4301-bee4-7e9149d0c7cd None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:45.481560 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:45.504775 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1618b6d-90d6-4975-890b-e902759e6bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:45.506067 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1618b6d-90d6-4975-890b-e902759e6bfa None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:45.506564 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1618b6d-90d6-4975-890b-e902759e6bfa None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:45.507058 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1618b6d-90d6-4975-890b-e902759e6bfa None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:45.520244 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1618b6d-90d6-4975-890b-e902759e6bfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:21:45.529221 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-b1618b6d-90d6-4975-890b-e902759e6bfa None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 12:21:45.529221 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:45.529221 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:45.529221 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:45.529221 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:45.529221 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:45.529221 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:45.529221 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:45.529221 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:45.529221 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:45.529221 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:45.529221 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:45.529221 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:21:45.529221 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:21:45.529221 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:21:45.529221 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:21:45.530268 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:21:45.530268 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:21:45.530268 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:21:45.530268 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:21:45.530268 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:45.530268 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:45.530268 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:45.530268 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:45.530268 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:45.530268 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:45.530268 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:45.530268 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:45.530268 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:45.530268 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:45.530268 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:45.530268 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:45.531113 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:45.531113 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:45.531113 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:45.531113 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:45.531113 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:21:45.531113 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:21:45.531113 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:21:45.531113 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:21:45.531113 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:21:45.531113 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:21:45.531113 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 12:21:45.531113 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:45.534392 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 444/891] 10.222.0.16 () {56 vars in 1120 bytes} [Thu May 26 12:21:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:21:45.540694 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204df0b2-b525-4630-9f2e-17df09826d82 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:45.656728 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204df0b2-b525-4630-9f2e-17df09826d82 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:45.705387 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e10f16-bf0b-4840-a300-368d1346369a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:45.706321 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e10f16-bf0b-4840-a300-368d1346369a None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:45.706763 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e10f16-bf0b-4840-a300-368d1346369a None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:45.707214 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e10f16-bf0b-4840-a300-368d1346369a None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:45.708130 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e10f16-bf0b-4840-a300-368d1346369a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:45.708590 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e10f16-bf0b-4840-a300-368d1346369a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:45.710228 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e10f16-bf0b-4840-a300-368d1346369a None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:45.721052 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 448/892] 10.222.0.16 () {56 vars in 1115 bytes} [Thu May 26 12:21:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:45.729700 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1618b6d-90d6-4975-890b-e902759e6bfa None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:45.852967 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1618b6d-90d6-4975-890b-e902759e6bfa None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:45.887862 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649f4e8c-96a5-405b-9f90-df82f15db89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:45.889082 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f4e8c-96a5-405b-9f90-df82f15db89a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:45.889610 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f4e8c-96a5-405b-9f90-df82f15db89a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:45.890064 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f4e8c-96a5-405b-9f90-df82f15db89a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:45.901391 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649f4e8c-96a5-405b-9f90-df82f15db89a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:45.903113 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649f4e8c-96a5-405b-9f90-df82f15db89a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:45.921005 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-649f4e8c-96a5-405b-9f90-df82f15db89a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:45.921005 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:45.921005 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:45.921005 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:45.921005 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:45.921005 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:45.921005 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:45.921005 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:45.921005 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:45.921005 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:45.921005 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:45.921005 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:45.921005 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:21:45.921005 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:21:45.921005 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:21:45.921959 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:21:45.921959 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:45.921959 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:45.921959 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:45.921959 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:45.921959 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:45.921959 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:45.921959 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:45.921959 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:45.921959 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:45.921959 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:45.921959 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:45.921959 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:45.921959 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:45.921959 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:45.921959 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:45.921959 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:45.923488 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:21:45.923488 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:21:45.923488 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:45.923488 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:45.925491 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 445/893] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:21:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:45.931187 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e10f16-bf0b-4840-a300-368d1346369a None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:45.957695 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:46.045907 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e10f16-bf0b-4840-a300-368d1346369a None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:46.082692 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f550e-e044-40c2-b0a1-de8762e29605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:46.083654 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f550e-e044-40c2-b0a1-de8762e29605 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:46.084102 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f550e-e044-40c2-b0a1-de8762e29605 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:46.084531 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f550e-e044-40c2-b0a1-de8762e29605 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:46.085459 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4f550e-e044-40c2-b0a1-de8762e29605 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:46.085908 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4f550e-e044-40c2-b0a1-de8762e29605 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:46.087437 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4f550e-e044-40c2-b0a1-de8762e29605 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:46.098204 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baed7df-a878-4c1e-8dd4-70f4cdd2ec41 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:46.098487 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baed7df-a878-4c1e-8dd4-70f4cdd2ec41 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:46.098769 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baed7df-a878-4c1e-8dd4-70f4cdd2ec41 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:46.100340 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 446/894] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:21:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:21:46.106657 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33e3e8-02af-41e8-868b-3728ac68c111 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:46.106941 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33e3e8-02af-41e8-868b-3728ac68c111 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:46.107218 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33e3e8-02af-41e8-868b-3728ac68c111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:46.112678 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 449/895] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:21:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:46.114237 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f550e-e044-40c2-b0a1-de8762e29605 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:46.129190 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-bc33e3e8-02af-41e8-868b-3728ac68c111 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:21:46.130677 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-bc33e3e8-02af-41e8-868b-3728ac68c111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:21:46.165332 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:46.207558 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 447/896] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:21:46 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:21:46.219008 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:46.235321 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc33e3e8-02af-41e8-868b-3728ac68c111 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:46.269994 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f550e-e044-40c2-b0a1-de8762e29605 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:46.329885 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a44294-0cc5-4290-ba15-0dd6db0a483a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:46.334878 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a44294-0cc5-4290-ba15-0dd6db0a483a None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:46.334878 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a44294-0cc5-4290-ba15-0dd6db0a483a None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:46.334878 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a44294-0cc5-4290-ba15-0dd6db0a483a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:46.341209 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a44294-0cc5-4290-ba15-0dd6db0a483a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:46.342816 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a44294-0cc5-4290-ba15-0dd6db0a483a None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:46.362525 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-73a44294-0cc5-4290-ba15-0dd6db0a483a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 12:21:46.362525 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:46.362525 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:46.362525 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:46.362525 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:46.362525 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:46.362525 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:46.362525 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:46.362525 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:46.362525 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:46.362525 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:46.362525 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:46.362525 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:21:46.362525 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:21:46.362525 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:21:46.362525 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:21:46.363697 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:46.363697 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:46.363697 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:21:46.363697 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:21:46.363697 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:21:46.363697 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:21:46.363697 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:46.363697 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:46.363697 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:46.363697 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:46.363697 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:46.363697 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:46.363697 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:46.363697 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:46.363697 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:46.363697 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:46.363697 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:46.363697 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:46.364899 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:46.364899 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:46.364899 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:21:46.364899 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:21:46.364899 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:21:46.364899 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:21:46.364899 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:21:46.364899 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:21:46.364899 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 12:21:46.364899 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:46.369002 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 450/897] 10.222.0.16 () {56 vars in 1117 bytes} [Thu May 26 12:21:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:21:46.375079 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a44294-0cc5-4290-ba15-0dd6db0a483a None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:46.405111 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc33e3e8-02af-41e8-868b-3728ac68c111 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:46.456536 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2ddb1d-47b6-4bc2-a45f-2d04291de036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:46.457706 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ddb1d-47b6-4bc2-a45f-2d04291de036 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:46.458134 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ddb1d-47b6-4bc2-a45f-2d04291de036 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:46.459056 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ddb1d-47b6-4bc2-a45f-2d04291de036 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:46.460229 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2ddb1d-47b6-4bc2-a45f-2d04291de036 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:46.461929 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2ddb1d-47b6-4bc2-a45f-2d04291de036 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:46.478249 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-cd2ddb1d-47b6-4bc2-a45f-2d04291de036 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 12:21:46.478249 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:46.478249 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:21:46.478249 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:21:46.478249 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:21:46.478249 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:21:46.478249 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:21:46.478249 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:21:46.478249 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 12:21:46.478249 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:46.478249 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:21:46.478249 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:46.478249 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:46.478249 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:46.478249 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:46.478249 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:46.479625 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:46.479625 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:46.479625 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:46.479625 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:46.479625 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:46.479625 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:46.479625 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:46.479625 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:21:46.479625 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:21:46.479625 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:21:46.479625 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:21:46.479625 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:46.479625 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:46.479625 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:46.479625 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:46.479625 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:46.480721 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:46.480721 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:46.480721 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:46.480721 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:46.480721 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:46.480721 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:46.480721 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:46.480721 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:46.480721 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:46.480721 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:46.480721 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:46.480721 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:21:46.480721 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:21:46.480721 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 12:21:46.480721 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:46.487431 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 448/898] 10.222.0.16 () {56 vars in 1132 bytes} [Thu May 26 12:21:46 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:46.489697 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2ddb1d-47b6-4bc2-a45f-2d04291de036 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:46.525222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:46.527333 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a44294-0cc5-4290-ba15-0dd6db0a483a None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:46.576072 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b167e92b-2868-4bd8-9238-b24e14ba0cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:46.577153 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167e92b-2868-4bd8-9238-b24e14ba0cbc None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:46.577604 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167e92b-2868-4bd8-9238-b24e14ba0cbc None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:46.578267 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167e92b-2868-4bd8-9238-b24e14ba0cbc None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:46.580698 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b167e92b-2868-4bd8-9238-b24e14ba0cbc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:46.581192 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b167e92b-2868-4bd8-9238-b24e14ba0cbc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:46.582776 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b167e92b-2868-4bd8-9238-b24e14ba0cbc None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:46.594671 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:46.611907 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 451/899] 10.222.0.16 () {56 vars in 1149 bytes} [Thu May 26 12:21:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:46.613086 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b167e92b-2868-4bd8-9238-b24e14ba0cbc None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:46.616181 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2ddb1d-47b6-4bc2-a45f-2d04291de036 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:46.673330 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda618e-e7dd-4ae2-b70b-f719be676881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:46.674068 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda618e-e7dd-4ae2-b70b-f719be676881 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:46.674278 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda618e-e7dd-4ae2-b70b-f719be676881 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:46.674563 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda618e-e7dd-4ae2-b70b-f719be676881 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:46.675247 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda618e-e7dd-4ae2-b70b-f719be676881 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:46.675550 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda618e-e7dd-4ae2-b70b-f719be676881 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:46.676951 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda618e-e7dd-4ae2-b70b-f719be676881 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:46.684870 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 449/900] 10.222.0.16 () {56 vars in 1126 bytes} [Thu May 26 12:21:46 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:46.690969 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda618e-e7dd-4ae2-b70b-f719be676881 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:46.743013 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b167e92b-2868-4bd8-9238-b24e14ba0cbc None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:46.787259 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9baf0c6-7d6d-4f89-9e0a-d6995a0f5fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:46.788140 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9baf0c6-7d6d-4f89-9e0a-d6995a0f5fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:46.788589 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9baf0c6-7d6d-4f89-9e0a-d6995a0f5fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:46.789043 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9baf0c6-7d6d-4f89-9e0a-d6995a0f5fc6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:46.807747 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:46.822310 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda618e-e7dd-4ae2-b70b-f719be676881 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:46.859260 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f449c4-8ec6-4b66-be1c-cb87bd4193e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:46.860092 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:46.861670 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f449c4-8ec6-4b66-be1c-cb87bd4193e8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:46.862336 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f449c4-8ec6-4b66-be1c-cb87bd4193e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:46.862992 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f449c4-8ec6-4b66-be1c-cb87bd4193e8 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:46.863717 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f449c4-8ec6-4b66-be1c-cb87bd4193e8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:46.864158 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f449c4-8ec6-4b66-be1c-cb87bd4193e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:46.865314 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9baf0c6-7d6d-4f89-9e0a-d6995a0f5fc6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:46.867285 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9baf0c6-7d6d-4f89-9e0a-d6995a0f5fc6 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:46.867525 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f449c4-8ec6-4b66-be1c-cb87bd4193e8 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:46.874793 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 450/901] 10.222.0.16 () {56 vars in 1126 bytes} [Thu May 26 12:21:46 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:46.880724 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f449c4-8ec6-4b66-be1c-cb87bd4193e8 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:46.982301 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 452/902] 10.222.0.16 () {58 vars in 1282 bytes} [Thu May 26 12:21:46 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:21:46.990022 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9baf0c6-7d6d-4f89-9e0a-d6995a0f5fc6 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:47.023814 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f449c4-8ec6-4b66-be1c-cb87bd4193e8 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:47.074818 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c92477-f683-4c37-863a-226f20400987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:47.075734 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c92477-f683-4c37-863a-226f20400987 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:47.076406 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c92477-f683-4c37-863a-226f20400987 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:47.077319 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c92477-f683-4c37-863a-226f20400987 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:47.078575 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c92477-f683-4c37-863a-226f20400987 None admin] RBAC: Adding query filter params (interface=public, service_id=b31f5ef08fc9425681b10bf604ccc29a, region_id=RegionOne) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:47.079081 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c92477-f683-4c37-863a-226f20400987 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:47.081284 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c92477-f683-4c37-863a-226f20400987 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:47.093352 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 451/903] 10.222.0.16 () {56 vars in 1251 bytes} [Thu May 26 12:21:46 2022] GET /identity/v3/endpoints?service_id=b31f5ef08fc9425681b10bf604ccc29a&interface=public®ion_id=RegionOne => generated 194 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:21:47.095751 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c92477-f683-4c37-863a-226f20400987 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:47.098237 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:47.103914 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9baf0c6-7d6d-4f89-9e0a-d6995a0f5fc6 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:47.115792 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:47.154875 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b58c9-0680-44d0-a2e9-104e02d88bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:47.156650 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b58c9-0680-44d0-a2e9-104e02d88bef None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:47.157812 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b58c9-0680-44d0-a2e9-104e02d88bef None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:47.158345 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b58c9-0680-44d0-a2e9-104e02d88bef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:47.174886 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b58c9-0680-44d0-a2e9-104e02d88bef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:47.177900 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b58c9-0680-44d0-a2e9-104e02d88bef None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:47.203211 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c92477-f683-4c37-863a-226f20400987 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:47.203757 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-836b58c9-0680-44d0-a2e9-104e02d88bef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:47.203757 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:47.203757 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:47.203757 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:47.203757 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:47.203757 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:47.203757 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:47.203757 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:47.203757 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:47.203757 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:47.203757 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:47.203757 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:47.203757 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:21:47.203757 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:21:47.203757 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:21:47.204865 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:21:47.204865 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:47.204865 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:47.204865 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:47.204865 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:47.204865 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:47.204865 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:47.204865 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:47.204865 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:47.204865 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:47.204865 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:47.204865 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:47.204865 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:47.204865 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:47.204865 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:47.204865 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:47.204865 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:47.206001 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:21:47.206001 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:21:47.206001 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:47.206001 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:47.209033 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 453/904] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:21:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:47.214389 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b58c9-0680-44d0-a2e9-104e02d88bef None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:47.256088 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c9344-194e-4078-82b6-7aae5a69ced4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:47.257687 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c9344-194e-4078-82b6-7aae5a69ced4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:47.258185 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c9344-194e-4078-82b6-7aae5a69ced4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:47.258682 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c9344-194e-4078-82b6-7aae5a69ced4 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:47.260121 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56c9344-194e-4078-82b6-7aae5a69ced4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:47.262195 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56c9344-194e-4078-82b6-7aae5a69ced4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:47.268875 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 452/905] 10.222.0.16 () {56 vars in 1087 bytes} [Thu May 26 12:21:47 2022] GET /identity/v3/services => generated 1268 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:21:47.334716 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b58c9-0680-44d0-a2e9-104e02d88bef None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:47.380006 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddef385-d1eb-4ce3-adf7-70a1a2deae86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:47.380682 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddef385-d1eb-4ce3-adf7-70a1a2deae86 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:47.380997 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddef385-d1eb-4ce3-adf7-70a1a2deae86 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:47.381276 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddef385-d1eb-4ce3-adf7-70a1a2deae86 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:47.382013 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddef385-d1eb-4ce3-adf7-70a1a2deae86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:47.382321 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddef385-d1eb-4ce3-adf7-70a1a2deae86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:47.383709 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddef385-d1eb-4ce3-adf7-70a1a2deae86 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:47.397651 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 454/906] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:21:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:21:47.403403 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c9344-194e-4078-82b6-7aae5a69ced4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:47.497058 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:47.518903 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c9344-194e-4078-82b6-7aae5a69ced4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:47.548597 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ae420-1d3f-4bf1-b4dc-692931f79e50 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:47.549208 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ae420-1d3f-4bf1-b4dc-692931f79e50 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:47.549208 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ae420-1d3f-4bf1-b4dc-692931f79e50 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:47.550859 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 455/907] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:21:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:21:47.556535 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b824f4-6149-4b01-b566-8af7d1e091ee None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:47.556891 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b824f4-6149-4b01-b566-8af7d1e091ee None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:47.557126 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b824f4-6149-4b01-b566-8af7d1e091ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:47.559915 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7cc73e-4282-4449-874c-6054cb264c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:47.560920 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cc73e-4282-4449-874c-6054cb264c13 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:47.561250 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cc73e-4282-4449-874c-6054cb264c13 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:47.561538 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cc73e-4282-4449-874c-6054cb264c13 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:47.571868 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7cc73e-4282-4449-874c-6054cb264c13 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:47.573390 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7cc73e-4282-4449-874c-6054cb264c13 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:47.575017 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-b6b824f4-6149-4b01-b566-8af7d1e091ee None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:21:47.576221 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-b6b824f4-6149-4b01-b566-8af7d1e091ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:21:47.581266 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:47.594427 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-9e7cc73e-4282-4449-874c-6054cb264c13 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:21:47.594427 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:47.594427 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:47.594427 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:47.594427 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:47.594427 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:47.594427 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:47.594427 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:47.594427 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:47.594427 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:47.594427 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:47.594427 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:47.594427 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:21:47.594427 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:21:47.594427 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:21:47.595932 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:21:47.595932 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:47.595932 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:47.595932 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:47.595932 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:47.595932 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:47.595932 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:47.595932 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:47.595932 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:47.595932 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:47.595932 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:47.595932 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:47.595932 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:47.595932 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:47.595932 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:47.595932 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:47.595932 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:47.596905 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:21:47.596905 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:21:47.596905 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:21:47.596905 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:21:47.596905 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:21:47.596905 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:21:47.596905 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:21:47.596905 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:47.599379 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 453/908] 10.222.0.16 () {56 vars in 1111 bytes} [Thu May 26 12:21:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:47.605800 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7cc73e-4282-4449-874c-6054cb264c13 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:47.655634 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 456/909] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:21:47 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:21:47.678423 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b824f4-6149-4b01-b566-8af7d1e091ee None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:47.718107 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7cc73e-4282-4449-874c-6054cb264c13 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:47.768496 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034853e9-a138-4c5b-867f-0ba8916055cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:47.769227 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034853e9-a138-4c5b-867f-0ba8916055cb None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:47.769530 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034853e9-a138-4c5b-867f-0ba8916055cb None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:47.769806 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034853e9-a138-4c5b-867f-0ba8916055cb None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:47.771024 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034853e9-a138-4c5b-867f-0ba8916055cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:47.771340 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034853e9-a138-4c5b-867f-0ba8916055cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:47.773237 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034853e9-a138-4c5b-867f-0ba8916055cb None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:47.785400 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:47.792989 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 454/910] 10.222.0.16 () {56 vars in 1148 bytes} [Thu May 26 12:21:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:47.794534 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34957e-72ec-4d71-8552-138373fd1cb1 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:47.794822 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34957e-72ec-4d71-8552-138373fd1cb1 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:47.795099 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34957e-72ec-4d71-8552-138373fd1cb1 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:47.801144 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 455/911] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:21:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:21:47.801144 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34957e-72ec-4d71-8552-138373fd1cb1 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:47.801339 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b824f4-6149-4b01-b566-8af7d1e091ee None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:47.840861 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeacfd9-ae5e-45cb-8e2b-07384a67de69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:47.841537 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeacfd9-ae5e-45cb-8e2b-07384a67de69 None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:47.841820 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeacfd9-ae5e-45cb-8e2b-07384a67de69 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:47.842093 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeacfd9-ae5e-45cb-8e2b-07384a67de69 None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:47.842922 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeacfd9-ae5e-45cb-8e2b-07384a67de69 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:47.844961 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeacfd9-ae5e-45cb-8e2b-07384a67de69 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:47.854369 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:47.869970 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 457/912] 10.222.0.16 () {60 vars in 1141 bytes} [Thu May 26 12:21:47 2022] POST /identity/v3/services => generated 241 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:21:47.871501 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c81dc2-78e3-4e6a-98ea-a339d8016768 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:47.872210 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c81dc2-78e3-4e6a-98ea-a339d8016768 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:47.872617 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c81dc2-78e3-4e6a-98ea-a339d8016768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:47.898038 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-45c81dc2-78e3-4e6a-98ea-a339d8016768 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:21:47.900243 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-45c81dc2-78e3-4e6a-98ea-a339d8016768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:21:47.932792 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34957e-72ec-4d71-8552-138373fd1cb1 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:47.976962 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1502c653-77c4-45bb-b2c8-05b157ccbeea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:47.977764 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502c653-77c4-45bb-b2c8-05b157ccbeea None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:47.978102 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502c653-77c4-45bb-b2c8-05b157ccbeea None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:47.978421 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502c653-77c4-45bb-b2c8-05b157ccbeea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:47.979587 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1502c653-77c4-45bb-b2c8-05b157ccbeea None admin] RBAC: Adding query filter params (role.id=d2c069ef8eed4c73a7fa3aa932c60945, scope.project.id=42e6c693bd224d92b8a0fe4ad0cc586d, user.id=512b4337083145f9ae57948a63444ced) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:47.980060 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1502c653-77c4-45bb-b2c8-05b157ccbeea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:47.981700 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1502c653-77c4-45bb-b2c8-05b157ccbeea None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:47.989045 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 456/913] 10.222.0.16 () {56 vars in 1374 bytes} [Thu May 26 12:21:47 2022] GET /identity/v3/role_assignments?user.id=512b4337083145f9ae57948a63444ced&scope.project.id=42e6c693bd224d92b8a0fe4ad0cc586d&role.id=d2c069ef8eed4c73a7fa3aa932c60945 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:47.991743 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 458/914] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:21:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:21:48.017328 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1502c653-77c4-45bb-b2c8-05b157ccbeea None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:48.096451 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:48.143854 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1502c653-77c4-45bb-b2c8-05b157ccbeea None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:48.182392 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba5c39f-c0c9-4822-bfd5-053debe7355d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:48.183185 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5c39f-c0c9-4822-bfd5-053debe7355d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:48.183466 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5c39f-c0c9-4822-bfd5-053debe7355d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:48.183735 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5c39f-c0c9-4822-bfd5-053debe7355d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:48.184382 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba5c39f-c0c9-4822-bfd5-053debe7355d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:48.185788 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba5c39f-c0c9-4822-bfd5-053debe7355d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:48.199022 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-6ba5c39f-c0c9-4822-bfd5-053debe7355d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 12:21:48.199022 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:48.199022 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:21:48.199022 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:21:48.199022 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:21:48.199022 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:21:48.199022 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:21:48.199022 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:21:48.199022 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 12:21:48.199022 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:48.199022 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:21:48.199022 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:48.199022 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:48.199022 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:48.199022 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:48.199022 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:48.199022 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:48.200053 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:48.200053 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:48.200053 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:48.200053 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:48.200053 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:48.200053 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:48.200053 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:21:48.200053 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:21:48.200053 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:21:48.200053 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:21:48.200053 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:48.200053 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:48.200053 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:48.200053 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:48.200053 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:48.200053 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:48.201014 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:48.201014 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:48.201014 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:48.201014 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:48.201014 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:48.201014 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:48.201014 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:48.201014 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:48.201014 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:48.201014 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:48.201014 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:21:48.201014 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:21:48.201014 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 12:21:48.201014 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:48.201014 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 457/915] 10.222.0.16 () {56 vars in 1114 bytes} [Thu May 26 12:21:48 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:48.206443 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c81dc2-78e3-4e6a-98ea-a339d8016768 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:48.308498 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c81dc2-78e3-4e6a-98ea-a339d8016768 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:48.343228 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:48.350152 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64939f-9ce1-44c4-a607-db6b506602c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:48.350875 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64939f-9ce1-44c4-a607-db6b506602c8 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:48.351249 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64939f-9ce1-44c4-a607-db6b506602c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:48.351527 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64939f-9ce1-44c4-a607-db6b506602c8 None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:48.352237 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b64939f-9ce1-44c4-a607-db6b506602c8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:48.352536 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b64939f-9ce1-44c4-a607-db6b506602c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:48.353944 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b64939f-9ce1-44c4-a607-db6b506602c8 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:48.359321 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 459/916] 10.222.0.16 () {56 vars in 1114 bytes} [Thu May 26 12:21:48 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:48.365205 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba5c39f-c0c9-4822-bfd5-053debe7355d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:48.469083 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba5c39f-c0c9-4822-bfd5-053debe7355d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:48.498971 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:48.512018 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e3fedb-53bd-4a9b-a7eb-d8c89f2d47c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:48.512684 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3fedb-53bd-4a9b-a7eb-d8c89f2d47c2 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:48.512998 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3fedb-53bd-4a9b-a7eb-d8c89f2d47c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:48.513270 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3fedb-53bd-4a9b-a7eb-d8c89f2d47c2 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:48.513985 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e3fedb-53bd-4a9b-a7eb-d8c89f2d47c2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:48.514291 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e3fedb-53bd-4a9b-a7eb-d8c89f2d47c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:48.515668 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e3fedb-53bd-4a9b-a7eb-d8c89f2d47c2 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:48.521109 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 458/917] 10.222.0.16 () {56 vars in 1114 bytes} [Thu May 26 12:21:48 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:48.527598 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64939f-9ce1-44c4-a607-db6b506602c8 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:48.636574 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64939f-9ce1-44c4-a607-db6b506602c8 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:48.671350 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecdd583-ff9c-4f4c-adba-4ad35e16d3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:48.671996 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecdd583-ff9c-4f4c-adba-4ad35e16d3a1 None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:48.672274 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecdd583-ff9c-4f4c-adba-4ad35e16d3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:48.672551 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecdd583-ff9c-4f4c-adba-4ad35e16d3a1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:48.673936 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecdd583-ff9c-4f4c-adba-4ad35e16d3a1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:48.675289 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecdd583-ff9c-4f4c-adba-4ad35e16d3a1 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:48.696133 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 460/918] 10.222.0.16 () {60 vars in 1144 bytes} [Thu May 26 12:21:48 2022] POST /identity/v3/endpoints => generated 346 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:21:49.587434 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f7206-ebdb-4bfb-8501-046d5e93a13f None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:49.587960 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f7206-ebdb-4bfb-8501-046d5e93a13f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:49.587960 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f7206-ebdb-4bfb-8501-046d5e93a13f None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:49.589624 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 459/919] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:21:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:21:49.595328 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f64839-d481-4f5b-b115-5592a6911358 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:49.595616 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f64839-d481-4f5b-b115-5592a6911358 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:49.595891 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f64839-d481-4f5b-b115-5592a6911358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:49.613443 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-d9f64839-d481-4f5b-b115-5592a6911358 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:21:49.614614 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-d9f64839-d481-4f5b-b115-5592a6911358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:21:49.663661 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:49.693054 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 461/920] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:21:49 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:21:49.715784 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f7206-ebdb-4bfb-8501-046d5e93a13f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:49.833513 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f7206-ebdb-4bfb-8501-046d5e93a13f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:49.871481 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3629260-35b9-4315-82ad-3ee4bce8b849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:49.872593 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3629260-35b9-4315-82ad-3ee4bce8b849 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:49.873093 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3629260-35b9-4315-82ad-3ee4bce8b849 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:49.873509 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3629260-35b9-4315-82ad-3ee4bce8b849 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:49.874306 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3629260-35b9-4315-82ad-3ee4bce8b849 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:49.875917 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3629260-35b9-4315-82ad-3ee4bce8b849 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:49.889319 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-a3629260-35b9-4315-82ad-3ee4bce8b849 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 12:21:49.889319 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:49.889319 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:21:49.889319 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:21:49.889319 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:21:49.889319 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:21:49.889319 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:21:49.889319 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:21:49.889319 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 12:21:49.889319 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:49.889319 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:21:49.889319 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:49.889319 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:49.889319 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:49.889319 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:49.889319 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:49.890471 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:49.890471 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:49.890471 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:49.890471 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:49.890471 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:49.890471 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:49.890471 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:49.890471 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:21:49.890471 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:21:49.890471 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:21:49.890471 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:21:49.890471 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:49.890471 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:49.890471 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:49.890471 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:49.890471 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:49.891498 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:49.891498 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:49.891498 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:49.891498 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:49.891498 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:49.891498 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:49.891498 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:49.891498 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:49.891498 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:49.891498 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:49.891498 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:49.891498 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:21:49.891498 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:21:49.891498 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 12:21:49.891498 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:49.894038 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 460/921] 10.222.0.16 () {56 vars in 1132 bytes} [Thu May 26 12:21:49 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:49.904886 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f64839-d481-4f5b-b115-5592a6911358 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:50.001973 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f64839-d481-4f5b-b115-5592a6911358 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:50.035487 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8456dea-a44c-4aaa-91d0-1eaafe0992af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:50.036369 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8456dea-a44c-4aaa-91d0-1eaafe0992af None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:50.036826 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8456dea-a44c-4aaa-91d0-1eaafe0992af None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:50.037293 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8456dea-a44c-4aaa-91d0-1eaafe0992af None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:50.038189 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8456dea-a44c-4aaa-91d0-1eaafe0992af None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:50.038636 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8456dea-a44c-4aaa-91d0-1eaafe0992af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:50.040144 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8456dea-a44c-4aaa-91d0-1eaafe0992af None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:50.045496 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 462/922] 10.222.0.16 () {56 vars in 1126 bytes} [Thu May 26 12:21:49 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:50.054040 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3629260-35b9-4315-82ad-3ee4bce8b849 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:50.125294 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:50.168037 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3629260-35b9-4315-82ad-3ee4bce8b849 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:50.202635 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de588ab-cc00-43a6-8023-3f596974ac7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:50.203292 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de588ab-cc00-43a6-8023-3f596974ac7c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:50.203574 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de588ab-cc00-43a6-8023-3f596974ac7c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:50.203848 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de588ab-cc00-43a6-8023-3f596974ac7c None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:50.204588 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de588ab-cc00-43a6-8023-3f596974ac7c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:50.204958 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de588ab-cc00-43a6-8023-3f596974ac7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:50.206561 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de588ab-cc00-43a6-8023-3f596974ac7c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:50.211680 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 461/923] 10.222.0.16 () {56 vars in 1126 bytes} [Thu May 26 12:21:50 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:50.217710 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8456dea-a44c-4aaa-91d0-1eaafe0992af None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:50.261392 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:50.291969 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4444315-15bc-4470-a588-f28ecd76a441 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:50.292634 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4444315-15bc-4470-a588-f28ecd76a441 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:50.293162 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4444315-15bc-4470-a588-f28ecd76a441 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:50.294940 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 462/924] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:21:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:21:50.296385 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090cc412-b001-41ae-912b-9e850d27add2 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:50.296920 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090cc412-b001-41ae-912b-9e850d27add2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:50.297403 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090cc412-b001-41ae-912b-9e850d27add2 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:50.299800 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 463/925] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:21:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:21:50.303077 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b72c06-cfe9-471e-85c9-24ba44e30db1 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:50.303809 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b72c06-cfe9-471e-85c9-24ba44e30db1 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:50.304093 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b72c06-cfe9-471e-85c9-24ba44e30db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:50.321229 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-47b72c06-cfe9-471e-85c9-24ba44e30db1 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:21:50.322408 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-47b72c06-cfe9-471e-85c9-24ba44e30db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:21:50.326047 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8456dea-a44c-4aaa-91d0-1eaafe0992af None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:50.369918 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1493b6a7-f80b-4e4c-b95a-b2dac93e079e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:50.370861 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493b6a7-f80b-4e4c-b95a-b2dac93e079e None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:50.371151 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493b6a7-f80b-4e4c-b95a-b2dac93e079e None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:50.371430 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493b6a7-f80b-4e4c-b95a-b2dac93e079e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:50.372184 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1493b6a7-f80b-4e4c-b95a-b2dac93e079e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:50.373574 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1493b6a7-f80b-4e4c-b95a-b2dac93e079e None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:50.400946 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 464/926] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:21:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:21:50.401137 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 463/927] 10.222.0.16 () {60 vars in 1144 bytes} [Thu May 26 12:21:50 2022] POST /identity/v3/endpoints => generated 347 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:21:50.401253 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac0fe0-cd82-4a1a-a28c-9b1dd4469a43 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:50.401253 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac0fe0-cd82-4a1a-a28c-9b1dd4469a43 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:50.401253 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac0fe0-cd82-4a1a-a28c-9b1dd4469a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:50.423648 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1493b6a7-f80b-4e4c-b95a-b2dac93e079e None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:50.423997 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-3fac0fe0-cd82-4a1a-a28c-9b1dd4469a43 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:21:50.425263 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3fac0fe0-cd82-4a1a-a28c-9b1dd4469a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:21:50.492225 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:50.536393 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 465/928] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:21:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:21:50.563335 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac0fe0-cd82-4a1a-a28c-9b1dd4469a43 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:50.564014 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:50.574215 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1493b6a7-f80b-4e4c-b95a-b2dac93e079e None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:50.626276 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf318ad-9b1c-491e-8cc2-693cad321aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:50.628128 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf318ad-9b1c-491e-8cc2-693cad321aaa None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:50.628732 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf318ad-9b1c-491e-8cc2-693cad321aaa None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:50.630308 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf318ad-9b1c-491e-8cc2-693cad321aaa None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:50.645749 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf318ad-9b1c-491e-8cc2-693cad321aaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:21:50.656467 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-ddf318ad-9b1c-491e-8cc2-693cad321aaa None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 12:21:50.656467 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:50.656467 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:50.656467 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:50.656467 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:50.656467 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:50.656467 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:50.656467 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:50.656467 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:50.656467 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:50.656467 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:50.656467 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:50.656467 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:21:50.656467 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:21:50.656467 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:21:50.656467 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:21:50.658130 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:21:50.658130 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:21:50.658130 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:21:50.658130 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:21:50.658130 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:50.658130 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:50.658130 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:50.658130 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:50.658130 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:50.658130 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:50.658130 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:50.658130 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:50.658130 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:50.658130 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:50.658130 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:50.658130 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:50.659004 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:50.659004 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:50.659004 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:50.659004 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:50.659004 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:21:50.659004 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:21:50.659004 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:21:50.659004 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:21:50.659004 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:21:50.659004 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:21:50.659004 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 12:21:50.659004 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:50.659004 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 464/929] 10.222.0.16 () {56 vars in 1120 bytes} [Thu May 26 12:21:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:21:50.662425 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf318ad-9b1c-491e-8cc2-693cad321aaa None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:50.700088 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac0fe0-cd82-4a1a-a28c-9b1dd4469a43 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:50.736502 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d48a11-d3f7-4901-aa00-b315cc527552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:50.737591 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d48a11-d3f7-4901-aa00-b315cc527552 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:50.737730 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d48a11-d3f7-4901-aa00-b315cc527552 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:50.737917 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d48a11-d3f7-4901-aa00-b315cc527552 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:50.738569 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d48a11-d3f7-4901-aa00-b315cc527552 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:50.740001 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d48a11-d3f7-4901-aa00-b315cc527552 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:50.752584 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-d7d48a11-d3f7-4901-aa00-b315cc527552 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:21:50.752584 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:50.752584 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:21:50.752584 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:21:50.752584 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:21:50.752584 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:21:50.752584 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:21:50.752584 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:21:50.752584 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:21:50.752584 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:50.752584 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:21:50.752584 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:50.752584 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:50.752584 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:50.752584 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:50.752584 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:50.752584 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:50.753659 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:50.753659 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:50.753659 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:50.753659 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:50.753659 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:50.753659 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:50.753659 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:21:50.753659 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:21:50.753659 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:21:50.753659 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:21:50.753659 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:50.753659 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:50.753659 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:50.753659 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:50.753659 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:50.753659 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:50.754511 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:50.754511 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:50.754511 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:50.754511 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:50.754511 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:50.754511 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:50.754511 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:50.754511 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:50.754511 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:50.754511 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:50.754511 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:21:50.754511 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:21:50.754511 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:21:50.754511 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:50.758937 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 466/930] 10.222.0.16 () {56 vars in 1126 bytes} [Thu May 26 12:21:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:21:50.759858 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d48a11-d3f7-4901-aa00-b315cc527552 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:50.799035 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:50.802359 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf318ad-9b1c-491e-8cc2-693cad321aaa None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:50.844427 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddcc226-07e6-4fe6-ab37-17d6cc6c631f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:50.845542 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddcc226-07e6-4fe6-ab37-17d6cc6c631f None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:50.846053 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddcc226-07e6-4fe6-ab37-17d6cc6c631f None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:50.846535 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddcc226-07e6-4fe6-ab37-17d6cc6c631f None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:50.847526 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddcc226-07e6-4fe6-ab37-17d6cc6c631f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:50.848037 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddcc226-07e6-4fe6-ab37-17d6cc6c631f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:50.849645 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddcc226-07e6-4fe6-ab37-17d6cc6c631f None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:50.863473 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 465/931] 10.222.0.16 () {56 vars in 1115 bytes} [Thu May 26 12:21:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:21:50.864666 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddcc226-07e6-4fe6-ab37-17d6cc6c631f None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:50.872003 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d48a11-d3f7-4901-aa00-b315cc527552 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:50.885534 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:50.910700 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae015e48-7b22-42b6-b50f-bae1f5c7c89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:50.911286 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae015e48-7b22-42b6-b50f-bae1f5c7c89c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:50.911565 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae015e48-7b22-42b6-b50f-bae1f5c7c89c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:50.911839 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae015e48-7b22-42b6-b50f-bae1f5c7c89c None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:50.912649 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae015e48-7b22-42b6-b50f-bae1f5c7c89c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:50.913000 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae015e48-7b22-42b6-b50f-bae1f5c7c89c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:50.914530 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae015e48-7b22-42b6-b50f-bae1f5c7c89c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:50.924679 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 467/932] 10.222.0.16 () {56 vars in 1122 bytes} [Thu May 26 12:21:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:50.925594 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae015e48-7b22-42b6-b50f-bae1f5c7c89c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:50.977770 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddcc226-07e6-4fe6-ab37-17d6cc6c631f None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:51.013184 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85729ac-b4fb-4496-8a0f-3d0479482cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:51.013975 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85729ac-b4fb-4496-8a0f-3d0479482cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:51.014259 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85729ac-b4fb-4496-8a0f-3d0479482cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:51.014532 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85729ac-b4fb-4496-8a0f-3d0479482cd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:51.026558 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85729ac-b4fb-4496-8a0f-3d0479482cd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:51.028011 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85729ac-b4fb-4496-8a0f-3d0479482cd7 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:51.033419 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:51.036650 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae015e48-7b22-42b6-b50f-bae1f5c7c89c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:51.047541 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-b85729ac-b4fb-4496-8a0f-3d0479482cd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:51.047541 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:51.047541 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:51.047541 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:51.047541 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:51.047541 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:51.047541 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:51.047541 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:51.047541 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:51.047541 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:51.047541 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:51.047541 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:51.047541 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:21:51.047541 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:21:51.047541 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:21:51.048551 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:21:51.048551 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:51.048551 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:51.048551 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:51.048551 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:51.048551 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:51.048551 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:51.048551 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:51.048551 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:51.048551 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:51.048551 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:51.048551 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:51.048551 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:51.048551 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:51.048551 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:51.048551 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:51.048551 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:51.053127 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:21:51.053127 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:21:51.053127 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:51.053127 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:51.053127 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 466/933] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:21:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:51.053127 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8df49-e43a-4419-bf81-df37565916d5 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:51.053127 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8df49-e43a-4419-bf81-df37565916d5 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:51.053127 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8df49-e43a-4419-bf81-df37565916d5 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:51.053127 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 467/934] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:21:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:21:51.054931 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8df49-e43a-4419-bf81-df37565916d5 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:51.081699 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2408824-dbd6-4f4c-914f-3755c22a22a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:51.082359 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2408824-dbd6-4f4c-914f-3755c22a22a6 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:51.082646 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2408824-dbd6-4f4c-914f-3755c22a22a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:51.082924 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2408824-dbd6-4f4c-914f-3755c22a22a6 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:51.083628 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2408824-dbd6-4f4c-914f-3755c22a22a6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:51.083938 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2408824-dbd6-4f4c-914f-3755c22a22a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:51.085357 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2408824-dbd6-4f4c-914f-3755c22a22a6 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:51.095968 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 468/935] 10.222.0.16 () {56 vars in 1122 bytes} [Thu May 26 12:21:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:51.095968 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723710ed-9579-43f3-bc2d-1af76e09c78b None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:51.095968 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723710ed-9579-43f3-bc2d-1af76e09c78b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:51.095968 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723710ed-9579-43f3-bc2d-1af76e09c78b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:51.113052 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-723710ed-9579-43f3-bc2d-1af76e09c78b None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:21:51.114236 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-723710ed-9579-43f3-bc2d-1af76e09c78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:21:51.136055 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:51.170111 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8df49-e43a-4419-bf81-df37565916d5 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:51.187024 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 469/936] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:21:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:21:51.188038 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723710ed-9579-43f3-bc2d-1af76e09c78b None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:51.211108 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21803d73-aaf7-49be-bb45-4b91a4815610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:51.211771 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21803d73-aaf7-49be-bb45-4b91a4815610 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:51.212054 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21803d73-aaf7-49be-bb45-4b91a4815610 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:51.212328 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21803d73-aaf7-49be-bb45-4b91a4815610 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:51.213111 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21803d73-aaf7-49be-bb45-4b91a4815610 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:51.213407 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21803d73-aaf7-49be-bb45-4b91a4815610 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:51.215200 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21803d73-aaf7-49be-bb45-4b91a4815610 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:51.231068 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 468/937] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:21:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:51.231935 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21803d73-aaf7-49be-bb45-4b91a4815610 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:51.303280 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:51.312376 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723710ed-9579-43f3-bc2d-1af76e09c78b None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:51.339700 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21803d73-aaf7-49be-bb45-4b91a4815610 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:51.349527 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1742ff-97fc-4430-af66-e5210539b7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:51.350186 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1742ff-97fc-4430-af66-e5210539b7d6 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:51.350471 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1742ff-97fc-4430-af66-e5210539b7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:51.350918 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1742ff-97fc-4430-af66-e5210539b7d6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:51.351604 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1742ff-97fc-4430-af66-e5210539b7d6 None admin] RBAC: Adding query filter params (interface=public, service_id=782332459dcc48af9184566972d5312e, region_id=RegionOne) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:51.351840 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1742ff-97fc-4430-af66-e5210539b7d6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:51.353248 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1742ff-97fc-4430-af66-e5210539b7d6 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:51.363582 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 470/938] 10.222.0.16 () {56 vars in 1251 bytes} [Thu May 26 12:21:51 2022] GET /identity/v3/endpoints?service_id=782332459dcc48af9184566972d5312e&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:51.363582 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1742ff-97fc-4430-af66-e5210539b7d6 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:51.373885 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:51.381972 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca97b9ec-bda4-45d8-92a9-d1de58e62810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:51.382624 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca97b9ec-bda4-45d8-92a9-d1de58e62810 None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:51.382901 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca97b9ec-bda4-45d8-92a9-d1de58e62810 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:51.383174 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca97b9ec-bda4-45d8-92a9-d1de58e62810 None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:51.383863 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca97b9ec-bda4-45d8-92a9-d1de58e62810 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:51.385324 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca97b9ec-bda4-45d8-92a9-d1de58e62810 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:51.386680 dv-cinder-815146-11-smb devstack@keystone.service[80180]: WARNING keystone.server.flask.common [None req-ca97b9ec-bda4-45d8-92a9-d1de58e62810 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 26 12:21:51.404105 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.sql.core [None req-ca97b9ec-bda4-45d8-92a9-d1de58e62810 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 26 12:21:51.404105 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 26 12:21:51.404105 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [parameters: {'id': 'd1689af2cad042268bf66abfa27ac529', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 26 12:21:51.404105 dv-cinder-815146-11-smb devstack@keystone.service[80180]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80180) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 26 12:21:51.412962 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-ca97b9ec-bda4-45d8-92a9-d1de58e62810 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d1689af2cad042268bf66abfa27ac529.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d1689af2cad042268bf66abfa27ac529. May 26 12:21:51.412962 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:51.412962 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 12:21:51.412962 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 12:21:51.412962 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 12:21:51.412962 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 12:21:51.412962 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 12:21:51.412962 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application result = self._query(query) May 26 12:21:51.412962 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 12:21:51.412962 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application conn.query(q) May 26 12:21:51.412962 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 12:21:51.412962 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 12:21:51.412962 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 12:21:51.413751 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application result.read() May 26 12:21:51.413751 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 12:21:51.413751 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 12:21:51.413751 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 12:21:51.413751 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 12:21:51.413751 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 12:21:51.413751 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 12:21:51.413751 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 12:21:51.413751 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 12:21:51.413751 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 26 12:21:51.413751 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:51.413751 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 26 12:21:51.413751 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:51.413751 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:51.413751 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 26 12:21:51.413751 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 26 12:21:51.413751 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 26 12:21:51.413751 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return project_ref.to_dict() May 26 12:21:51.414909 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 12:21:51.414909 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application next(self.gen) May 26 12:21:51.414909 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 26 12:21:51.414909 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application yield resource May 26 12:21:51.414909 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 12:21:51.414909 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application next(self.gen) May 26 12:21:51.414909 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 26 12:21:51.414909 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self.session.rollback() May 26 12:21:51.414909 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 26 12:21:51.414909 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self.force_reraise() May 26 12:21:51.414909 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 26 12:21:51.414909 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise self.value May 26 12:21:51.414909 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 26 12:21:51.414909 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 26 12:21:51.414909 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 26 12:21:51.414909 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application session.commit() May 26 12:21:51.414909 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 26 12:21:51.415813 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 26 12:21:51.415813 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 26 12:21:51.415813 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._prepare_impl() May 26 12:21:51.415813 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 26 12:21:51.415813 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self.session.flush() May 26 12:21:51.415813 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 26 12:21:51.415813 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._flush(objects) May 26 12:21:51.415813 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 26 12:21:51.415813 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 26 12:21:51.415813 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 26 12:21:51.415813 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application compat.raise_( May 26 12:21:51.415813 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 12:21:51.415813 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception May 26 12:21:51.415813 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 26 12:21:51.415813 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application flush_context.execute() May 26 12:21:51.415813 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 26 12:21:51.415813 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rec.execute(self) May 26 12:21:51.416706 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 26 12:21:51.416706 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 26 12:21:51.416706 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 26 12:21:51.416706 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application _emit_insert_statements( May 26 12:21:51.416706 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 26 12:21:51.416706 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application c = connection._execute_20( May 26 12:21:51.416706 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 26 12:21:51.416706 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 26 12:21:51.416706 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 26 12:21:51.416706 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 26 12:21:51.416706 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 26 12:21:51.416706 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ret = self._execute_context( May 26 12:21:51.416706 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 26 12:21:51.416706 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 26 12:21:51.416706 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 26 12:21:51.420394 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 26 12:21:51.420394 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 12:21:51.420394 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception May 26 12:21:51.420394 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 12:21:51.420394 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 12:21:51.420394 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 12:21:51.420394 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 12:21:51.420394 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 12:21:51.420394 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application result = self._query(query) May 26 12:21:51.420394 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 12:21:51.420394 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application conn.query(q) May 26 12:21:51.420394 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 12:21:51.420394 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 12:21:51.420394 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 12:21:51.420394 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application result.read() May 26 12:21:51.420394 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 12:21:51.420394 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 12:21:51.422721 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 12:21:51.422721 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 12:21:51.422721 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 12:21:51.422721 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 12:21:51.422721 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 12:21:51.422721 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 12:21:51.422721 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 26 12:21:51.422721 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 26 12:21:51.422721 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [parameters: {'id': 'd1689af2cad042268bf66abfa27ac529', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 26 12:21:51.422721 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 26 12:21:51.422721 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:51.422721 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:21:51.422721 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:51.422721 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:51.422721 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 26 12:21:51.425864 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 26 12:21:51.425864 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 26 12:21:51.425864 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 26 12:21:51.425864 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 26 12:21:51.425864 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:51.425864 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:21:51.425864 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:51.425864 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:51.425864 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:51.425864 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:51.425864 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:51.425864 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:51.425864 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:51.425864 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:51.425864 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:51.425864 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:51.425864 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:51.428277 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:51.428277 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 26 12:21:51.428277 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 26 12:21:51.428277 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:51.428277 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:51.428277 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 26 12:21:51.428277 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.Conflict( May 26 12:21:51.428277 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d1689af2cad042268bf66abfa27ac529. May 26 12:21:51.428277 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:51.428277 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 469/939] 10.222.0.16 () {60 vars in 1140 bytes} [Thu May 26 12:21:51 2022] POST /identity/v3/projects => generated 262 bytes in 183 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:51.428277 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca97b9ec-bda4-45d8-92a9-d1de58e62810 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:51.482858 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1742ff-97fc-4430-af66-e5210539b7d6 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:51.524342 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca97b9ec-bda4-45d8-92a9-d1de58e62810 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:51.528298 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca4c87d-e4d5-411a-a359-8c952eba546a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:51.529138 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4c87d-e4d5-411a-a359-8c952eba546a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:51.529423 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4c87d-e4d5-411a-a359-8c952eba546a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:51.529697 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4c87d-e4d5-411a-a359-8c952eba546a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:51.537519 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca4c87d-e4d5-411a-a359-8c952eba546a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:51.538956 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca4c87d-e4d5-411a-a359-8c952eba546a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:51.554546 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-eca4c87d-e4d5-411a-a359-8c952eba546a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 12:21:51.554546 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:51.554546 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:51.554546 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:51.554546 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:51.554546 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:51.554546 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:51.554546 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:51.554546 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:51.554546 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:51.554546 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:51.554546 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:51.554546 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:21:51.554546 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:21:51.554546 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:21:51.554546 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:21:51.555512 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:51.555512 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:51.555512 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:21:51.555512 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:21:51.555512 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:21:51.555512 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:21:51.555512 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:51.555512 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:51.555512 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:51.555512 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:51.555512 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:51.555512 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:51.555512 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:51.555512 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:51.555512 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:51.555512 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:51.555512 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:51.555512 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:51.556480 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:51.556480 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:51.556480 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:21:51.556480 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:21:51.556480 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:21:51.556480 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:21:51.556480 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:21:51.556480 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:21:51.556480 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 12:21:51.556480 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:51.556480 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 471/940] 10.222.0.16 () {56 vars in 1117 bytes} [Thu May 26 12:21:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:51.556480 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca4c87d-e4d5-411a-a359-8c952eba546a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:51.564857 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d245ee-5cfb-4f71-a909-5bcc374bd5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:51.564857 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d245ee-5cfb-4f71-a909-5bcc374bd5c2 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:51.565154 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d245ee-5cfb-4f71-a909-5bcc374bd5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:51.565408 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d245ee-5cfb-4f71-a909-5bcc374bd5c2 None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:51.566089 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d245ee-5cfb-4f71-a909-5bcc374bd5c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:51.567654 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d245ee-5cfb-4f71-a909-5bcc374bd5c2 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:51.577774 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 470/941] 10.222.0.16 () {56 vars in 1087 bytes} [Thu May 26 12:21:51 2022] GET /identity/v3/services => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:21:51.578649 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d245ee-5cfb-4f71-a909-5bcc374bd5c2 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:51.591496 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:51.640255 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:51.702083 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca4c87d-e4d5-411a-a359-8c952eba546a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:51.702595 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d245ee-5cfb-4f71-a909-5bcc374bd5c2 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:51.741527 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a111ae1e-b3fd-4379-af13-0e4ee5322ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:51.741748 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b0b124-f331-4c90-b8ee-ecbd467e3fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:51.742252 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a111ae1e-b3fd-4379-af13-0e4ee5322ba2 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:51.742535 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a111ae1e-b3fd-4379-af13-0e4ee5322ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:51.742807 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a111ae1e-b3fd-4379-af13-0e4ee5322ba2 None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:51.743389 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0b124-f331-4c90-b8ee-ecbd467e3fca None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:51.743666 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a111ae1e-b3fd-4379-af13-0e4ee5322ba2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:51.743974 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a111ae1e-b3fd-4379-af13-0e4ee5322ba2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:51.744241 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0b124-f331-4c90-b8ee-ecbd467e3fca None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:51.744690 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0b124-f331-4c90-b8ee-ecbd467e3fca None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:51.745510 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a111ae1e-b3fd-4379-af13-0e4ee5322ba2 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:51.753056 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b0b124-f331-4c90-b8ee-ecbd467e3fca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:51.754898 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b0b124-f331-4c90-b8ee-ecbd467e3fca None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:51.765669 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 471/942] 10.222.0.16 () {56 vars in 1149 bytes} [Thu May 26 12:21:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:51.771069 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a111ae1e-b3fd-4379-af13-0e4ee5322ba2 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:51.771563 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-28b0b124-f331-4c90-b8ee-ecbd467e3fca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:21:51.771563 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:51.771563 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:51.771563 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:51.771563 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:51.771563 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:51.771563 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:51.771563 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:51.771563 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:51.771563 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:51.771563 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:51.771563 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:51.771563 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:21:51.771563 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:21:51.771563 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:21:51.772448 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:21:51.772448 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:51.772448 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:51.772448 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:51.772448 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:51.772448 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:51.772448 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:51.772448 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:51.772448 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:51.772448 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:51.772448 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:51.772448 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:51.772448 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:51.772448 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:51.772448 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:51.772448 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:51.772448 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:51.773397 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:21:51.773397 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:21:51.773397 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:21:51.773397 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:21:51.773397 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:21:51.773397 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:21:51.773397 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:21:51.773397 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:51.777248 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 472/943] 10.222.0.16 () {56 vars in 1111 bytes} [Thu May 26 12:21:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:51.781512 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b0b124-f331-4c90-b8ee-ecbd467e3fca None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:51.884165 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:51.885802 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a111ae1e-b3fd-4379-af13-0e4ee5322ba2 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:51.896694 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:51.915162 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b0b124-f331-4c90-b8ee-ecbd467e3fca None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:51.925826 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6edf04-7079-432b-a0d8-f65147b3ce22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:51.926625 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6edf04-7079-432b-a0d8-f65147b3ce22 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:51.926910 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6edf04-7079-432b-a0d8-f65147b3ce22 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:51.927187 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6edf04-7079-432b-a0d8-f65147b3ce22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:51.937889 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6edf04-7079-432b-a0d8-f65147b3ce22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:51.939236 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6edf04-7079-432b-a0d8-f65147b3ce22 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:51.957518 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef6389-f223-425f-8ae6-082162bb6ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:51.958382 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef6389-f223-425f-8ae6-082162bb6ef8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:51.958805 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef6389-f223-425f-8ae6-082162bb6ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:51.959228 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef6389-f223-425f-8ae6-082162bb6ef8 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:51.959649 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-af6edf04-7079-432b-a0d8-f65147b3ce22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:51.959649 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:51.959649 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:51.959649 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:51.959649 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:51.959649 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:51.959649 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:51.959649 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:51.959649 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:51.959649 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:51.959649 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:51.959649 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:51.959649 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:21:51.959649 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:21:51.959649 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:21:51.960675 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:21:51.960675 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:51.960675 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:51.960675 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:51.960675 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:51.960675 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:51.960675 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:51.960675 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:51.960675 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:51.960675 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:51.960675 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:51.960675 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:51.960675 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:51.960675 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:51.960675 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:51.960675 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:51.960675 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:51.961688 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:21:51.961688 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:21:51.961688 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:51.961688 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:51.962476 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ef6389-f223-425f-8ae6-082162bb6ef8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:51.962938 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ef6389-f223-425f-8ae6-082162bb6ef8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:51.964529 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ef6389-f223-425f-8ae6-082162bb6ef8 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:51.964936 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 472/944] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:21:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:51.966751 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6edf04-7079-432b-a0d8-f65147b3ce22 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:51.988570 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 473/945] 10.222.0.16 () {56 vars in 1112 bytes} [Thu May 26 12:21:51 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:52.088459 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6edf04-7079-432b-a0d8-f65147b3ce22 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:52.128077 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb20706-f3bb-459d-81ff-04440ca7209d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:52.128761 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb20706-f3bb-459d-81ff-04440ca7209d None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:52.129082 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb20706-f3bb-459d-81ff-04440ca7209d None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:52.129360 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb20706-f3bb-459d-81ff-04440ca7209d None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:52.130103 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb20706-f3bb-459d-81ff-04440ca7209d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:52.130412 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb20706-f3bb-459d-81ff-04440ca7209d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:52.131814 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb20706-f3bb-459d-81ff-04440ca7209d None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:52.146200 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 473/946] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:21:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:21:52.151599 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef6389-f223-425f-8ae6-082162bb6ef8 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:52.259154 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef6389-f223-425f-8ae6-082162bb6ef8 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:52.294869 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2262ac-b580-4c5f-a28f-2e3989b21448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:52.295666 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2262ac-b580-4c5f-a28f-2e3989b21448 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:52.295966 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2262ac-b580-4c5f-a28f-2e3989b21448 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:52.296326 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2262ac-b580-4c5f-a28f-2e3989b21448 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:52.303510 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2262ac-b580-4c5f-a28f-2e3989b21448 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:52.305013 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2262ac-b580-4c5f-a28f-2e3989b21448 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:52.306821 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:52.322150 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-7b2262ac-b580-4c5f-a28f-2e3989b21448 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:21:52.322150 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:52.322150 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:52.322150 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:52.322150 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:52.322150 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:52.322150 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:52.322150 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:52.322150 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:52.322150 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:52.322150 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:52.322150 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:52.322150 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:21:52.322150 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:21:52.322150 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:21:52.323089 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:21:52.323089 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:52.323089 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:52.323089 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:52.323089 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:52.323089 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:52.323089 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:52.323089 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:52.323089 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:52.323089 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:52.323089 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:52.323089 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:52.323089 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:52.323089 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:52.323089 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:52.323089 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:52.323089 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:52.323987 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:21:52.323987 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:21:52.323987 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:21:52.323987 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:21:52.323987 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:21:52.323987 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:21:52.323987 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:21:52.323987 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:52.323987 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 474/947] 10.222.0.16 () {56 vars in 1111 bytes} [Thu May 26 12:21:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:52.329979 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb20706-f3bb-459d-81ff-04440ca7209d None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:52.354139 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:52.442576 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb20706-f3bb-459d-81ff-04440ca7209d None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:52.478460 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a9733-9fb0-4743-aca4-66980137ad5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:52.479126 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a9733-9fb0-4743-aca4-66980137ad5e None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:52.479411 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a9733-9fb0-4743-aca4-66980137ad5e None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:52.479690 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a9733-9fb0-4743-aca4-66980137ad5e None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:52.480484 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7a9733-9fb0-4743-aca4-66980137ad5e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:52.480908 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7a9733-9fb0-4743-aca4-66980137ad5e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:52.482347 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7a9733-9fb0-4743-aca4-66980137ad5e None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:52.495654 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 474/948] 10.222.0.16 () {56 vars in 1148 bytes} [Thu May 26 12:21:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:52.502175 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2262ac-b580-4c5f-a28f-2e3989b21448 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:52.612665 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2262ac-b580-4c5f-a28f-2e3989b21448 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:52.650470 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f95f9b-17b4-44d8-a89f-605a6258ef45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:52.651353 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f95f9b-17b4-44d8-a89f-605a6258ef45 None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:52.651634 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f95f9b-17b4-44d8-a89f-605a6258ef45 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:52.651909 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f95f9b-17b4-44d8-a89f-605a6258ef45 None admin] PATH_INFO: `/v3/projects/42e6c693bd224d92b8a0fe4ad0cc586d/users/512b4337083145f9ae57948a63444ced/roles/d2c069ef8eed4c73a7fa3aa932c60945` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:52.654319 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f95f9b-17b4-44d8-a89f-605a6258ef45 None admin] RBAC: Authorizing `identity:create_grant(project_id=42e6c693bd224d92b8a0fe4ad0cc586d, user_id=512b4337083145f9ae57948a63444ced, role_id=d2c069ef8eed4c73a7fa3aa932c60945)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:52.655772 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f95f9b-17b4-44d8-a89f-605a6258ef45 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:52.670335 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 475/949] 10.222.0.16 () {58 vars in 1439 bytes} [Thu May 26 12:21:52 2022] PUT /identity/v3/projects/42e6c693bd224d92b8a0fe4ad0cc586d/users/512b4337083145f9ae57948a63444ced/roles/d2c069ef8eed4c73a7fa3aa932c60945 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:21:52.706867 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af114a-da46-4916-8861-5fd44f301cbf None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:52.707287 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af114a-da46-4916-8861-5fd44f301cbf None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:52.707421 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af114a-da46-4916-8861-5fd44f301cbf None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:52.710965 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 475/950] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:21:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:21:52.716905 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addbfef8-c9cc-4e2a-a03b-0a942375dadb None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:52.717454 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addbfef8-c9cc-4e2a-a03b-0a942375dadb None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:52.717454 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addbfef8-c9cc-4e2a-a03b-0a942375dadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:52.736733 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-addbfef8-c9cc-4e2a-a03b-0a942375dadb None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:21:52.738049 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-addbfef8-c9cc-4e2a-a03b-0a942375dadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:21:52.804907 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:52.823679 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 476/951] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:21:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:21:52.847692 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af114a-da46-4916-8861-5fd44f301cbf None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:52.942693 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:52.967051 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af114a-da46-4916-8861-5fd44f301cbf None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:53.007367 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8533d2c4-a38c-452b-aa52-7423d4536de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:53.008541 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533d2c4-a38c-452b-aa52-7423d4536de4 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:53.009060 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533d2c4-a38c-452b-aa52-7423d4536de4 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:53.009546 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533d2c4-a38c-452b-aa52-7423d4536de4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:53.010398 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8533d2c4-a38c-452b-aa52-7423d4536de4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:53.011963 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8533d2c4-a38c-452b-aa52-7423d4536de4 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:53.024571 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-8533d2c4-a38c-452b-aa52-7423d4536de4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 26 12:21:53.024571 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:53.024571 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:21:53.024571 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:21:53.024571 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:21:53.024571 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:21:53.024571 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:21:53.024571 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:21:53.024571 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 12:21:53.024571 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:53.024571 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:21:53.024571 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:53.024571 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:53.024571 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:53.024571 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:53.024571 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:53.024571 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:53.025801 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:53.025801 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:53.025801 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:53.025801 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:53.025801 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:53.025801 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:53.025801 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:21:53.025801 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:21:53.025801 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:21:53.025801 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:21:53.025801 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:53.025801 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:53.025801 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:53.025801 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:53.025801 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:53.025801 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:53.026728 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:53.026728 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:53.026728 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:53.026728 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:53.026728 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:53.026728 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:53.026728 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:53.026728 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:53.026728 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:53.026728 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:53.026728 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:21:53.026728 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:21:53.026728 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 12:21:53.026728 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:53.029604 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 476/952] 10.222.0.16 () {56 vars in 1111 bytes} [Thu May 26 12:21:52 2022] GET /identity/v3/services/compute => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:53.036371 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addbfef8-c9cc-4e2a-a03b-0a942375dadb None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:53.143716 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addbfef8-c9cc-4e2a-a03b-0a942375dadb None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:53.177763 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4521fb-19fd-4175-8c4e-b9c9940103f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:53.178423 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4521fb-19fd-4175-8c4e-b9c9940103f3 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:53.178707 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4521fb-19fd-4175-8c4e-b9c9940103f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:53.178981 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4521fb-19fd-4175-8c4e-b9c9940103f3 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:53.179690 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4521fb-19fd-4175-8c4e-b9c9940103f3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:53.180054 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4521fb-19fd-4175-8c4e-b9c9940103f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:53.181502 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4521fb-19fd-4175-8c4e-b9c9940103f3 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:53.186570 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 477/953] 10.222.0.16 () {56 vars in 1112 bytes} [Thu May 26 12:21:53 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:21:53.192599 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8533d2c4-a38c-452b-aa52-7423d4536de4 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:53.303364 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8533d2c4-a38c-452b-aa52-7423d4536de4 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:53.340125 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3462edf8-dc1d-4785-9ffa-13134d330cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:53.341160 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462edf8-dc1d-4785-9ffa-13134d330cb0 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:53.341675 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462edf8-dc1d-4785-9ffa-13134d330cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:53.342173 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462edf8-dc1d-4785-9ffa-13134d330cb0 None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:53.343096 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3462edf8-dc1d-4785-9ffa-13134d330cb0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:53.343612 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3462edf8-dc1d-4785-9ffa-13134d330cb0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:53.345519 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3462edf8-dc1d-4785-9ffa-13134d330cb0 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:53.350970 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 477/954] 10.222.0.16 () {56 vars in 1112 bytes} [Thu May 26 12:21:53 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:53.922224 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317ed9b-5187-48b9-acfc-568422e5ce25 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:53.922764 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317ed9b-5187-48b9-acfc-568422e5ce25 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:53.922764 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317ed9b-5187-48b9-acfc-568422e5ce25 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:53.925128 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 478/955] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:21:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:21:53.930734 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf9e39b-8ef1-4eda-9c76-7e8bf1c9d1b3 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:53.931023 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf9e39b-8ef1-4eda-9c76-7e8bf1c9d1b3 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:53.931299 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf9e39b-8ef1-4eda-9c76-7e8bf1c9d1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:53.948832 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-ebf9e39b-8ef1-4eda-9c76-7e8bf1c9d1b3 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:21:53.950375 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-ebf9e39b-8ef1-4eda-9c76-7e8bf1c9d1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:21:53.952652 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:54.029135 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 478/956] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:21:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:21:54.046829 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e317ed9b-5187-48b9-acfc-568422e5ce25 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:54.103191 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:54.152819 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e317ed9b-5187-48b9-acfc-568422e5ce25 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:54.189246 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e780b378-b0e5-4dce-ba30-e0f41d76a011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:54.190098 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780b378-b0e5-4dce-ba30-e0f41d76a011 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:54.190383 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780b378-b0e5-4dce-ba30-e0f41d76a011 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:54.190657 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780b378-b0e5-4dce-ba30-e0f41d76a011 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:54.191339 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e780b378-b0e5-4dce-ba30-e0f41d76a011 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:54.192771 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e780b378-b0e5-4dce-ba30-e0f41d76a011 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:54.206462 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-e780b378-b0e5-4dce-ba30-e0f41d76a011 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:21:54.206462 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:54.206462 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:21:54.206462 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:21:54.206462 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:21:54.206462 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:21:54.206462 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:21:54.206462 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:21:54.206462 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:21:54.206462 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:54.206462 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:21:54.206462 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:54.206462 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:54.206462 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:54.206462 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:54.206462 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:54.206462 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:54.207576 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:54.207576 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:54.207576 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:54.207576 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:54.207576 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:54.207576 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:54.207576 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:21:54.207576 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:21:54.207576 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:21:54.207576 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:21:54.207576 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:54.207576 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:54.207576 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:54.207576 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:54.207576 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:54.207576 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:54.208428 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:54.208428 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:54.208428 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:54.208428 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:54.208428 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:54.208428 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:54.208428 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:54.208428 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:54.208428 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:54.208428 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:54.208428 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:21:54.208428 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:21:54.208428 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:21:54.208428 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:54.213125 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 479/957] 10.222.0.16 () {56 vars in 1126 bytes} [Thu May 26 12:21:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:54.214565 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf9e39b-8ef1-4eda-9c76-7e8bf1c9d1b3 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:54.323082 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf9e39b-8ef1-4eda-9c76-7e8bf1c9d1b3 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:54.359383 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cdba5d-04e9-4c6c-bed4-532953f6ae19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:54.360965 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cdba5d-04e9-4c6c-bed4-532953f6ae19 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:54.361523 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cdba5d-04e9-4c6c-bed4-532953f6ae19 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:54.362036 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cdba5d-04e9-4c6c-bed4-532953f6ae19 None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:54.362948 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cdba5d-04e9-4c6c-bed4-532953f6ae19 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:54.363473 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cdba5d-04e9-4c6c-bed4-532953f6ae19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:54.365065 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cdba5d-04e9-4c6c-bed4-532953f6ae19 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:54.370608 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 479/958] 10.222.0.16 () {56 vars in 1122 bytes} [Thu May 26 12:21:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:54.376608 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cdba5d-04e9-4c6c-bed4-532953f6ae19 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:54.377336 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dbc276-79d4-4b1e-b107-06afe5fa50f5 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:54.377628 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dbc276-79d4-4b1e-b107-06afe5fa50f5 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:54.377912 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dbc276-79d4-4b1e-b107-06afe5fa50f5 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:54.379277 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:54.379638 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 480/959] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:21:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:21:54.386425 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a50cb-dcdd-42f0-81e6-ea3b49d17f04 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:54.386425 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a50cb-dcdd-42f0-81e6-ea3b49d17f04 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:54.386425 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a50cb-dcdd-42f0-81e6-ea3b49d17f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:54.406916 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-017a50cb-dcdd-42f0-81e6-ea3b49d17f04 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:21:54.408534 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-017a50cb-dcdd-42f0-81e6-ea3b49d17f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:21:54.486125 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cdba5d-04e9-4c6c-bed4-532953f6ae19 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:54.504862 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 481/960] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:21:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:21:54.524202 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a50cb-dcdd-42f0-81e6-ea3b49d17f04 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:54.526981 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5eae80-4f88-404b-9f31-4fbeade03a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:54.527897 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5eae80-4f88-404b-9f31-4fbeade03a17 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:54.528377 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5eae80-4f88-404b-9f31-4fbeade03a17 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:54.528823 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5eae80-4f88-404b-9f31-4fbeade03a17 None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:54.529764 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5eae80-4f88-404b-9f31-4fbeade03a17 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:54.530257 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5eae80-4f88-404b-9f31-4fbeade03a17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:54.531790 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5eae80-4f88-404b-9f31-4fbeade03a17 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:54.537768 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 480/961] 10.222.0.16 () {56 vars in 1122 bytes} [Thu May 26 12:21:54 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:54.543204 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5eae80-4f88-404b-9f31-4fbeade03a17 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:54.581935 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:54.624155 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:54.649805 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a50cb-dcdd-42f0-81e6-ea3b49d17f04 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:54.668748 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5eae80-4f88-404b-9f31-4fbeade03a17 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:54.699954 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55136e1-9214-443e-9f40-6cdeb4b082ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:54.701068 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55136e1-9214-443e-9f40-6cdeb4b082ea None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:54.701358 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55136e1-9214-443e-9f40-6cdeb4b082ea None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:54.701639 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55136e1-9214-443e-9f40-6cdeb4b082ea None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:54.702649 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55136e1-9214-443e-9f40-6cdeb4b082ea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:54.704124 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55136e1-9214-443e-9f40-6cdeb4b082ea None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:54.705472 dv-cinder-815146-11-smb devstack@keystone.service[80181]: WARNING keystone.server.flask.common [None req-b55136e1-9214-443e-9f40-6cdeb4b082ea None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 26 12:21:54.706694 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af4ce46-13a8-4d52-b029-3967270ce2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:54.707558 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4ce46-13a8-4d52-b029-3967270ce2cc None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:54.708075 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4ce46-13a8-4d52-b029-3967270ce2cc None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:54.708542 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4ce46-13a8-4d52-b029-3967270ce2cc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:54.709492 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af4ce46-13a8-4d52-b029-3967270ce2cc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:54.711028 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af4ce46-13a8-4d52-b029-3967270ce2cc None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:54.722690 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.sql.core [None req-b55136e1-9214-443e-9f40-6cdeb4b082ea None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 26 12:21:54.722690 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 26 12:21:54.722690 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [parameters: {'user_id': '0e7fdec336fb43d5ac856fc7bd53bf3f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 26 12:21:54.722690 dv-cinder-815146-11-smb devstack@keystone.service[80181]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80181) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 26 12:21:54.732857 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 481/962] 10.222.0.16 () {60 vars in 1144 bytes} [Thu May 26 12:21:54 2022] POST /identity/v3/endpoints => generated 349 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:21:54.744566 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-b55136e1-9214-443e-9f40-6cdeb4b082ea None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 26 12:21:54.744566 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:54.744566 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 12:21:54.744566 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 12:21:54.744566 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 12:21:54.744566 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 12:21:54.744566 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 12:21:54.744566 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application result = self._query(query) May 26 12:21:54.744566 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 12:21:54.744566 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application conn.query(q) May 26 12:21:54.744566 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 12:21:54.744566 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 12:21:54.744566 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 12:21:54.744566 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application result.read() May 26 12:21:54.744566 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 12:21:54.745638 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 12:21:54.745638 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 12:21:54.745638 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 12:21:54.745638 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 12:21:54.745638 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 12:21:54.745638 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 12:21:54.745638 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 12:21:54.745638 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 26 12:21:54.745638 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:54.745638 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 26 12:21:54.745638 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:54.745638 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:54.745638 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 26 12:21:54.745638 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 26 12:21:54.745638 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 26 12:21:54.745638 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 26 12:21:54.745638 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 12:21:54.745638 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application next(self.gen) May 26 12:21:54.746644 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 26 12:21:54.746644 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application yield resource May 26 12:21:54.746644 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 12:21:54.746644 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application next(self.gen) May 26 12:21:54.746644 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 26 12:21:54.746644 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self.session.rollback() May 26 12:21:54.746644 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 26 12:21:54.746644 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self.force_reraise() May 26 12:21:54.746644 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 26 12:21:54.746644 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise self.value May 26 12:21:54.746644 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 26 12:21:54.746644 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 26 12:21:54.746644 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 26 12:21:54.746644 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application session.commit() May 26 12:21:54.746644 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 26 12:21:54.746644 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 26 12:21:54.746644 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 26 12:21:54.747555 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._prepare_impl() May 26 12:21:54.747555 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 26 12:21:54.747555 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self.session.flush() May 26 12:21:54.747555 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 26 12:21:54.747555 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._flush(objects) May 26 12:21:54.747555 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 26 12:21:54.747555 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 26 12:21:54.747555 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 26 12:21:54.747555 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application compat.raise_( May 26 12:21:54.747555 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 12:21:54.747555 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception May 26 12:21:54.747555 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 26 12:21:54.747555 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application flush_context.execute() May 26 12:21:54.747555 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 26 12:21:54.747555 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rec.execute(self) May 26 12:21:54.747555 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 26 12:21:54.747555 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 26 12:21:54.748447 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 26 12:21:54.748447 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application _emit_insert_statements( May 26 12:21:54.748447 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 26 12:21:54.748447 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application result = connection._execute_20( May 26 12:21:54.748447 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 26 12:21:54.748447 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 26 12:21:54.748447 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 26 12:21:54.748447 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 26 12:21:54.748447 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 26 12:21:54.748447 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ret = self._execute_context( May 26 12:21:54.748447 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 26 12:21:54.748447 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 26 12:21:54.748447 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 26 12:21:54.748447 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 26 12:21:54.748447 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 12:21:54.748447 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception May 26 12:21:54.751281 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 12:21:54.751281 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 12:21:54.751281 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 12:21:54.751281 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 12:21:54.751281 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 12:21:54.751281 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application result = self._query(query) May 26 12:21:54.751281 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 12:21:54.751281 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application conn.query(q) May 26 12:21:54.751281 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 12:21:54.751281 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 12:21:54.751281 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 12:21:54.751281 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application result.read() May 26 12:21:54.751281 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 12:21:54.751281 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 12:21:54.751281 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 12:21:54.751281 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 12:21:54.752944 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 12:21:54.752944 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 12:21:54.752944 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 12:21:54.752944 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 12:21:54.752944 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 26 12:21:54.752944 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 26 12:21:54.752944 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [parameters: {'user_id': '0e7fdec336fb43d5ac856fc7bd53bf3f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 26 12:21:54.752944 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 26 12:21:54.752944 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:54.752944 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:21:54.752944 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:54.752944 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:54.752944 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:54.752944 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:54.752944 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:54.754425 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:54.754425 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:54.754425 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:54.754425 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:54.754425 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:54.754425 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:54.754425 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:54.754425 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 26 12:21:54.754425 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 26 12:21:54.754425 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:54.754425 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:54.754425 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:21:54.754425 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:21:54.754425 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:21:54.754425 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:21:54.754425 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 26 12:21:54.754425 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 26 12:21:54.756137 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 26 12:21:54.756137 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 26 12:21:54.756137 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 26 12:21:54.756137 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 26 12:21:54.756137 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 26 12:21:54.756137 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:54.758968 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 482/963] 10.222.0.16 () {60 vars in 1131 bytes} [Thu May 26 12:21:54 2022] POST /identity/v3/users => generated 160 bytes in 235 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 26 12:21:54.766202 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af4ce46-13a8-4d52-b029-3967270ce2cc None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:54.896195 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af4ce46-13a8-4d52-b029-3967270ce2cc None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:54.919355 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:54.935237 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285d9f67-68a0-4995-b95e-ffb09fcc3901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:54.936028 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d9f67-68a0-4995-b95e-ffb09fcc3901 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:54.936309 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d9f67-68a0-4995-b95e-ffb09fcc3901 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:54.936579 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d9f67-68a0-4995-b95e-ffb09fcc3901 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:54.945257 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285d9f67-68a0-4995-b95e-ffb09fcc3901 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:54.946690 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285d9f67-68a0-4995-b95e-ffb09fcc3901 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:54.961612 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-285d9f67-68a0-4995-b95e-ffb09fcc3901 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 12:21:54.961612 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:54.961612 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:54.961612 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:54.961612 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:54.961612 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:54.961612 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:54.961612 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:54.961612 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:54.961612 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:54.961612 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:54.961612 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:54.961612 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:21:54.961612 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:21:54.961612 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:21:54.961612 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:21:54.963016 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:54.963016 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:54.963016 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:21:54.963016 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:21:54.963016 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:21:54.963016 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:21:54.963016 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:54.963016 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:54.963016 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:54.963016 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:54.963016 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:54.963016 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:54.963016 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:54.963016 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:54.963016 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:54.963016 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:54.963016 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:54.963016 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:54.964547 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:54.964547 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:54.964547 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:21:54.964547 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:21:54.964547 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:21:54.964547 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:21:54.964547 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:21:54.964547 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:21:54.964547 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 12:21:54.964547 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:54.964547 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 482/964] 10.222.0.16 () {56 vars in 1099 bytes} [Thu May 26 12:21:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:54.968983 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55136e1-9214-443e-9f40-6cdeb4b082ea None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:55.060766 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335dee6-738d-413c-98b3-510c588afdb9 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:55.061114 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335dee6-738d-413c-98b3-510c588afdb9 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:55.061362 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335dee6-738d-413c-98b3-510c588afdb9 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:55.062988 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 483/965] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:21:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:21:55.068474 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230e5ff-2961-4293-91da-735f275b387b None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:55.068762 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230e5ff-2961-4293-91da-735f275b387b None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:55.069080 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230e5ff-2961-4293-91da-735f275b387b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:55.081209 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55136e1-9214-443e-9f40-6cdeb4b082ea None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:55.092445 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:55.093755 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-4230e5ff-2961-4293-91da-735f275b387b None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:21:55.095991 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-4230e5ff-2961-4293-91da-735f275b387b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:21:55.124632 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c83191-cde8-44ad-bd8f-2721a62e5310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:55.125597 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c83191-cde8-44ad-bd8f-2721a62e5310 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:55.125877 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c83191-cde8-44ad-bd8f-2721a62e5310 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:55.126181 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c83191-cde8-44ad-bd8f-2721a62e5310 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:55.127448 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c83191-cde8-44ad-bd8f-2721a62e5310 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:55.127759 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c83191-cde8-44ad-bd8f-2721a62e5310 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:55.129690 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c83191-cde8-44ad-bd8f-2721a62e5310 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:55.174239 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 484/966] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:21:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:21:55.176282 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 483/967] 10.222.0.16 () {56 vars in 1101 bytes} [Thu May 26 12:21:54 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:55.192767 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4230e5ff-2961-4293-91da-735f275b387b None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:55.306202 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4230e5ff-2961-4293-91da-735f275b387b None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:55.317344 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:55.345384 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb86258-aa28-473e-ac12-350ee5c1d15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:55.346218 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb86258-aa28-473e-ac12-350ee5c1d15d None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:55.346496 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb86258-aa28-473e-ac12-350ee5c1d15d None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:55.346767 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb86258-aa28-473e-ac12-350ee5c1d15d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:55.359170 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb86258-aa28-473e-ac12-350ee5c1d15d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:21:55.367637 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-afb86258-aa28-473e-ac12-350ee5c1d15d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 12:21:55.367637 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:55.367637 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:55.367637 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:55.367637 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:55.367637 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:55.367637 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:55.367637 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:55.367637 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:55.367637 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:55.367637 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:55.367637 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:55.367637 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:21:55.367637 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:21:55.367637 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:21:55.367637 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:21:55.368674 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:21:55.368674 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:21:55.368674 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:21:55.368674 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:21:55.368674 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:55.368674 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:55.368674 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:55.368674 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:55.368674 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:55.368674 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:55.368674 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:55.368674 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:55.368674 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:55.368674 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:55.368674 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:55.368674 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:55.369777 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:55.369777 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:55.369777 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:55.369777 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:55.369777 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:21:55.369777 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:21:55.369777 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:21:55.369777 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:21:55.369777 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:21:55.369777 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:21:55.369777 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 12:21:55.369777 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:55.369777 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 485/968] 10.222.0.16 () {56 vars in 1120 bytes} [Thu May 26 12:21:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:55.374885 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c83191-cde8-44ad-bd8f-2721a62e5310 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:55.487445 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c83191-cde8-44ad-bd8f-2721a62e5310 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:55.528049 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a5188-b49b-41ea-80e0-fc45dd76b997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:55.529076 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a5188-b49b-41ea-80e0-fc45dd76b997 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:55.529424 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a5188-b49b-41ea-80e0-fc45dd76b997 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:55.529823 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a5188-b49b-41ea-80e0-fc45dd76b997 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:55.530662 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0a5188-b49b-41ea-80e0-fc45dd76b997 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:55.531039 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0a5188-b49b-41ea-80e0-fc45dd76b997 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:55.532531 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0a5188-b49b-41ea-80e0-fc45dd76b997 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:55.541586 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 484/969] 10.222.0.16 () {56 vars in 1115 bytes} [Thu May 26 12:21:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:55.547316 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb86258-aa28-473e-ac12-350ee5c1d15d None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:55.647359 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb86258-aa28-473e-ac12-350ee5c1d15d None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:55.681323 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da7e4d-bb3b-4310-acd4-203cf7594b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:55.682206 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da7e4d-bb3b-4310-acd4-203cf7594b02 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:55.683138 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da7e4d-bb3b-4310-acd4-203cf7594b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:55.683486 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da7e4d-bb3b-4310-acd4-203cf7594b02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:55.694700 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37da7e4d-bb3b-4310-acd4-203cf7594b02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:55.696298 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37da7e4d-bb3b-4310-acd4-203cf7594b02 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:55.697147 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7079e-bb8b-4a2f-9775-002ad6218b5b None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:55.697442 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7079e-bb8b-4a2f-9775-002ad6218b5b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:55.697720 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7079e-bb8b-4a2f-9775-002ad6218b5b None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:55.699309 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 485/970] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:21:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:21:55.703905 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f026dd8-bc15-403c-8b49-14edfdc12032 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:55.704224 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f026dd8-bc15-403c-8b49-14edfdc12032 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:55.704505 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f026dd8-bc15-403c-8b49-14edfdc12032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:55.713768 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-37da7e4d-bb3b-4310-acd4-203cf7594b02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:55.713768 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:55.713768 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:55.713768 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:55.713768 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:55.713768 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:55.713768 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:55.713768 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:55.713768 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:55.713768 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:55.713768 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:55.713768 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:55.713768 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:21:55.713768 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:21:55.713768 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:21:55.714836 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:21:55.714836 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:55.714836 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:55.714836 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:55.714836 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:55.714836 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:55.714836 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:55.714836 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:55.714836 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:55.714836 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:55.714836 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:55.714836 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:55.714836 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:55.714836 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:55.714836 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:55.714836 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:55.714836 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:55.715979 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:21:55.715979 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:21:55.715979 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:55.715979 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:55.720983 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 486/971] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:21:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:55.721931 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da7e4d-bb3b-4310-acd4-203cf7594b02 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:55.726766 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-7f026dd8-bc15-403c-8b49-14edfdc12032 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:21:55.728288 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7f026dd8-bc15-403c-8b49-14edfdc12032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:21:55.745690 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:55.760785 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:55.809479 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 486/972] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:21:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:21:55.832006 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f026dd8-bc15-403c-8b49-14edfdc12032 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:55.833299 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da7e4d-bb3b-4310-acd4-203cf7594b02 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:55.869202 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda740f1-760c-48ab-8cd6-87dd80c4fbaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:55.869865 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda740f1-760c-48ab-8cd6-87dd80c4fbaf None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:55.870160 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda740f1-760c-48ab-8cd6-87dd80c4fbaf None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:55.870421 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda740f1-760c-48ab-8cd6-87dd80c4fbaf None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:55.871157 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda740f1-760c-48ab-8cd6-87dd80c4fbaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:55.871463 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda740f1-760c-48ab-8cd6-87dd80c4fbaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:55.872812 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda740f1-760c-48ab-8cd6-87dd80c4fbaf None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:55.885417 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 487/973] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:21:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:21:55.890576 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda740f1-760c-48ab-8cd6-87dd80c4fbaf None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:55.933324 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f026dd8-bc15-403c-8b49-14edfdc12032 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:55.970558 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a1bac-5efc-4597-98ec-84cdc6411444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:55.971203 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a1bac-5efc-4597-98ec-84cdc6411444 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:55.971497 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a1bac-5efc-4597-98ec-84cdc6411444 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:55.971778 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a1bac-5efc-4597-98ec-84cdc6411444 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:55.972500 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a1bac-5efc-4597-98ec-84cdc6411444 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:55.973917 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a1bac-5efc-4597-98ec-84cdc6411444 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:55.975990 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:55.989149 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 487/974] 10.222.0.16 () {60 vars in 1141 bytes} [Thu May 26 12:21:55 2022] POST /identity/v3/services => generated 242 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:21:56.004576 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda740f1-760c-48ab-8cd6-87dd80c4fbaf None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:56.050664 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b282f96-4272-4b33-86b8-a2233c220329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:56.051489 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b282f96-4272-4b33-86b8-a2233c220329 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:56.051763 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b282f96-4272-4b33-86b8-a2233c220329 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:56.052029 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b282f96-4272-4b33-86b8-a2233c220329 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:56.060537 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b282f96-4272-4b33-86b8-a2233c220329 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:56.062044 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b282f96-4272-4b33-86b8-a2233c220329 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:56.078869 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-8b282f96-4272-4b33-86b8-a2233c220329 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 12:21:56.078869 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:56.078869 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:56.078869 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:56.078869 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:56.078869 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:56.078869 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:56.078869 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:56.078869 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:56.078869 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:56.078869 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:56.078869 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:56.078869 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:21:56.078869 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:21:56.078869 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:21:56.078869 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:21:56.079971 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:56.079971 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:56.079971 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:21:56.079971 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:21:56.079971 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:21:56.079971 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:21:56.079971 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:56.079971 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:56.079971 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:56.079971 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:56.079971 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:56.079971 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:56.079971 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:56.079971 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:56.079971 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:56.079971 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:56.079971 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:56.079971 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:56.080972 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:56.080972 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:56.080972 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:21:56.080972 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:21:56.080972 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:21:56.080972 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:21:56.080972 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:21:56.080972 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:21:56.080972 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 12:21:56.080972 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:56.086864 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 488/975] 10.222.0.16 () {56 vars in 1117 bytes} [Thu May 26 12:21:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:21:56.087088 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a1bac-5efc-4597-98ec-84cdc6411444 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:56.108779 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:56.195615 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a1bac-5efc-4597-98ec-84cdc6411444 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:56.229874 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d932a5-9460-4424-bc25-867d11db4cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:56.230627 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d932a5-9460-4424-bc25-867d11db4cdb None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:56.230980 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d932a5-9460-4424-bc25-867d11db4cdb None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:56.231323 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d932a5-9460-4424-bc25-867d11db4cdb None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:56.232256 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d932a5-9460-4424-bc25-867d11db4cdb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:56.232692 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d932a5-9460-4424-bc25-867d11db4cdb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:56.234167 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d932a5-9460-4424-bc25-867d11db4cdb None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:56.251929 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 488/976] 10.222.0.16 () {56 vars in 1149 bytes} [Thu May 26 12:21:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:56.257788 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b282f96-4272-4b33-86b8-a2233c220329 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:56.356951 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b282f96-4272-4b33-86b8-a2233c220329 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:56.391243 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e46f98-6003-4033-b523-fe252de81f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:56.392058 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e46f98-6003-4033-b523-fe252de81f3f None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:56.392444 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e46f98-6003-4033-b523-fe252de81f3f None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:56.392819 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e46f98-6003-4033-b523-fe252de81f3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:56.396594 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:56.462551 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e46f98-6003-4033-b523-fe252de81f3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:56.464160 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e46f98-6003-4033-b523-fe252de81f3f None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:56.568947 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 489/977] 10.222.0.16 () {58 vars in 1282 bytes} [Thu May 26 12:21:56 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:21:56.570495 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d932a5-9460-4424-bc25-867d11db4cdb None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:56.648487 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:56.672984 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d932a5-9460-4424-bc25-867d11db4cdb None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:56.707240 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ee72f-c40a-40c5-b0aa-04671fe5c95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:56.708173 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ee72f-c40a-40c5-b0aa-04671fe5c95f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:56.708557 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ee72f-c40a-40c5-b0aa-04671fe5c95f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:56.708961 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ee72f-c40a-40c5-b0aa-04671fe5c95f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:56.718918 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06ee72f-c40a-40c5-b0aa-04671fe5c95f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:56.721285 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06ee72f-c40a-40c5-b0aa-04671fe5c95f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:56.738638 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-f06ee72f-c40a-40c5-b0aa-04671fe5c95f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:56.738638 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:56.738638 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:56.738638 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:56.738638 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:56.738638 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:56.738638 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:56.738638 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:56.738638 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:56.738638 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:56.738638 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:56.738638 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:56.738638 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:21:56.738638 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:21:56.738638 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:21:56.739764 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:21:56.739764 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:56.739764 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:56.739764 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:56.739764 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:56.739764 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:56.739764 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:56.739764 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:56.739764 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:56.739764 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:56.739764 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:56.739764 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:56.739764 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:56.739764 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:56.739764 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:56.739764 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:56.739764 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:56.742948 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:21:56.742948 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:21:56.742948 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:56.742948 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:56.742948 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 489/978] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:21:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:56.752599 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e46f98-6003-4033-b523-fe252de81f3f None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:56.791508 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:56.861260 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e46f98-6003-4033-b523-fe252de81f3f None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:56.898660 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b008241d-f7ad-4ebf-9145-ca4dccf75e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:56.899571 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008241d-f7ad-4ebf-9145-ca4dccf75e38 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:56.900007 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008241d-f7ad-4ebf-9145-ca4dccf75e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:56.900430 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008241d-f7ad-4ebf-9145-ca4dccf75e38 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:56.901346 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b008241d-f7ad-4ebf-9145-ca4dccf75e38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:56.901800 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b008241d-f7ad-4ebf-9145-ca4dccf75e38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:56.903332 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b008241d-f7ad-4ebf-9145-ca4dccf75e38 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:56.914774 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 490/979] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:21:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:56.920368 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ee72f-c40a-40c5-b0aa-04671fe5c95f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:57.021730 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ee72f-c40a-40c5-b0aa-04671fe5c95f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:57.043984 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3658c6-d318-43f7-b819-e25d2cfdf1da None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:57.044478 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3658c6-d318-43f7-b819-e25d2cfdf1da None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:57.044571 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3658c6-d318-43f7-b819-e25d2cfdf1da None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:57.046097 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 491/980] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:21:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:21:57.048757 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:57.051268 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e374b9-76e4-4564-b373-fa7aa5ac62f8 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:57.051559 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e374b9-76e4-4564-b373-fa7aa5ac62f8 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:57.051879 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e374b9-76e4-4564-b373-fa7aa5ac62f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:57.059251 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87120547-0c58-412b-a7c3-6e3c91f57951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:57.060044 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87120547-0c58-412b-a7c3-6e3c91f57951 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:57.060326 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87120547-0c58-412b-a7c3-6e3c91f57951 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:57.060600 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87120547-0c58-412b-a7c3-6e3c91f57951 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:57.068421 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87120547-0c58-412b-a7c3-6e3c91f57951 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:57.068780 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-d3e374b9-76e4-4564-b373-fa7aa5ac62f8 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:21:57.069902 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87120547-0c58-412b-a7c3-6e3c91f57951 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:57.070004 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-d3e374b9-76e4-4564-b373-fa7aa5ac62f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:21:57.083954 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-87120547-0c58-412b-a7c3-6e3c91f57951 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:21:57.083954 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:57.083954 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:57.083954 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:57.083954 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:57.083954 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:57.083954 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:57.083954 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:57.083954 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:57.083954 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:57.083954 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:57.083954 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:57.083954 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:21:57.083954 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:21:57.083954 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:21:57.084894 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:21:57.084894 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:57.084894 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:57.084894 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:57.084894 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:57.084894 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:57.084894 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:57.084894 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:57.084894 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:21:57.084894 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:57.084894 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:57.084894 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:57.084894 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:57.084894 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:57.084894 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:57.084894 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:57.084894 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:57.085843 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:21:57.085843 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:21:57.085843 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:21:57.085843 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:21:57.085843 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:21:57.085843 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:21:57.085843 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:21:57.085843 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:21:57.085843 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 490/981] 10.222.0.16 () {56 vars in 1111 bytes} [Thu May 26 12:21:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:57.090665 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87120547-0c58-412b-a7c3-6e3c91f57951 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:57.149296 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 492/982] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:21:57 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:21:57.170769 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e374b9-76e4-4564-b373-fa7aa5ac62f8 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:57.197187 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87120547-0c58-412b-a7c3-6e3c91f57951 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:57.199651 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:57.233057 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4736bf2b-682b-4062-ad3e-e204b20e9b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:57.233723 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736bf2b-682b-4062-ad3e-e204b20e9b82 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:57.234010 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736bf2b-682b-4062-ad3e-e204b20e9b82 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:57.234288 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736bf2b-682b-4062-ad3e-e204b20e9b82 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:57.235073 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4736bf2b-682b-4062-ad3e-e204b20e9b82 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:57.235921 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4736bf2b-682b-4062-ad3e-e204b20e9b82 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:57.237404 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4736bf2b-682b-4062-ad3e-e204b20e9b82 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:57.250366 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 491/983] 10.222.0.16 () {56 vars in 1148 bytes} [Thu May 26 12:21:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:21:57.256472 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4736bf2b-682b-4062-ad3e-e204b20e9b82 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:57.277344 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e374b9-76e4-4564-b373-fa7aa5ac62f8 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:57.307315 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:57.314646 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e37a0-27bc-444f-adc6-017572f16601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:57.315449 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e37a0-27bc-444f-adc6-017572f16601 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:57.315727 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e37a0-27bc-444f-adc6-017572f16601 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:57.316002 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e37a0-27bc-444f-adc6-017572f16601 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:57.316644 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279e37a0-27bc-444f-adc6-017572f16601 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:57.318116 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279e37a0-27bc-444f-adc6-017572f16601 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:57.330013 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-279e37a0-27bc-444f-adc6-017572f16601 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:21:57.330013 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:57.330013 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:21:57.330013 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:21:57.330013 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:21:57.330013 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:21:57.330013 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:21:57.330013 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:21:57.330013 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:21:57.330013 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:57.330013 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:21:57.330013 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:57.330013 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:57.330013 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:57.330013 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:57.330013 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:57.330013 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:57.331016 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:57.331016 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:57.331016 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:57.331016 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:57.331016 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:57.331016 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:57.331016 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:21:57.331016 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:21:57.331016 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:21:57.331016 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:21:57.331016 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:57.331016 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:57.331016 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:57.331016 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:57.331016 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:57.331016 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:57.331866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:57.331866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:57.331866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:57.331866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:57.331866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:57.331866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:57.331866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:57.331866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:57.331866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:57.331866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:57.331866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:21:57.331866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:21:57.331866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:21:57.331866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:57.331866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 493/984] 10.222.0.16 () {56 vars in 1126 bytes} [Thu May 26 12:21:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:21:57.337032 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e37a0-27bc-444f-adc6-017572f16601 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:57.364414 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4736bf2b-682b-4062-ad3e-e204b20e9b82 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:57.397998 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66dffb7-6764-484d-9f19-5f1e515305eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:57.398636 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66dffb7-6764-484d-9f19-5f1e515305eb None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:57.398914 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66dffb7-6764-484d-9f19-5f1e515305eb None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:57.399189 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66dffb7-6764-484d-9f19-5f1e515305eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:57.400062 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66dffb7-6764-484d-9f19-5f1e515305eb None admin] RBAC: Adding query filter params (role.id=d2c069ef8eed4c73a7fa3aa932c60945, scope.project.id=42e6c693bd224d92b8a0fe4ad0cc586d, user.id=512b4337083145f9ae57948a63444ced) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:57.400317 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66dffb7-6764-484d-9f19-5f1e515305eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:57.401787 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66dffb7-6764-484d-9f19-5f1e515305eb None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:57.407817 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 492/985] 10.222.0.16 () {56 vars in 1374 bytes} [Thu May 26 12:21:57 2022] GET /identity/v3/role_assignments?user.id=512b4337083145f9ae57948a63444ced&scope.project.id=42e6c693bd224d92b8a0fe4ad0cc586d&role.id=d2c069ef8eed4c73a7fa3aa932c60945 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:21:57.446432 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:57.457593 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e37a0-27bc-444f-adc6-017572f16601 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:57.494749 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb0944-bd9c-4843-a625-6f2d7598caff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:57.495485 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb0944-bd9c-4843-a625-6f2d7598caff None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:57.495774 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb0944-bd9c-4843-a625-6f2d7598caff None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:57.496049 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb0944-bd9c-4843-a625-6f2d7598caff None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:57.496784 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb0944-bd9c-4843-a625-6f2d7598caff None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:57.497130 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb0944-bd9c-4843-a625-6f2d7598caff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:57.498538 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb0944-bd9c-4843-a625-6f2d7598caff None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:57.509695 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 494/986] 10.222.0.16 () {56 vars in 1122 bytes} [Thu May 26 12:21:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:21:57.510564 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66dffb7-6764-484d-9f19-5f1e515305eb None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:57.618982 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66dffb7-6764-484d-9f19-5f1e515305eb None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:57.633433 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:57.656909 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98405c42-ca5e-4a3b-9f7d-b47956993958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:57.658050 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98405c42-ca5e-4a3b-9f7d-b47956993958 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:57.658332 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98405c42-ca5e-4a3b-9f7d-b47956993958 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:57.658606 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98405c42-ca5e-4a3b-9f7d-b47956993958 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:57.659311 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98405c42-ca5e-4a3b-9f7d-b47956993958 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:57.659616 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98405c42-ca5e-4a3b-9f7d-b47956993958 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:57.661046 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98405c42-ca5e-4a3b-9f7d-b47956993958 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:57.666509 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 493/987] 10.222.0.16 () {56 vars in 1122 bytes} [Thu May 26 12:21:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:21:57.672434 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb0944-bd9c-4843-a625-6f2d7598caff None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:57.775725 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb0944-bd9c-4843-a625-6f2d7598caff None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:57.811282 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e20c75-3753-4676-83aa-d67dd0cb9905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:57.811937 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e20c75-3753-4676-83aa-d67dd0cb9905 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:57.812219 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e20c75-3753-4676-83aa-d67dd0cb9905 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:57.812493 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e20c75-3753-4676-83aa-d67dd0cb9905 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:57.813320 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e20c75-3753-4676-83aa-d67dd0cb9905 None admin] RBAC: Adding query filter params (interface=admin, service_id=782332459dcc48af9184566972d5312e, region_id=RegionOne) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:57.813660 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e20c75-3753-4676-83aa-d67dd0cb9905 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:57.815022 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e20c75-3753-4676-83aa-d67dd0cb9905 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:57.824865 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 495/988] 10.222.0.16 () {56 vars in 1249 bytes} [Thu May 26 12:21:57 2022] GET /identity/v3/endpoints?service_id=782332459dcc48af9184566972d5312e&interface=admin®ion_id=RegionOne => generated 193 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:21:57.826249 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98405c42-ca5e-4a3b-9f7d-b47956993958 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:57.929937 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98405c42-ca5e-4a3b-9f7d-b47956993958 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:57.965387 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb1d52-b2c3-4b02-9017-0344fab84755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:57.966058 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb1d52-b2c3-4b02-9017-0344fab84755 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:57.966344 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb1d52-b2c3-4b02-9017-0344fab84755 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:57.966622 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb1d52-b2c3-4b02-9017-0344fab84755 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:57.967309 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb1d52-b2c3-4b02-9017-0344fab84755 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:57.968748 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb1d52-b2c3-4b02-9017-0344fab84755 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:57.977161 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 494/989] 10.222.0.16 () {56 vars in 1087 bytes} [Thu May 26 12:21:57 2022] GET /identity/v3/services => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:21:58.231997 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0a930-45f2-4b25-bdff-8a8c92cad78c None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:58.232526 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0a930-45f2-4b25-bdff-8a8c92cad78c None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:58.232609 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0a930-45f2-4b25-bdff-8a8c92cad78c None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:58.234101 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 496/990] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:21:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:21:58.239267 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab544b-f692-4fda-b872-2d562ce52025 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:58.239651 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab544b-f692-4fda-b872-2d562ce52025 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:58.239828 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab544b-f692-4fda-b872-2d562ce52025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:58.256753 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-6eab544b-f692-4fda-b872-2d562ce52025 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:21:58.257965 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6eab544b-f692-4fda-b872-2d562ce52025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:21:58.293628 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:58.327860 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 495/991] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:21:58 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:21:58.350943 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b0a930-45f2-4b25-bdff-8a8c92cad78c None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:58.370632 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:58.454910 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b0a930-45f2-4b25-bdff-8a8c92cad78c None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:58.488491 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede893a6-2d3c-41ca-af3e-7a3e6d5f28db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:58.489242 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede893a6-2d3c-41ca-af3e-7a3e6d5f28db None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:58.489529 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede893a6-2d3c-41ca-af3e-7a3e6d5f28db None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:58.489804 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede893a6-2d3c-41ca-af3e-7a3e6d5f28db None admin] PATH_INFO: `/v3/services/compute` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:58.490450 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede893a6-2d3c-41ca-af3e-7a3e6d5f28db None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:58.491822 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede893a6-2d3c-41ca-af3e-7a3e6d5f28db None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:58.504033 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-ede893a6-2d3c-41ca-af3e-7a3e6d5f28db None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 26 12:21:58.504033 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:58.504033 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:21:58.504033 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:21:58.504033 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:21:58.504033 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:21:58.504033 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:21:58.504033 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:21:58.504033 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 12:21:58.504033 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:58.504033 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:21:58.504033 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:58.504033 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:58.504033 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:58.504033 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:58.504033 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:58.504033 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:58.505288 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:58.505288 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:58.505288 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:58.505288 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:58.505288 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:58.505288 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:58.505288 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:21:58.505288 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:21:58.505288 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:21:58.505288 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:21:58.505288 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:58.505288 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:58.505288 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:58.505288 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:58.505288 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:58.505288 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:58.506270 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:58.506270 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:21:58.506270 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:58.506270 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:58.506270 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:58.506270 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:58.506270 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:58.506270 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:58.506270 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:58.506270 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:58.506270 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:21:58.506270 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:21:58.506270 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 12:21:58.506270 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:21:58.508929 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 497/992] 10.222.0.16 () {56 vars in 1111 bytes} [Thu May 26 12:21:58 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:58.511553 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab544b-f692-4fda-b872-2d562ce52025 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:58.609688 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab544b-f692-4fda-b872-2d562ce52025 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:58.644541 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3898d7a7-8966-494a-8260-c85d222d8cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:58.645234 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898d7a7-8966-494a-8260-c85d222d8cc4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:58.645520 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898d7a7-8966-494a-8260-c85d222d8cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:58.645796 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898d7a7-8966-494a-8260-c85d222d8cc4 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:58.646504 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3898d7a7-8966-494a-8260-c85d222d8cc4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:58.646810 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3898d7a7-8966-494a-8260-c85d222d8cc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:58.648185 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3898d7a7-8966-494a-8260-c85d222d8cc4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:58.653218 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 496/993] 10.222.0.16 () {56 vars in 1112 bytes} [Thu May 26 12:21:58 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:21:58.659341 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede893a6-2d3c-41ca-af3e-7a3e6d5f28db None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:58.741042 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:58.769417 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede893a6-2d3c-41ca-af3e-7a3e6d5f28db None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:58.802995 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d6a735-5211-4a4a-92be-15e6fd63db28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:58.803651 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6a735-5211-4a4a-92be-15e6fd63db28 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:58.803933 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6a735-5211-4a4a-92be-15e6fd63db28 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:58.804208 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6a735-5211-4a4a-92be-15e6fd63db28 None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:58.804944 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d6a735-5211-4a4a-92be-15e6fd63db28 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:58.805258 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d6a735-5211-4a4a-92be-15e6fd63db28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:58.806614 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d6a735-5211-4a4a-92be-15e6fd63db28 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:58.811580 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 498/994] 10.222.0.16 () {56 vars in 1112 bytes} [Thu May 26 12:21:58 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:58.817321 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3898d7a7-8966-494a-8260-c85d222d8cc4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:58.852320 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:58.920192 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3898d7a7-8966-494a-8260-c85d222d8cc4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:58.953351 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc842b57-b1d3-4ddd-bd11-c4db60fceb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:58.954008 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc842b57-b1d3-4ddd-bd11-c4db60fceb60 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:58.954856 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc842b57-b1d3-4ddd-bd11-c4db60fceb60 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:58.955137 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc842b57-b1d3-4ddd-bd11-c4db60fceb60 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:58.955926 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc842b57-b1d3-4ddd-bd11-c4db60fceb60 None admin] RBAC: Adding query filter params (interface=public, service_id=d78659e5d1b24c11842ee7bd0755fa73, region_id=RegionOne) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:58.956240 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc842b57-b1d3-4ddd-bd11-c4db60fceb60 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:58.957648 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc842b57-b1d3-4ddd-bd11-c4db60fceb60 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:58.962982 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 497/995] 10.222.0.16 () {56 vars in 1251 bytes} [Thu May 26 12:21:58 2022] GET /identity/v3/endpoints?service_id=d78659e5d1b24c11842ee7bd0755fa73&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:58.968382 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d6a735-5211-4a4a-92be-15e6fd63db28 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:59.068652 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d6a735-5211-4a4a-92be-15e6fd63db28 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:59.101983 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed7b274-f50a-465b-a10b-85adb3983a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:59.102644 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7b274-f50a-465b-a10b-85adb3983a8a None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:59.102928 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7b274-f50a-465b-a10b-85adb3983a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:59.103206 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7b274-f50a-465b-a10b-85adb3983a8a None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:59.103882 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed7b274-f50a-465b-a10b-85adb3983a8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:59.105340 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed7b274-f50a-465b-a10b-85adb3983a8a None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:59.112313 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 499/996] 10.222.0.16 () {56 vars in 1087 bytes} [Thu May 26 12:21:58 2022] GET /identity/v3/services => generated 1727 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:22:00.059698 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe5b23-ceeb-48d6-862b-2f014cbaef9c None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:00.060242 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe5b23-ceeb-48d6-862b-2f014cbaef9c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:00.060242 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe5b23-ceeb-48d6-862b-2f014cbaef9c None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:00.061597 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 498/997] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:22:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:22:00.066717 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940300b3-ebf7-4386-8829-a951726334e9 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:00.067108 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940300b3-ebf7-4386-8829-a951726334e9 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:00.067284 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940300b3-ebf7-4386-8829-a951726334e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:00.084002 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-940300b3-ebf7-4386-8829-a951726334e9 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:22:00.085203 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-940300b3-ebf7-4386-8829-a951726334e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:22:00.087962 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:00.154011 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 500/998] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:22:00 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:22:00.176222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe5b23-ceeb-48d6-862b-2f014cbaef9c None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:00.275449 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:00.281495 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe5b23-ceeb-48d6-862b-2f014cbaef9c None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:00.315595 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c90e25f-1b87-4ecb-9e01-0366522dd6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:00.316296 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90e25f-1b87-4ecb-9e01-0366522dd6cf None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:00.316574 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90e25f-1b87-4ecb-9e01-0366522dd6cf None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:00.316867 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90e25f-1b87-4ecb-9e01-0366522dd6cf None admin] PATH_INFO: `/v3/services/image` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:00.317590 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c90e25f-1b87-4ecb-9e01-0366522dd6cf None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:00.319090 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c90e25f-1b87-4ecb-9e01-0366522dd6cf None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:00.331198 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-6c90e25f-1b87-4ecb-9e01-0366522dd6cf None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 26 12:22:00.331198 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:00.331198 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:22:00.331198 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:22:00.331198 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:22:00.331198 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:22:00.331198 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:22:00.331198 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:22:00.331198 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 12:22:00.331198 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:22:00.331198 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:22:00.331198 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:22:00.331198 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:00.331198 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:22:00.331198 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:22:00.331198 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:22:00.331198 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:22:00.332258 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:22:00.332258 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:22:00.332258 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:22:00.332258 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:22:00.332258 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:22:00.332258 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:22:00.332258 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:22:00.332258 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:22:00.332258 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:22:00.332258 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:22:00.332258 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:22:00.332258 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:22:00.332258 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:22:00.332258 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:22:00.332258 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:22:00.332258 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:22:00.333136 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:22:00.333136 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:22:00.333136 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:22:00.333136 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:22:00.333136 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:22:00.333136 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:22:00.333136 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:22:00.333136 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:22:00.333136 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:22:00.333136 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:22:00.333136 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:22:00.333136 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:22:00.333136 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 12:22:00.333136 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:22:00.337005 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 499/999] 10.222.0.16 () {56 vars in 1105 bytes} [Thu May 26 12:22:00 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:22:00.338525 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940300b3-ebf7-4386-8829-a951726334e9 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:00.442243 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940300b3-ebf7-4386-8829-a951726334e9 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:00.477096 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c3c79b-4442-4e0a-9cb4-2e5213c80621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:00.477962 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3c79b-4442-4e0a-9cb4-2e5213c80621 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:00.478245 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3c79b-4442-4e0a-9cb4-2e5213c80621 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:00.478514 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3c79b-4442-4e0a-9cb4-2e5213c80621 None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:00.479216 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c3c79b-4442-4e0a-9cb4-2e5213c80621 None admin] RBAC: Adding query filter params (name=image) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:00.479516 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c3c79b-4442-4e0a-9cb4-2e5213c80621 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:00.480889 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c3c79b-4442-4e0a-9cb4-2e5213c80621 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:00.491746 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 501/1000] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:22:00 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:00.491885 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c90e25f-1b87-4ecb-9e01-0366522dd6cf None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:00.550673 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c1d33-15ef-4bb9-b17e-4e1ea10f88bc None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:00.551020 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c1d33-15ef-4bb9-b17e-4e1ea10f88bc None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:00.551244 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c1d33-15ef-4bb9-b17e-4e1ea10f88bc None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:00.552758 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 502/1001] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:22:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:22:00.557498 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6c11d-95b8-43e0-839c-55fe3fdc9ef9 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:00.557786 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6c11d-95b8-43e0-839c-55fe3fdc9ef9 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:00.558062 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6c11d-95b8-43e0-839c-55fe3fdc9ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:00.564378 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:00.577201 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-44b6c11d-95b8-43e0-839c-55fe3fdc9ef9 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:22:00.578296 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-44b6c11d-95b8-43e0-839c-55fe3fdc9ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:22:00.597440 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c90e25f-1b87-4ecb-9e01-0366522dd6cf None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:00.634313 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff7b81f-39ca-45c2-85d8-445b5de3349a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:00.635290 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff7b81f-39ca-45c2-85d8-445b5de3349a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:00.635758 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff7b81f-39ca-45c2-85d8-445b5de3349a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:00.636210 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff7b81f-39ca-45c2-85d8-445b5de3349a None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:00.637325 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff7b81f-39ca-45c2-85d8-445b5de3349a None admin] RBAC: Adding query filter params (type=image) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:00.637637 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff7b81f-39ca-45c2-85d8-445b5de3349a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:00.639025 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff7b81f-39ca-45c2-85d8-445b5de3349a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:00.652871 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 500/1002] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:22:00 2022] GET /identity/v3/services?type=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:00.653104 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 503/1003] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:22:00 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:22:00.670863 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff7b81f-39ca-45c2-85d8-445b5de3349a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:00.702098 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:00.793250 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff7b81f-39ca-45c2-85d8-445b5de3349a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:00.829056 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f8459-e5d7-40d8-ae64-71aa21beb3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:00.830355 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f8459-e5d7-40d8-ae64-71aa21beb3f6 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:00.830641 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f8459-e5d7-40d8-ae64-71aa21beb3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:00.830917 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f8459-e5d7-40d8-ae64-71aa21beb3f6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:00.831574 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89f8459-e5d7-40d8-ae64-71aa21beb3f6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:00.832984 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89f8459-e5d7-40d8-ae64-71aa21beb3f6 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:00.846516 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-e89f8459-e5d7-40d8-ae64-71aa21beb3f6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:22:00.846516 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:00.846516 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:22:00.846516 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:22:00.846516 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:22:00.846516 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:22:00.846516 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:22:00.846516 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:22:00.846516 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:22:00.846516 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:22:00.846516 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:22:00.846516 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:22:00.846516 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:00.846516 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:22:00.846516 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:22:00.846516 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:22:00.846516 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:22:00.847728 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:22:00.847728 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:22:00.847728 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:22:00.847728 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:22:00.847728 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:22:00.847728 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:22:00.847728 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:22:00.847728 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:22:00.847728 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:22:00.847728 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:22:00.847728 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:22:00.847728 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:22:00.847728 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:22:00.847728 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:22:00.847728 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:22:00.847728 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:22:00.848687 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:22:00.848687 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:22:00.848687 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:22:00.848687 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:22:00.848687 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:22:00.848687 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:22:00.848687 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:22:00.848687 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:22:00.848687 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:22:00.848687 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:22:00.848687 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:22:00.848687 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:22:00.848687 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:22:00.848687 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:22:00.848687 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 501/1004] 10.222.0.16 () {56 vars in 1126 bytes} [Thu May 26 12:22:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:22:00.853850 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b6c11d-95b8-43e0-839c-55fe3fdc9ef9 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:00.955457 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b6c11d-95b8-43e0-839c-55fe3fdc9ef9 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:00.990763 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecae587-9f7b-42d2-9236-91b19246fdf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:00.991422 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecae587-9f7b-42d2-9236-91b19246fdf8 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:00.991704 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecae587-9f7b-42d2-9236-91b19246fdf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:00.991976 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecae587-9f7b-42d2-9236-91b19246fdf8 None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:00.992679 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecae587-9f7b-42d2-9236-91b19246fdf8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:00.993021 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecae587-9f7b-42d2-9236-91b19246fdf8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:00.994380 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecae587-9f7b-42d2-9236-91b19246fdf8 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:00.995555 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:01.006033 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 504/1005] 10.222.0.16 () {56 vars in 1122 bytes} [Thu May 26 12:22:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:01.007175 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f8459-e5d7-40d8-ae64-71aa21beb3f6 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:01.098757 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:01.109643 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f8459-e5d7-40d8-ae64-71aa21beb3f6 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:01.149726 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368f184-4c6b-44ad-88de-006ab05e0e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:01.150800 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368f184-4c6b-44ad-88de-006ab05e0e47 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:01.151284 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368f184-4c6b-44ad-88de-006ab05e0e47 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:01.151759 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368f184-4c6b-44ad-88de-006ab05e0e47 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:01.152700 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8368f184-4c6b-44ad-88de-006ab05e0e47 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:01.153238 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8368f184-4c6b-44ad-88de-006ab05e0e47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:01.154836 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8368f184-4c6b-44ad-88de-006ab05e0e47 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:01.160498 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 502/1006] 10.222.0.16 () {56 vars in 1122 bytes} [Thu May 26 12:22:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:22:01.166375 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecae587-9f7b-42d2-9236-91b19246fdf8 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:01.269326 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecae587-9f7b-42d2-9236-91b19246fdf8 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:01.303681 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc78ea72-fda6-4c29-9e72-de50b18d5dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:01.304341 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78ea72-fda6-4c29-9e72-de50b18d5dbe None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:01.304625 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78ea72-fda6-4c29-9e72-de50b18d5dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:01.304929 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78ea72-fda6-4c29-9e72-de50b18d5dbe None admin] PATH_INFO: `/v3/endpoints` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:01.305665 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc78ea72-fda6-4c29-9e72-de50b18d5dbe None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:01.307061 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc78ea72-fda6-4c29-9e72-de50b18d5dbe None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:01.318196 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d332a-9d8c-416e-9126-f7c0224f1ade None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:01.318570 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d332a-9d8c-416e-9126-f7c0224f1ade None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:01.319058 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d332a-9d8c-416e-9126-f7c0224f1ade None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:01.320736 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 503/1007] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:22:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:22:01.325635 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ab227-84d9-4191-8118-e61f15995a3d None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:01.325947 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ab227-84d9-4191-8118-e61f15995a3d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:01.326224 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ab227-84d9-4191-8118-e61f15995a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:01.329305 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 505/1008] 10.222.0.16 () {60 vars in 1144 bytes} [Thu May 26 12:22:01 2022] POST /identity/v3/endpoints => generated 325 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:22:01.344139 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-9d0ab227-84d9-4191-8118-e61f15995a3d None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:22:01.346207 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9d0ab227-84d9-4191-8118-e61f15995a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:22:01.433343 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 504/1009] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:22:01 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:22:01.451242 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc78ea72-fda6-4c29-9e72-de50b18d5dbe None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:01.516220 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:01.565044 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc78ea72-fda6-4c29-9e72-de50b18d5dbe None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:01.599636 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff91e09a-a973-4afc-96e6-b87fc54c65dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:01.600437 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff91e09a-a973-4afc-96e6-b87fc54c65dd None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:01.600719 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff91e09a-a973-4afc-96e6-b87fc54c65dd None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:01.601031 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff91e09a-a973-4afc-96e6-b87fc54c65dd None admin] PATH_INFO: `/v3/services/compute` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:01.601688 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff91e09a-a973-4afc-96e6-b87fc54c65dd None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:01.603045 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff91e09a-a973-4afc-96e6-b87fc54c65dd None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:01.615495 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-ff91e09a-a973-4afc-96e6-b87fc54c65dd None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 26 12:22:01.615495 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:01.615495 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:22:01.615495 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:22:01.615495 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:22:01.615495 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:22:01.615495 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:22:01.615495 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:22:01.615495 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 12:22:01.615495 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:22:01.615495 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:22:01.615495 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:22:01.615495 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:01.615495 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:22:01.615495 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:22:01.615495 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:22:01.615495 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:22:01.616480 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:22:01.616480 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:22:01.616480 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:22:01.616480 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:22:01.616480 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:22:01.616480 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:22:01.616480 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:22:01.616480 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:22:01.616480 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:22:01.616480 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:22:01.616480 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:22:01.616480 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:22:01.616480 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:22:01.616480 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:22:01.616480 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:22:01.616480 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:22:01.617399 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:22:01.617399 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:22:01.617399 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:22:01.617399 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:22:01.617399 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:22:01.617399 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:22:01.617399 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:22:01.617399 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:22:01.617399 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:22:01.617399 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:22:01.617399 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:22:01.617399 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:22:01.617399 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 12:22:01.617399 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:22:01.617399 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 506/1010] 10.222.0.16 () {56 vars in 1111 bytes} [Thu May 26 12:22:01 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:22:01.622986 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ab227-84d9-4191-8118-e61f15995a3d None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:01.707334 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:01.728592 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ab227-84d9-4191-8118-e61f15995a3d None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:01.766015 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f5b55c-2068-4b11-a0ca-d3fc881c35da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:01.767242 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f5b55c-2068-4b11-a0ca-d3fc881c35da None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:01.767530 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f5b55c-2068-4b11-a0ca-d3fc881c35da None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:01.767804 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f5b55c-2068-4b11-a0ca-d3fc881c35da None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:01.768525 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f5b55c-2068-4b11-a0ca-d3fc881c35da None admin] RBAC: Adding query filter params (name=compute) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:01.768851 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f5b55c-2068-4b11-a0ca-d3fc881c35da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:01.770294 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f5b55c-2068-4b11-a0ca-d3fc881c35da None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:01.780112 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 505/1011] 10.222.0.16 () {56 vars in 1112 bytes} [Thu May 26 12:22:01 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:01.781387 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff91e09a-a973-4afc-96e6-b87fc54c65dd None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:01.886442 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff91e09a-a973-4afc-96e6-b87fc54c65dd None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:01.909595 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:01.921733 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b35c487-177d-484d-8dae-2f80c1b1189e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:01.922396 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35c487-177d-484d-8dae-2f80c1b1189e None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:01.922677 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35c487-177d-484d-8dae-2f80c1b1189e None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:01.922979 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35c487-177d-484d-8dae-2f80c1b1189e None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:01.923684 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b35c487-177d-484d-8dae-2f80c1b1189e None admin] RBAC: Adding query filter params (type=compute) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:01.923986 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b35c487-177d-484d-8dae-2f80c1b1189e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:01.925375 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b35c487-177d-484d-8dae-2f80c1b1189e None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:01.935036 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 507/1012] 10.222.0.16 () {56 vars in 1112 bytes} [Thu May 26 12:22:01 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:01.935816 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f5b55c-2068-4b11-a0ca-d3fc881c35da None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:02.034782 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f5b55c-2068-4b11-a0ca-d3fc881c35da None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:02.068161 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bae48ed-373d-4043-9dc6-7645be95c32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:02.068817 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae48ed-373d-4043-9dc6-7645be95c32b None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:02.069126 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae48ed-373d-4043-9dc6-7645be95c32b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:02.069401 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae48ed-373d-4043-9dc6-7645be95c32b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:02.070139 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bae48ed-373d-4043-9dc6-7645be95c32b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:02.071512 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bae48ed-373d-4043-9dc6-7645be95c32b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:02.088168 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:02.104876 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 506/1013] 10.222.0.16 () {60 vars in 1144 bytes} [Thu May 26 12:22:01 2022] POST /identity/v3/endpoints => generated 334 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:22:02.864478 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aebe38e-cfca-4f0e-aece-52894d4056c8 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:02.865029 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aebe38e-cfca-4f0e-aece-52894d4056c8 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:02.865139 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aebe38e-cfca-4f0e-aece-52894d4056c8 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:02.866588 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 508/1014] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:22:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:22:02.871771 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ad613-62eb-44e4-90eb-10ac443cce35 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:02.872071 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ad613-62eb-44e4-90eb-10ac443cce35 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:02.872351 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ad613-62eb-44e4-90eb-10ac443cce35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:02.889230 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-157ad613-62eb-44e4-90eb-10ac443cce35 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:22:02.890415 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-157ad613-62eb-44e4-90eb-10ac443cce35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:22:02.963830 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 507/1015] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:22:02 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:22:02.987517 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aebe38e-cfca-4f0e-aece-52894d4056c8 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:03.088891 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aebe38e-cfca-4f0e-aece-52894d4056c8 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:03.123280 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a49b8c8-e828-4dce-b411-13fd9edd291b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:03.123934 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49b8c8-e828-4dce-b411-13fd9edd291b None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:03.124214 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49b8c8-e828-4dce-b411-13fd9edd291b None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:03.124489 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49b8c8-e828-4dce-b411-13fd9edd291b None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:03.125242 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a49b8c8-e828-4dce-b411-13fd9edd291b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:03.126635 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a49b8c8-e828-4dce-b411-13fd9edd291b None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:03.141820 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 509/1016] 10.222.0.16 () {60 vars in 1141 bytes} [Thu May 26 12:22:02 2022] POST /identity/v3/services => generated 242 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:22:03.582344 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965344e-1468-4824-9f96-01c9956a5248 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:03.582869 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965344e-1468-4824-9f96-01c9956a5248 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:03.582869 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965344e-1468-4824-9f96-01c9956a5248 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:03.584282 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 508/1017] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:22:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:22:03.589511 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd1ca7-7690-4ea8-9adb-9ff942f82ca3 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:03.589802 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd1ca7-7690-4ea8-9adb-9ff942f82ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:03.590076 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd1ca7-7690-4ea8-9adb-9ff942f82ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:03.606999 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-66cd1ca7-7690-4ea8-9adb-9ff942f82ca3 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:22:03.608171 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-66cd1ca7-7690-4ea8-9adb-9ff942f82ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:22:03.650953 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:03.683279 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 510/1018] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:22:03 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:22:03.707580 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7965344e-1468-4824-9f96-01c9956a5248 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:03.815122 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7965344e-1468-4824-9f96-01c9956a5248 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:03.841189 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:03.851161 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4109fd6a-0011-4808-867d-c4f7b200712f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:03.851955 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4109fd6a-0011-4808-867d-c4f7b200712f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:03.852235 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4109fd6a-0011-4808-867d-c4f7b200712f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:03.852511 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4109fd6a-0011-4808-867d-c4f7b200712f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:03.853717 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4109fd6a-0011-4808-867d-c4f7b200712f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:03.855206 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4109fd6a-0011-4808-867d-c4f7b200712f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:03.857002 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 509/1019] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:22:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:03.862717 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd1ca7-7690-4ea8-9adb-9ff942f82ca3 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:03.962186 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd1ca7-7690-4ea8-9adb-9ff942f82ca3 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:03.996639 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7acdf20-90ff-4e77-836a-4be1dbb71488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:03.997318 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7acdf20-90ff-4e77-836a-4be1dbb71488 None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:03.997600 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7acdf20-90ff-4e77-836a-4be1dbb71488 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:03.997871 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7acdf20-90ff-4e77-836a-4be1dbb71488 None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:03.998583 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7acdf20-90ff-4e77-836a-4be1dbb71488 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:04.000035 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7acdf20-90ff-4e77-836a-4be1dbb71488 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:04.027874 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 511/1020] 10.222.0.16 () {60 vars in 1141 bytes} [Thu May 26 12:22:03 2022] POST /identity/v3/projects => generated 311 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:22:04.426180 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e1f1f-4b73-4636-979e-b90e776fc7fd None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:04.426464 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e1f1f-4b73-4636-979e-b90e776fc7fd None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:04.426912 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e1f1f-4b73-4636-979e-b90e776fc7fd None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:04.428333 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 510/1021] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:22:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:22:04.433440 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d24fd-06ae-40d2-a483-4ed48e739e23 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:04.433731 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d24fd-06ae-40d2-a483-4ed48e739e23 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:04.434006 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d24fd-06ae-40d2-a483-4ed48e739e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:04.450784 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-723d24fd-06ae-40d2-a483-4ed48e739e23 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:22:04.451967 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-723d24fd-06ae-40d2-a483-4ed48e739e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:22:04.469433 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:04.522387 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 512/1022] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:22:04 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:22:04.545733 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e1f1f-4b73-4636-979e-b90e776fc7fd None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:04.648730 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e1f1f-4b73-4636-979e-b90e776fc7fd None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:04.683007 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f55c23-bbbb-4c92-9cac-7b154e823a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:04.683745 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f55c23-bbbb-4c92-9cac-7b154e823a12 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:04.684027 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f55c23-bbbb-4c92-9cac-7b154e823a12 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:04.684301 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f55c23-bbbb-4c92-9cac-7b154e823a12 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:04.694244 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f55c23-bbbb-4c92-9cac-7b154e823a12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:22:04.702340 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-67f55c23-bbbb-4c92-9cac-7b154e823a12 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 12:22:04.702340 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:04.702340 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:22:04.702340 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:22:04.702340 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:22:04.702340 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:22:04.702340 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:22:04.702340 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:22:04.702340 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:22:04.702340 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:22:04.702340 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:22:04.702340 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:22:04.702340 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:22:04.702340 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:22:04.702340 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:22:04.702340 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:22:04.703281 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:22:04.703281 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:22:04.703281 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:22:04.703281 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:22:04.703281 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:22:04.703281 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:22:04.703281 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:22:04.703281 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:22:04.703281 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:22:04.703281 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:22:04.703281 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:22:04.703281 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:22:04.703281 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:22:04.703281 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:22:04.703281 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:22:04.703281 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:22:04.704653 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:22:04.704653 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:22:04.704653 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:22:04.704653 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:22:04.704653 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:22:04.704653 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:22:04.704653 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:22:04.704653 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:22:04.704653 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:22:04.704653 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:22:04.704653 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 12:22:04.704653 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:22:04.704653 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 511/1023] 10.222.0.16 () {56 vars in 1120 bytes} [Thu May 26 12:22:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:22:04.709994 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d24fd-06ae-40d2-a483-4ed48e739e23 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:04.821300 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d24fd-06ae-40d2-a483-4ed48e739e23 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:04.857413 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48048a3a-3e8e-47f4-b783-e7a6157ca63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:04.858086 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48048a3a-3e8e-47f4-b783-e7a6157ca63b None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:04.858372 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48048a3a-3e8e-47f4-b783-e7a6157ca63b None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:04.858648 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48048a3a-3e8e-47f4-b783-e7a6157ca63b None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:04.859401 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48048a3a-3e8e-47f4-b783-e7a6157ca63b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:04.859708 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48048a3a-3e8e-47f4-b783-e7a6157ca63b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:04.861126 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48048a3a-3e8e-47f4-b783-e7a6157ca63b None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:04.874660 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 513/1024] 10.222.0.16 () {56 vars in 1115 bytes} [Thu May 26 12:22:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:22:04.875795 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f55c23-bbbb-4c92-9cac-7b154e823a12 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:04.932943 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:04.979420 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f55c23-bbbb-4c92-9cac-7b154e823a12 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:05.011874 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25156f20-1d03-4ade-ad09-d2f465601054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:05.012662 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25156f20-1d03-4ade-ad09-d2f465601054 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:05.012974 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25156f20-1d03-4ade-ad09-d2f465601054 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:05.013251 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25156f20-1d03-4ade-ad09-d2f465601054 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:05.024339 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25156f20-1d03-4ade-ad09-d2f465601054 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:05.025833 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25156f20-1d03-4ade-ad09-d2f465601054 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:05.045774 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-25156f20-1d03-4ade-ad09-d2f465601054 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:22:05.045774 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:05.045774 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:22:05.045774 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:22:05.045774 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:22:05.045774 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:22:05.045774 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:22:05.045774 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:22:05.045774 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:22:05.045774 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:22:05.045774 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:22:05.045774 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:22:05.045774 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:22:05.045774 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:22:05.045774 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:22:05.046711 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:22:05.046711 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:22:05.046711 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:22:05.046711 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:22:05.046711 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:22:05.046711 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:22:05.046711 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:22:05.046711 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:22:05.046711 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:22:05.046711 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:22:05.046711 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:22:05.046711 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:22:05.046711 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:22:05.046711 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:22:05.046711 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:22:05.046711 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:22:05.046711 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:22:05.047643 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:22:05.047643 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:22:05.047643 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:22:05.047643 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:22:05.047643 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 512/1025] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:22:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:22:05.052694 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48048a3a-3e8e-47f4-b783-e7a6157ca63b None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:05.072387 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:05.158013 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48048a3a-3e8e-47f4-b783-e7a6157ca63b None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:05.201645 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa6f24-a762-4868-8b5c-3e9b2e7009d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:05.202321 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa6f24-a762-4868-8b5c-3e9b2e7009d4 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:05.202605 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa6f24-a762-4868-8b5c-3e9b2e7009d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:05.202881 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa6f24-a762-4868-8b5c-3e9b2e7009d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:05.203610 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daa6f24-a762-4868-8b5c-3e9b2e7009d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:05.203917 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daa6f24-a762-4868-8b5c-3e9b2e7009d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:05.205322 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daa6f24-a762-4868-8b5c-3e9b2e7009d4 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:05.223913 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 514/1026] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:22:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:22:05.225148 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25156f20-1d03-4ade-ad09-d2f465601054 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:05.325416 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25156f20-1d03-4ade-ad09-d2f465601054 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:05.333268 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:05.345658 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ed998-c213-41ef-b444-d47406b4c48e None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:05.345948 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ed998-c213-41ef-b444-d47406b4c48e None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:05.346220 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ed998-c213-41ef-b444-d47406b4c48e None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:05.347592 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 515/1027] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:22:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:22:05.352923 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa8fe5-dbf8-4bbb-a918-17b15384693f None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:05.353438 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa8fe5-dbf8-4bbb-a918-17b15384693f None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:05.353780 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa8fe5-dbf8-4bbb-a918-17b15384693f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:05.361949 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ec949-72e0-4145-afc4-9dec45274035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:05.362744 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ec949-72e0-4145-afc4-9dec45274035 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:05.363030 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ec949-72e0-4145-afc4-9dec45274035 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:05.363309 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ec949-72e0-4145-afc4-9dec45274035 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:05.370108 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-1caa8fe5-dbf8-4bbb-a918-17b15384693f None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:22:05.370751 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40ec949-72e0-4145-afc4-9dec45274035 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:05.371380 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-1caa8fe5-dbf8-4bbb-a918-17b15384693f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:22:05.372209 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40ec949-72e0-4145-afc4-9dec45274035 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:05.387105 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-e40ec949-72e0-4145-afc4-9dec45274035 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 12:22:05.387105 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:05.387105 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:22:05.387105 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:22:05.387105 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:22:05.387105 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:22:05.387105 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:22:05.387105 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:22:05.387105 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:22:05.387105 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:22:05.387105 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:22:05.387105 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:22:05.387105 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:22:05.387105 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:22:05.387105 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:22:05.387105 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:22:05.388105 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:22:05.388105 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:22:05.388105 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:22:05.388105 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:22:05.388105 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:22:05.388105 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:22:05.388105 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:22:05.388105 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:22:05.388105 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:22:05.388105 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:22:05.388105 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:22:05.388105 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:22:05.388105 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:22:05.388105 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:22:05.388105 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:22:05.388105 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:22:05.388105 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:22:05.388105 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:22:05.389768 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:22:05.389768 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:22:05.389768 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:22:05.389768 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:22:05.389768 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:22:05.389768 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:22:05.389768 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:22:05.389768 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:22:05.389768 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 12:22:05.389768 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:22:05.389768 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 513/1028] 10.222.0.16 () {56 vars in 1093 bytes} [Thu May 26 12:22:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:22:05.395411 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ec949-72e0-4145-afc4-9dec45274035 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:05.448809 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 516/1029] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:22:05 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:22:05.468232 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa8fe5-dbf8-4bbb-a918-17b15384693f None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:05.477471 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:05.500157 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ec949-72e0-4145-afc4-9dec45274035 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:05.537093 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2233da-4267-46ac-8415-6802c58d0f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:05.537769 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2233da-4267-46ac-8415-6802c58d0f65 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:05.538057 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2233da-4267-46ac-8415-6802c58d0f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:05.538316 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2233da-4267-46ac-8415-6802c58d0f65 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:05.539152 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2233da-4267-46ac-8415-6802c58d0f65 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:05.539464 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2233da-4267-46ac-8415-6802c58d0f65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:05.540919 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2233da-4267-46ac-8415-6802c58d0f65 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:05.560016 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 514/1030] 10.222.0.16 () {56 vars in 1133 bytes} [Thu May 26 12:22:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:05.565962 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2233da-4267-46ac-8415-6802c58d0f65 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:05.581340 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa8fe5-dbf8-4bbb-a918-17b15384693f None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:05.593681 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:05.618975 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835de697-6f5c-47f2-aab9-833b0c7aa12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:05.619768 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835de697-6f5c-47f2-aab9-833b0c7aa12d None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:05.620048 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835de697-6f5c-47f2-aab9-833b0c7aa12d None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:05.620327 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835de697-6f5c-47f2-aab9-833b0c7aa12d None admin] PATH_INFO: `/v3/services/image` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:05.621009 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835de697-6f5c-47f2-aab9-833b0c7aa12d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:05.622380 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835de697-6f5c-47f2-aab9-833b0c7aa12d None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:05.634893 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-835de697-6f5c-47f2-aab9-833b0c7aa12d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 26 12:22:05.634893 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:05.634893 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:22:05.634893 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:22:05.634893 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:22:05.634893 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:22:05.634893 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:22:05.634893 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:22:05.634893 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 12:22:05.634893 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:22:05.634893 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:22:05.634893 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:22:05.634893 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:05.634893 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:22:05.634893 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:22:05.634893 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:22:05.634893 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:22:05.635909 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:22:05.635909 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:22:05.635909 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:22:05.635909 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:22:05.635909 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:22:05.635909 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:22:05.635909 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:22:05.635909 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:22:05.635909 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:22:05.635909 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:22:05.635909 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:22:05.635909 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:22:05.635909 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:22:05.635909 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:22:05.635909 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:22:05.635909 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:22:05.637070 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:22:05.637070 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:22:05.637070 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:22:05.637070 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:22:05.637070 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:22:05.637070 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:22:05.637070 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:22:05.637070 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:22:05.637070 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:22:05.637070 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:22:05.637070 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:22:05.637070 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:22:05.637070 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 12:22:05.637070 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:22:05.637070 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 517/1031] 10.222.0.16 () {56 vars in 1105 bytes} [Thu May 26 12:22:05 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:22:05.641940 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835de697-6f5c-47f2-aab9-833b0c7aa12d None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:05.677444 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2233da-4267-46ac-8415-6802c58d0f65 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:05.714237 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:05.714841 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d4159-a658-42e9-9432-cefa3a0b35f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:05.715741 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d4159-a658-42e9-9432-cefa3a0b35f4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:05.716031 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d4159-a658-42e9-9432-cefa3a0b35f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:05.716308 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d4159-a658-42e9-9432-cefa3a0b35f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:05.754267 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835de697-6f5c-47f2-aab9-833b0c7aa12d None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:05.790768 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66f2ba7-94dc-4071-8a63-5d45d372f4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:05.791431 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f2ba7-94dc-4071-8a63-5d45d372f4b0 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:05.791714 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f2ba7-94dc-4071-8a63-5d45d372f4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:05.791993 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f2ba7-94dc-4071-8a63-5d45d372f4b0 None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:05.792704 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66f2ba7-94dc-4071-8a63-5d45d372f4b0 None admin] RBAC: Adding query filter params (name=image) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:05.793041 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66f2ba7-94dc-4071-8a63-5d45d372f4b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:05.794403 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079d4159-a658-42e9-9432-cefa3a0b35f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:05.794516 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66f2ba7-94dc-4071-8a63-5d45d372f4b0 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:05.795862 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079d4159-a658-42e9-9432-cefa3a0b35f4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:05.804872 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 518/1032] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:22:05 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:22:05.806183 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66f2ba7-94dc-4071-8a63-5d45d372f4b0 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:05.824381 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:05.905956 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 515/1033] 10.222.0.16 () {58 vars in 1282 bytes} [Thu May 26 12:22:05 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:22:05.911965 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d4159-a658-42e9-9432-cefa3a0b35f4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:05.915927 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66f2ba7-94dc-4071-8a63-5d45d372f4b0 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:05.950206 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa05c71-e3ff-4321-8fc1-cb500bea7dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:05.950875 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa05c71-e3ff-4321-8fc1-cb500bea7dfa None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:05.951157 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa05c71-e3ff-4321-8fc1-cb500bea7dfa None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:05.951436 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa05c71-e3ff-4321-8fc1-cb500bea7dfa None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:05.952141 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa05c71-e3ff-4321-8fc1-cb500bea7dfa None admin] RBAC: Adding query filter params (type=image) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:05.952445 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa05c71-e3ff-4321-8fc1-cb500bea7dfa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:05.953854 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa05c71-e3ff-4321-8fc1-cb500bea7dfa None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:05.955171 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:05.964449 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 519/1034] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:22:05 2022] GET /identity/v3/services?type=image => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:22:05.965336 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa05c71-e3ff-4321-8fc1-cb500bea7dfa None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:06.018623 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d4159-a658-42e9-9432-cefa3a0b35f4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:06.043484 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:06.056586 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444033e-79a5-44a4-a4f1-e9938adbcf1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:06.057419 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444033e-79a5-44a4-a4f1-e9938adbcf1d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:06.057711 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444033e-79a5-44a4-a4f1-e9938adbcf1d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:06.057989 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444033e-79a5-44a4-a4f1-e9938adbcf1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:06.068672 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444033e-79a5-44a4-a4f1-e9938adbcf1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:06.070173 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444033e-79a5-44a4-a4f1-e9938adbcf1d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:06.077693 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa05c71-e3ff-4321-8fc1-cb500bea7dfa None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:06.088014 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-4444033e-79a5-44a4-a4f1-e9938adbcf1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:22:06.088014 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:06.088014 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:22:06.088014 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:22:06.088014 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:22:06.088014 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:22:06.088014 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:22:06.088014 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:22:06.088014 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:22:06.088014 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:22:06.088014 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:22:06.088014 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:22:06.088014 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:22:06.088014 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:22:06.088014 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:22:06.089080 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:22:06.089080 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:22:06.089080 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:22:06.089080 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:22:06.089080 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:22:06.089080 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:22:06.089080 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:22:06.089080 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:22:06.089080 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:22:06.089080 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:22:06.089080 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:22:06.089080 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:22:06.089080 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:22:06.089080 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:22:06.089080 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:22:06.089080 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:22:06.089080 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:22:06.095851 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:22:06.095851 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:22:06.095851 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:22:06.095851 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:22:06.095851 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 516/1035] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:22:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:22:06.096159 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444033e-79a5-44a4-a4f1-e9938adbcf1d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:06.119973 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058ea7a-8944-4ad1-9e4a-ab4e13552568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:06.120641 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058ea7a-8944-4ad1-9e4a-ab4e13552568 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:06.120975 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058ea7a-8944-4ad1-9e4a-ab4e13552568 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:06.121254 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058ea7a-8944-4ad1-9e4a-ab4e13552568 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:06.122064 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8058ea7a-8944-4ad1-9e4a-ab4e13552568 None admin] RBAC: Adding query filter params (interface=public, service_id=22721115c7184558989b3e37761d45b8, region_id=RegionOne) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:06.122736 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8058ea7a-8944-4ad1-9e4a-ab4e13552568 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:06.123807 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8058ea7a-8944-4ad1-9e4a-ab4e13552568 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:06.134506 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 520/1036] 10.222.0.16 () {56 vars in 1251 bytes} [Thu May 26 12:22:05 2022] GET /identity/v3/endpoints?service_id=22721115c7184558989b3e37761d45b8&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:06.135592 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058ea7a-8944-4ad1-9e4a-ab4e13552568 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:06.208009 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:06.209591 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444033e-79a5-44a4-a4f1-e9938adbcf1d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:06.245822 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff768099-4c92-4f0d-8ad6-00df17b030f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:06.246605 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff768099-4c92-4f0d-8ad6-00df17b030f5 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:06.246960 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff768099-4c92-4f0d-8ad6-00df17b030f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:06.247311 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff768099-4c92-4f0d-8ad6-00df17b030f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:06.248209 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff768099-4c92-4f0d-8ad6-00df17b030f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:06.248611 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff768099-4c92-4f0d-8ad6-00df17b030f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:06.250132 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff768099-4c92-4f0d-8ad6-00df17b030f5 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:06.254616 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058ea7a-8944-4ad1-9e4a-ab4e13552568 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:06.263473 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 517/1037] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:22:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:22:06.271223 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff768099-4c92-4f0d-8ad6-00df17b030f5 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:06.292343 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26414cb-fa1d-4afe-aaf6-64f29f6177cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:06.293035 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26414cb-fa1d-4afe-aaf6-64f29f6177cb None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:06.293309 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26414cb-fa1d-4afe-aaf6-64f29f6177cb None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:06.293585 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26414cb-fa1d-4afe-aaf6-64f29f6177cb None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:06.294272 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26414cb-fa1d-4afe-aaf6-64f29f6177cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:06.295627 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26414cb-fa1d-4afe-aaf6-64f29f6177cb None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:06.302263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 521/1038] 10.222.0.16 () {56 vars in 1087 bytes} [Thu May 26 12:22:06 2022] GET /identity/v3/services => generated 1957 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:22:06.306813 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8ba9f-cfb4-45ae-a163-dd8f340bcadc None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:06.307108 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8ba9f-cfb4-45ae-a163-dd8f340bcadc None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:06.307389 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8ba9f-cfb4-45ae-a163-dd8f340bcadc None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:06.309001 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 522/1039] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:22:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:22:06.311446 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:06.315255 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d7a43-54f2-4114-be5e-585768a928c4 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:06.315547 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d7a43-54f2-4114-be5e-585768a928c4 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:06.315831 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d7a43-54f2-4114-be5e-585768a928c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:06.336892 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-277d7a43-54f2-4114-be5e-585768a928c4 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:22:06.338154 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-277d7a43-54f2-4114-be5e-585768a928c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:22:06.396225 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff768099-4c92-4f0d-8ad6-00df17b030f5 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:06.424880 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 523/1040] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:22:06 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:22:06.436550 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38d7dc-fae6-4b83-9224-c80f5e23bdd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:06.437390 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38d7dc-fae6-4b83-9224-c80f5e23bdd3 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:06.437674 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38d7dc-fae6-4b83-9224-c80f5e23bdd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:06.437944 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38d7dc-fae6-4b83-9224-c80f5e23bdd3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:06.445712 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d7a43-54f2-4114-be5e-585768a928c4 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:06.447544 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe38d7dc-fae6-4b83-9224-c80f5e23bdd3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:06.449074 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe38d7dc-fae6-4b83-9224-c80f5e23bdd3 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:06.464939 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-fe38d7dc-fae6-4b83-9224-c80f5e23bdd3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:22:06.464939 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:06.464939 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:22:06.464939 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:22:06.464939 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:22:06.464939 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:22:06.464939 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:22:06.464939 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:22:06.464939 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:22:06.464939 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:22:06.464939 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:22:06.464939 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:22:06.464939 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:22:06.464939 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:22:06.464939 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:22:06.466106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:22:06.466106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:22:06.466106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:22:06.466106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:22:06.466106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:22:06.466106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:22:06.466106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:22:06.466106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:22:06.466106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:22:06.466106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:22:06.466106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:22:06.466106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:22:06.466106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:22:06.466106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:22:06.466106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:22:06.466106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:22:06.466106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:22:06.467435 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:22:06.467435 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:22:06.467435 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:22:06.467435 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:22:06.467435 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:22:06.467435 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:22:06.467435 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:22:06.467435 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:22:06.473569 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 518/1041] 10.222.0.16 () {56 vars in 1111 bytes} [Thu May 26 12:22:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:22:06.474805 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38d7dc-fae6-4b83-9224-c80f5e23bdd3 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:06.525552 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:06.576558 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d7a43-54f2-4114-be5e-585768a928c4 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:06.583538 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:06.590585 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38d7dc-fae6-4b83-9224-c80f5e23bdd3 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:06.619708 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc7079-a603-481b-8ac9-b7339c075026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:06.620502 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc7079-a603-481b-8ac9-b7339c075026 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:06.620788 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc7079-a603-481b-8ac9-b7339c075026 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:06.621088 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc7079-a603-481b-8ac9-b7339c075026 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:06.622247 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edc7079-a603-481b-8ac9-b7339c075026 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:06.623674 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edc7079-a603-481b-8ac9-b7339c075026 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:06.625490 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 524/1042] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:22:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:22:06.627001 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc99a9-aadb-4edb-bbb7-24ed6aceb8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:06.627665 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc99a9-aadb-4edb-bbb7-24ed6aceb8a7 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:06.627946 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc99a9-aadb-4edb-bbb7-24ed6aceb8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:06.628217 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc99a9-aadb-4edb-bbb7-24ed6aceb8a7 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:06.629033 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcc99a9-aadb-4edb-bbb7-24ed6aceb8a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:06.629341 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcc99a9-aadb-4edb-bbb7-24ed6aceb8a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:06.630779 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcc99a9-aadb-4edb-bbb7-24ed6aceb8a7 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:06.631360 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc7079-a603-481b-8ac9-b7339c075026 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:06.648513 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 519/1043] 10.222.0.16 () {56 vars in 1148 bytes} [Thu May 26 12:22:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:22:06.651031 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc99a9-aadb-4edb-bbb7-24ed6aceb8a7 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:06.751758 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc7079-a603-481b-8ac9-b7339c075026 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:06.760960 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc99a9-aadb-4edb-bbb7-24ed6aceb8a7 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:06.779699 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:06.792635 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b2490-795c-4c50-bbff-c995afdfae3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:06.793338 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b2490-795c-4c50-bbff-c995afdfae3c None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:06.793622 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b2490-795c-4c50-bbff-c995afdfae3c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:06.793898 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b2490-795c-4c50-bbff-c995afdfae3c None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:06.794608 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b2490-795c-4c50-bbff-c995afdfae3c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:06.796035 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b2490-795c-4c50-bbff-c995afdfae3c None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:06.799217 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e991da5b-db13-4b4e-a28c-3fcc323517a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:06.799870 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991da5b-db13-4b4e-a28c-3fcc323517a6 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:06.800151 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991da5b-db13-4b4e-a28c-3fcc323517a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:06.800422 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991da5b-db13-4b4e-a28c-3fcc323517a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:06.801310 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e991da5b-db13-4b4e-a28c-3fcc323517a6 None admin] RBAC: Adding query filter params (role.id=d2c069ef8eed4c73a7fa3aa932c60945, scope.project.id=42e6c693bd224d92b8a0fe4ad0cc586d, user.id=536f68ff77794352adf41aaacdc0645c) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:06.801623 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e991da5b-db13-4b4e-a28c-3fcc323517a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:06.803049 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e991da5b-db13-4b4e-a28c-3fcc323517a6 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:06.809671 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 520/1044] 10.222.0.16 () {56 vars in 1374 bytes} [Thu May 26 12:22:06 2022] GET /identity/v3/role_assignments?user.id=536f68ff77794352adf41aaacdc0645c&scope.project.id=42e6c693bd224d92b8a0fe4ad0cc586d&role.id=d2c069ef8eed4c73a7fa3aa932c60945 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:06.831282 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 525/1045] 10.222.0.16 () {60 vars in 1132 bytes} [Thu May 26 12:22:06 2022] POST /identity/v3/users => generated 285 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:22:08.557286 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3686e1f-c88d-4b3d-86a0-6e52728855f9 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:08.557829 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3686e1f-c88d-4b3d-86a0-6e52728855f9 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:08.557829 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3686e1f-c88d-4b3d-86a0-6e52728855f9 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:08.559358 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 521/1046] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:22:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:22:08.564585 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbae2d1-3b60-4651-a9c3-a7dcb7e87dc3 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:08.565033 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbae2d1-3b60-4651-a9c3-a7dcb7e87dc3 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:08.565206 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbae2d1-3b60-4651-a9c3-a7dcb7e87dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:08.582325 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-2dbae2d1-3b60-4651-a9c3-a7dcb7e87dc3 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:22:08.583527 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-2dbae2d1-3b60-4651-a9c3-a7dcb7e87dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:22:08.653298 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 526/1047] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:22:08 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:22:08.676804 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3686e1f-c88d-4b3d-86a0-6e52728855f9 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:08.699065 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:08.788810 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3686e1f-c88d-4b3d-86a0-6e52728855f9 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:08.822634 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8afe68-0480-4bd4-9b9b-f26cb4dc360c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:08.823345 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8afe68-0480-4bd4-9b9b-f26cb4dc360c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:08.823630 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8afe68-0480-4bd4-9b9b-f26cb4dc360c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:08.823906 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8afe68-0480-4bd4-9b9b-f26cb4dc360c None admin] PATH_INFO: `/v3/services/image` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:08.824563 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8afe68-0480-4bd4-9b9b-f26cb4dc360c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:08.826003 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8afe68-0480-4bd4-9b9b-f26cb4dc360c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:08.839212 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-dc8afe68-0480-4bd4-9b9b-f26cb4dc360c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 26 12:22:08.839212 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:08.839212 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:22:08.839212 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:22:08.839212 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:22:08.839212 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:22:08.839212 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:22:08.839212 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:22:08.839212 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 12:22:08.839212 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:22:08.839212 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:22:08.839212 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:22:08.839212 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:08.839212 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:22:08.839212 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:22:08.839212 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:22:08.839212 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:22:08.840280 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:22:08.840280 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:22:08.840280 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:22:08.840280 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:22:08.840280 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:22:08.840280 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:22:08.840280 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:22:08.840280 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:22:08.840280 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:22:08.840280 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:22:08.840280 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:22:08.840280 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:22:08.840280 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:22:08.840280 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:22:08.840280 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:22:08.840280 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:22:08.841591 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:22:08.841591 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:22:08.841591 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:22:08.841591 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:22:08.841591 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:22:08.841591 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:22:08.841591 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:22:08.841591 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:22:08.841591 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:22:08.841591 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:22:08.841591 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:22:08.841591 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:22:08.841591 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 12:22:08.841591 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:22:08.845456 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 522/1048] 10.222.0.16 () {56 vars in 1105 bytes} [Thu May 26 12:22:08 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:22:08.847269 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbae2d1-3b60-4651-a9c3-a7dcb7e87dc3 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:08.953680 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbae2d1-3b60-4651-a9c3-a7dcb7e87dc3 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:08.965186 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:08.991272 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b907943-3ca6-486b-bd29-a3041e6c80cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:08.991939 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b907943-3ca6-486b-bd29-a3041e6c80cb None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:08.992224 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b907943-3ca6-486b-bd29-a3041e6c80cb None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:08.992502 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b907943-3ca6-486b-bd29-a3041e6c80cb None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:08.993335 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b907943-3ca6-486b-bd29-a3041e6c80cb None admin] RBAC: Adding query filter params (name=image) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:08.993647 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b907943-3ca6-486b-bd29-a3041e6c80cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:08.995024 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b907943-3ca6-486b-bd29-a3041e6c80cb None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:09.005473 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 527/1049] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:22:08 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:09.006588 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8afe68-0480-4bd4-9b9b-f26cb4dc360c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:09.029025 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c8aba-2e6d-4600-aee8-50d9563ded85 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:09.029319 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c8aba-2e6d-4600-aee8-50d9563ded85 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:09.029602 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c8aba-2e6d-4600-aee8-50d9563ded85 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:09.031096 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 528/1050] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:22:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:22:09.035754 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001992f-df76-49a0-ba67-70c6df855cb2 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:09.036047 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001992f-df76-49a0-ba67-70c6df855cb2 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:09.036332 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001992f-df76-49a0-ba67-70c6df855cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:09.053799 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-e001992f-df76-49a0-ba67-70c6df855cb2 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:22:09.054995 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-e001992f-df76-49a0-ba67-70c6df855cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:22:09.098504 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:09.115783 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8afe68-0480-4bd4-9b9b-f26cb4dc360c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:09.127404 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 529/1051] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:22:09 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:22:09.128714 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321560ed-9b56-419e-892c-6db7d071415c None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:09.129033 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321560ed-9b56-419e-892c-6db7d071415c None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:09.129309 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321560ed-9b56-419e-892c-6db7d071415c None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:09.130690 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 530/1052] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:22:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:22:09.135784 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de1b6d-0357-44e4-a1f8-725885c1b390 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:09.136141 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de1b6d-0357-44e4-a1f8-725885c1b390 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:09.136494 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de1b6d-0357-44e4-a1f8-725885c1b390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:09.152672 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c1c855-91c8-4c4f-9b32-faecb0f46722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:09.153373 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1c855-91c8-4c4f-9b32-faecb0f46722 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:09.153660 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1c855-91c8-4c4f-9b32-faecb0f46722 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:09.153940 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1c855-91c8-4c4f-9b32-faecb0f46722 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:09.154614 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-a2de1b6d-0357-44e4-a1f8-725885c1b390 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:22:09.154711 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c1c855-91c8-4c4f-9b32-faecb0f46722 None admin] RBAC: Adding query filter params (type=image) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:09.154940 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c1c855-91c8-4c4f-9b32-faecb0f46722 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:09.155792 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-a2de1b6d-0357-44e4-a1f8-725885c1b390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:22:09.156325 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c1c855-91c8-4c4f-9b32-faecb0f46722 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:09.166060 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 523/1053] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:22:09 2022] GET /identity/v3/services?type=image => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:09.166060 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c1c855-91c8-4c4f-9b32-faecb0f46722 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:09.222060 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 531/1054] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:22:09 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:22:09.222870 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de1b6d-0357-44e4-a1f8-725885c1b390 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:09.256733 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:09.270238 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c1c855-91c8-4c4f-9b32-faecb0f46722 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:09.302944 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6440e4-b7d2-4569-8141-ae9ea4e297bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:09.303757 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6440e4-b7d2-4569-8141-ae9ea4e297bc None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:09.304040 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6440e4-b7d2-4569-8141-ae9ea4e297bc None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:09.304315 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6440e4-b7d2-4569-8141-ae9ea4e297bc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:09.314843 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6440e4-b7d2-4569-8141-ae9ea4e297bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:22:09.321777 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de1b6d-0357-44e4-a1f8-725885c1b390 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:09.323002 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-3f6440e4-b7d2-4569-8141-ae9ea4e297bc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 12:22:09.323002 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:09.323002 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:22:09.323002 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:22:09.323002 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:22:09.323002 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:22:09.323002 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:22:09.323002 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:22:09.323002 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:22:09.323002 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:22:09.323002 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:22:09.323002 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:22:09.323002 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:22:09.323002 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:22:09.323002 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:22:09.323002 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:22:09.323920 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:22:09.323920 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:22:09.323920 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:22:09.323920 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:22:09.323920 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:22:09.323920 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:22:09.323920 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:22:09.323920 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:22:09.323920 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:22:09.323920 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:22:09.323920 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:22:09.323920 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:22:09.323920 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:22:09.323920 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:22:09.323920 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:22:09.323920 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:22:09.324773 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:22:09.324773 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:22:09.324773 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:22:09.324773 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:22:09.324773 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:22:09.324773 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:22:09.324773 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:22:09.324773 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:22:09.324773 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:22:09.324773 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:22:09.324773 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 12:22:09.324773 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:22:09.324773 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 524/1055] 10.222.0.16 () {56 vars in 1120 bytes} [Thu May 26 12:22:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:22:09.325523 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6440e4-b7d2-4569-8141-ae9ea4e297bc None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:09.335646 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:09.359430 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ee081-1284-4e09-90ba-4a40852af815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:09.360025 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ee081-1284-4e09-90ba-4a40852af815 None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:09.360316 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ee081-1284-4e09-90ba-4a40852af815 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:09.361157 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ee081-1284-4e09-90ba-4a40852af815 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:09.361887 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946ee081-1284-4e09-90ba-4a40852af815 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:09.363251 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946ee081-1284-4e09-90ba-4a40852af815 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:09.384144 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 532/1056] 10.222.0.16 () {60 vars in 1144 bytes} [Thu May 26 12:22:09 2022] POST /identity/v3/endpoints => generated 327 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:22:09.385049 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ee081-1284-4e09-90ba-4a40852af815 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:09.443948 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6440e4-b7d2-4569-8141-ae9ea4e297bc None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:09.486232 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:09.495852 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4533d94c-148e-4544-b029-710f71aa94d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:09.496993 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4533d94c-148e-4544-b029-710f71aa94d0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:09.497408 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4533d94c-148e-4544-b029-710f71aa94d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:09.497929 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4533d94c-148e-4544-b029-710f71aa94d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:09.502769 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ee081-1284-4e09-90ba-4a40852af815 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:09.513410 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4533d94c-148e-4544-b029-710f71aa94d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:22:09.522118 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-4533d94c-148e-4544-b029-710f71aa94d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:22:09.522118 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:09.522118 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:22:09.522118 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:22:09.522118 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:22:09.522118 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:22:09.522118 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:22:09.522118 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:22:09.522118 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:22:09.522118 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:22:09.522118 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:22:09.522118 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:22:09.522118 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:22:09.522118 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:22:09.522118 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:22:09.522118 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:22:09.523236 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:22:09.523236 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:22:09.523236 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:22:09.523236 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:22:09.523236 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:22:09.523236 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:22:09.523236 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:22:09.523236 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:22:09.523236 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:22:09.523236 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:22:09.523236 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:22:09.523236 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:22:09.523236 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:22:09.523236 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:22:09.523236 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:22:09.523236 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:22:09.524087 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:22:09.524087 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:22:09.524087 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:22:09.524087 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:22:09.524087 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:22:09.524087 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:22:09.524087 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:22:09.524087 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:22:09.524087 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:22:09.524087 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:22:09.524087 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:22:09.524087 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:22:09.524087 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 525/1057] 10.222.0.16 () {56 vars in 1096 bytes} [Thu May 26 12:22:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:22:09.529749 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4533d94c-148e-4544-b029-710f71aa94d0 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:09.544604 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c3e2bc-7d15-4bc3-ac44-597cb5cc3aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:09.545316 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3e2bc-7d15-4bc3-ac44-597cb5cc3aee None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:09.545600 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3e2bc-7d15-4bc3-ac44-597cb5cc3aee None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:09.545878 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3e2bc-7d15-4bc3-ac44-597cb5cc3aee None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:09.546650 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c3e2bc-7d15-4bc3-ac44-597cb5cc3aee None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:09.546951 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c3e2bc-7d15-4bc3-ac44-597cb5cc3aee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:09.548897 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c3e2bc-7d15-4bc3-ac44-597cb5cc3aee None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:09.558619 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 533/1058] 10.222.0.16 () {56 vars in 1115 bytes} [Thu May 26 12:22:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:09.565023 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c3e2bc-7d15-4bc3-ac44-597cb5cc3aee None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:09.610416 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:09.654962 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4533d94c-148e-4544-b029-710f71aa94d0 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:09.679433 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c3e2bc-7d15-4bc3-ac44-597cb5cc3aee None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:09.696216 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be94e79a-0536-46e0-997b-d83936f87e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:09.697188 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94e79a-0536-46e0-997b-d83936f87e76 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:09.697467 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94e79a-0536-46e0-997b-d83936f87e76 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:09.697735 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94e79a-0536-46e0-997b-d83936f87e76 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:09.698501 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be94e79a-0536-46e0-997b-d83936f87e76 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:09.698805 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be94e79a-0536-46e0-997b-d83936f87e76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:09.700171 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be94e79a-0536-46e0-997b-d83936f87e76 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:09.708590 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 526/1059] 10.222.0.16 () {56 vars in 1099 bytes} [Thu May 26 12:22:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:09.713993 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be94e79a-0536-46e0-997b-d83936f87e76 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:09.714120 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90512e21-794f-400f-a7da-276ab337d1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:09.714908 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90512e21-794f-400f-a7da-276ab337d1ff None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:09.715193 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90512e21-794f-400f-a7da-276ab337d1ff None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:09.715468 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90512e21-794f-400f-a7da-276ab337d1ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:09.727607 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90512e21-794f-400f-a7da-276ab337d1ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:09.729075 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90512e21-794f-400f-a7da-276ab337d1ff None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:09.747195 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-90512e21-794f-400f-a7da-276ab337d1ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:22:09.747195 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:09.747195 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:22:09.747195 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:22:09.747195 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:22:09.747195 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:22:09.747195 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:22:09.747195 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:22:09.747195 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:22:09.747195 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:22:09.747195 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:22:09.747195 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:22:09.747195 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:22:09.747195 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:22:09.747195 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:22:09.748152 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:22:09.748152 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:22:09.748152 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:22:09.748152 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:22:09.748152 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:22:09.748152 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:22:09.748152 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:22:09.748152 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:22:09.748152 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:22:09.748152 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:22:09.748152 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:22:09.748152 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:22:09.748152 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:22:09.748152 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:22:09.748152 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:22:09.748152 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:22:09.748152 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:22:09.749371 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:22:09.749371 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:22:09.749371 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:22:09.749371 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:22:09.753934 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 534/1060] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:22:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:22:09.754726 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90512e21-794f-400f-a7da-276ab337d1ff None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:09.759309 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:09.833664 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be94e79a-0536-46e0-997b-d83936f87e76 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:09.861562 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:09.865265 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90512e21-794f-400f-a7da-276ab337d1ff None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:09.871811 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b6ef67-61db-4f85-bcb8-99489739f3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:09.872692 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6ef67-61db-4f85-bcb8-99489739f3ab None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:09.873007 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6ef67-61db-4f85-bcb8-99489739f3ab None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:09.873281 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6ef67-61db-4f85-bcb8-99489739f3ab None admin] PATH_INFO: `/v3/users/6fab3cce2e3447839cb3b52f2c4bdbb2` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:09.887782 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b6ef67-61db-4f85-bcb8-99489739f3ab None admin] RBAC: Authorizing `identity:get_user(user_id=6fab3cce2e3447839cb3b52f2c4bdbb2)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:09.889279 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b6ef67-61db-4f85-bcb8-99489739f3ab None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:09.891023 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 527/1061] 10.222.0.16 () {56 vars in 1177 bytes} [Thu May 26 12:22:09 2022] GET /identity/v3/users/6fab3cce2e3447839cb3b52f2c4bdbb2 => generated 285 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:22:09.897559 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b6ef67-61db-4f85-bcb8-99489739f3ab None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:09.912407 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af92bbd8-5eaf-49d0-8393-a3b3051c8f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:09.913394 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92bbd8-5eaf-49d0-8393-a3b3051c8f73 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:09.913878 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92bbd8-5eaf-49d0-8393-a3b3051c8f73 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:09.914326 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92bbd8-5eaf-49d0-8393-a3b3051c8f73 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:09.915191 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af92bbd8-5eaf-49d0-8393-a3b3051c8f73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:09.915646 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af92bbd8-5eaf-49d0-8393-a3b3051c8f73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:09.917378 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af92bbd8-5eaf-49d0-8393-a3b3051c8f73 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:09.931390 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 535/1062] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:22:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:22:09.936969 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af92bbd8-5eaf-49d0-8393-a3b3051c8f73 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:09.999366 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b6ef67-61db-4f85-bcb8-99489739f3ab None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:10.004327 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:10.034036 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad510372-377e-4a78-a636-6ead62326c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:10.034679 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad510372-377e-4a78-a636-6ead62326c3f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:10.034962 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad510372-377e-4a78-a636-6ead62326c3f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:10.035234 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad510372-377e-4a78-a636-6ead62326c3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:10.047923 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af92bbd8-5eaf-49d0-8393-a3b3051c8f73 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:10.082874 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1fc24-31cd-4e8a-935f-394bccad5225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:10.083658 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1fc24-31cd-4e8a-935f-394bccad5225 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:10.083940 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1fc24-31cd-4e8a-935f-394bccad5225 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:10.084214 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1fc24-31cd-4e8a-935f-394bccad5225 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:10.089217 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:10.091686 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a1fc24-31cd-4e8a-935f-394bccad5225 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:10.093207 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a1fc24-31cd-4e8a-935f-394bccad5225 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:10.107050 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad510372-377e-4a78-a636-6ead62326c3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:10.108321 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-d7a1fc24-31cd-4e8a-935f-394bccad5225 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 12:22:10.108321 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:10.108321 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:22:10.108321 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:22:10.108321 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:22:10.108321 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:22:10.108321 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:22:10.108321 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:22:10.108321 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:22:10.108321 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:22:10.108321 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:22:10.108321 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:22:10.108321 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:22:10.108321 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:22:10.108321 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:22:10.108321 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:22:10.109263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:22:10.109263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:22:10.109263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:22:10.109263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:22:10.109263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:22:10.109263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:22:10.109263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:22:10.109263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:22:10.109263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:22:10.109263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:22:10.109263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:22:10.109263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:22:10.109263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:22:10.109263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:22:10.109263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:22:10.109263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:22:10.109263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:22:10.109263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:22:10.115109 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:22:10.115109 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:22:10.115109 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:22:10.115109 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:22:10.115109 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:22:10.115109 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:22:10.115109 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:22:10.115109 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:22:10.115109 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 12:22:10.115109 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:22:10.115663 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad510372-377e-4a78-a636-6ead62326c3f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:10.115738 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 536/1063] 10.222.0.16 () {56 vars in 1093 bytes} [Thu May 26 12:22:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:22:10.115738 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1fc24-31cd-4e8a-935f-394bccad5225 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:10.218886 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1fc24-31cd-4e8a-935f-394bccad5225 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:10.229213 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 528/1064] 10.222.0.16 () {58 vars in 1282 bytes} [Thu May 26 12:22:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 12:22:10.231755 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad510372-377e-4a78-a636-6ead62326c3f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:10.244599 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:10.256474 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae9a32-9d70-449d-b90a-fcbda7bfb3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:10.257330 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae9a32-9d70-449d-b90a-fcbda7bfb3a6 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:10.257613 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae9a32-9d70-449d-b90a-fcbda7bfb3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:10.258190 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae9a32-9d70-449d-b90a-fcbda7bfb3a6 None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:10.259300 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ae9a32-9d70-449d-b90a-fcbda7bfb3a6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:10.259608 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ae9a32-9d70-449d-b90a-fcbda7bfb3a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:10.261777 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ae9a32-9d70-449d-b90a-fcbda7bfb3a6 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:10.288615 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 537/1065] 10.222.0.16 () {56 vars in 1133 bytes} [Thu May 26 12:22:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:22:10.290040 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae9a32-9d70-449d-b90a-fcbda7bfb3a6 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:10.321395 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:10.340335 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad510372-377e-4a78-a636-6ead62326c3f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:10.375871 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa29d78-4216-446a-a789-e4e905995c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:10.377062 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa29d78-4216-446a-a789-e4e905995c81 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:10.377346 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa29d78-4216-446a-a789-e4e905995c81 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:10.377620 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa29d78-4216-446a-a789-e4e905995c81 None admin] PATH_INFO: `/v3/projects/32613a2d0b4e49988a08ac9fea5fb88a` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:10.378850 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa29d78-4216-446a-a789-e4e905995c81 None admin] RBAC: Authorizing `identity:get_project(project_id=32613a2d0b4e49988a08ac9fea5fb88a)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:10.380305 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa29d78-4216-446a-a789-e4e905995c81 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:10.382184 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 529/1066] 10.222.0.16 () {56 vars in 1186 bytes} [Thu May 26 12:22:10 2022] GET /identity/v3/projects/32613a2d0b4e49988a08ac9fea5fb88a => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:22:10.387811 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa29d78-4216-446a-a789-e4e905995c81 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:10.395973 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae9a32-9d70-449d-b90a-fcbda7bfb3a6 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:10.433189 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417bce83-736a-4304-9c0c-32d897816b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:10.434097 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417bce83-736a-4304-9c0c-32d897816b64 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:10.434389 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417bce83-736a-4304-9c0c-32d897816b64 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:10.434805 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417bce83-736a-4304-9c0c-32d897816b64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:10.447755 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417bce83-736a-4304-9c0c-32d897816b64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:10.449696 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417bce83-736a-4304-9c0c-32d897816b64 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:10.473316 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-417bce83-736a-4304-9c0c-32d897816b64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:22:10.473316 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:10.473316 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:22:10.473316 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:22:10.473316 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:22:10.473316 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:22:10.473316 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:22:10.473316 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:22:10.473316 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:22:10.473316 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:22:10.473316 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:22:10.473316 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:22:10.473316 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:22:10.473316 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:22:10.473316 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:22:10.474245 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:22:10.474245 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:22:10.474245 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:22:10.474245 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:22:10.474245 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:22:10.474245 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:22:10.474245 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:22:10.474245 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:22:10.474245 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:22:10.474245 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:22:10.474245 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:22:10.474245 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:22:10.474245 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:22:10.474245 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:22:10.474245 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:22:10.474245 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:22:10.474245 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:22:10.475187 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:22:10.475187 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:22:10.475187 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:22:10.475187 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:22:10.476175 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 538/1067] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:22:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:22:10.480732 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417bce83-736a-4304-9c0c-32d897816b64 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:10.494805 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa29d78-4216-446a-a789-e4e905995c81 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:10.522044 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:10.533948 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef628d2-89fe-46f4-a9fe-e6060de3254d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:10.534897 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef628d2-89fe-46f4-a9fe-e6060de3254d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:10.535177 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef628d2-89fe-46f4-a9fe-e6060de3254d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:10.535454 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef628d2-89fe-46f4-a9fe-e6060de3254d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:10.536286 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef628d2-89fe-46f4-a9fe-e6060de3254d None admin] RBAC: Adding query filter params (role.id=1a8e523ecbc84d818c2a9af0fb54da74, scope.project.id=32613a2d0b4e49988a08ac9fea5fb88a, user.id=6fab3cce2e3447839cb3b52f2c4bdbb2) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:10.536606 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef628d2-89fe-46f4-a9fe-e6060de3254d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:10.538096 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef628d2-89fe-46f4-a9fe-e6060de3254d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:10.552885 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 530/1068] 10.222.0.16 () {56 vars in 1374 bytes} [Thu May 26 12:22:10 2022] GET /identity/v3/role_assignments?user.id=6fab3cce2e3447839cb3b52f2c4bdbb2&scope.project.id=32613a2d0b4e49988a08ac9fea5fb88a&role.id=1a8e523ecbc84d818c2a9af0fb54da74 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:22:10.608421 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417bce83-736a-4304-9c0c-32d897816b64 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:10.647514 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e858c-3fca-46fd-9f7a-82636dfd6751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:10.648111 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e858c-3fca-46fd-9f7a-82636dfd6751 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:10.648393 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e858c-3fca-46fd-9f7a-82636dfd6751 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:10.648668 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e858c-3fca-46fd-9f7a-82636dfd6751 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:10.649444 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1e858c-3fca-46fd-9f7a-82636dfd6751 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:10.649749 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1e858c-3fca-46fd-9f7a-82636dfd6751 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:10.651132 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1e858c-3fca-46fd-9f7a-82636dfd6751 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:10.663821 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 539/1069] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:22:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:10.669819 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef628d2-89fe-46f4-a9fe-e6060de3254d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:10.691235 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:10.780364 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef628d2-89fe-46f4-a9fe-e6060de3254d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:10.813420 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d753399a-710c-4a7f-8048-bf0419fc3528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:10.814778 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753399a-710c-4a7f-8048-bf0419fc3528 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:10.815060 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753399a-710c-4a7f-8048-bf0419fc3528 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:10.815332 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753399a-710c-4a7f-8048-bf0419fc3528 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:10.821914 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d753399a-710c-4a7f-8048-bf0419fc3528 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:10.823354 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d753399a-710c-4a7f-8048-bf0419fc3528 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:10.837843 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-d753399a-710c-4a7f-8048-bf0419fc3528 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:22:10.837843 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:10.837843 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:22:10.837843 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:22:10.837843 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:22:10.837843 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:22:10.837843 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:22:10.837843 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:22:10.837843 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:22:10.837843 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:22:10.837843 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:22:10.837843 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:22:10.837843 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:22:10.837843 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:22:10.837843 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:22:10.838744 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:22:10.838744 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:22:10.838744 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:22:10.838744 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:22:10.838744 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:22:10.838744 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:22:10.838744 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:22:10.838744 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:22:10.838744 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:22:10.838744 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:22:10.838744 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:22:10.838744 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:22:10.838744 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:22:10.838744 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:22:10.838744 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:22:10.838744 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:22:10.838744 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:22:10.844299 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:22:10.844299 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:22:10.844299 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:22:10.844299 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:22:10.844299 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:22:10.844299 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:22:10.844299 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:22:10.844299 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:22:10.844299 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 531/1070] 10.222.0.16 () {56 vars in 1111 bytes} [Thu May 26 12:22:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:22:10.846534 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e858c-3fca-46fd-9f7a-82636dfd6751 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:10.941790 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:10.949801 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e858c-3fca-46fd-9f7a-82636dfd6751 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:10.983581 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e6d686-4e2d-49f8-9a0e-252551f2d4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:10.984239 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6d686-4e2d-49f8-9a0e-252551f2d4a0 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:10.984520 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6d686-4e2d-49f8-9a0e-252551f2d4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:10.984793 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6d686-4e2d-49f8-9a0e-252551f2d4a0 None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:10.986127 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e6d686-4e2d-49f8-9a0e-252551f2d4a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:10.986440 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e6d686-4e2d-49f8-9a0e-252551f2d4a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:10.987886 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e6d686-4e2d-49f8-9a0e-252551f2d4a0 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:11.005405 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 540/1071] 10.222.0.16 () {56 vars in 1148 bytes} [Thu May 26 12:22:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:11.007021 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d753399a-710c-4a7f-8048-bf0419fc3528 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:11.088380 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:11.112933 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d753399a-710c-4a7f-8048-bf0419fc3528 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:11.147586 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb714d-7adb-48f0-acfb-09db83755c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:11.148475 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb714d-7adb-48f0-acfb-09db83755c38 None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:11.148758 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb714d-7adb-48f0-acfb-09db83755c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:11.149061 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb714d-7adb-48f0-acfb-09db83755c38 None admin] PATH_INFO: `/v3/projects/42e6c693bd224d92b8a0fe4ad0cc586d/users/536f68ff77794352adf41aaacdc0645c/roles/d2c069ef8eed4c73a7fa3aa932c60945` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:11.151231 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbb714d-7adb-48f0-acfb-09db83755c38 None admin] RBAC: Authorizing `identity:create_grant(project_id=42e6c693bd224d92b8a0fe4ad0cc586d, user_id=536f68ff77794352adf41aaacdc0645c, role_id=d2c069ef8eed4c73a7fa3aa932c60945)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:11.152668 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbb714d-7adb-48f0-acfb-09db83755c38 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:11.166348 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 532/1072] 10.222.0.16 () {58 vars in 1439 bytes} [Thu May 26 12:22:11 2022] PUT /identity/v3/projects/42e6c693bd224d92b8a0fe4ad0cc586d/users/536f68ff77794352adf41aaacdc0645c/roles/d2c069ef8eed4c73a7fa3aa932c60945 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:22:11.624419 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dbd86f-5edd-45c5-9297-fa4aa1b3c2ff None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:11.625013 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dbd86f-5edd-45c5-9297-fa4aa1b3c2ff None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:11.625013 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dbd86f-5edd-45c5-9297-fa4aa1b3c2ff None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:11.627112 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 541/1073] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:22:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:22:11.632201 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590cf1a-a56b-4e5e-8ca3-edb81b928567 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:11.632499 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590cf1a-a56b-4e5e-8ca3-edb81b928567 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:11.632779 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590cf1a-a56b-4e5e-8ca3-edb81b928567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:11.650536 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-8590cf1a-a56b-4e5e-8ca3-edb81b928567 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:22:11.651763 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8590cf1a-a56b-4e5e-8ca3-edb81b928567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:22:11.722085 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 533/1074] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:22:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:22:11.744228 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dbd86f-5edd-45c5-9297-fa4aa1b3c2ff None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:11.853092 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dbd86f-5edd-45c5-9297-fa4aa1b3c2ff None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:11.888200 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a7079a-0a47-4e96-ab89-1ccc4376b1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:11.888765 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7079a-0a47-4e96-ab89-1ccc4376b1ea None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:11.889107 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7079a-0a47-4e96-ab89-1ccc4376b1ea None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:11.889360 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7079a-0a47-4e96-ab89-1ccc4376b1ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:11.913656 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:11.958308 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a7079a-0a47-4e96-ab89-1ccc4376b1ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:11.959753 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a7079a-0a47-4e96-ab89-1ccc4376b1ea None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:12.061419 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 542/1075] 10.222.0.16 () {58 vars in 1282 bytes} [Thu May 26 12:22:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 12:22:12.062948 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590cf1a-a56b-4e5e-8ca3-edb81b928567 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:12.127187 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:12.163445 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590cf1a-a56b-4e5e-8ca3-edb81b928567 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:12.197590 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34151c-6aeb-4f8d-a9f0-8be7f929928c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:12.198381 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34151c-6aeb-4f8d-a9f0-8be7f929928c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:12.198664 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34151c-6aeb-4f8d-a9f0-8be7f929928c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:12.198947 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34151c-6aeb-4f8d-a9f0-8be7f929928c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:12.209142 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e34151c-6aeb-4f8d-a9f0-8be7f929928c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:12.210607 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e34151c-6aeb-4f8d-a9f0-8be7f929928c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:12.228754 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-2e34151c-6aeb-4f8d-a9f0-8be7f929928c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:22:12.228754 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:12.228754 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:22:12.228754 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:22:12.228754 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:22:12.228754 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:22:12.228754 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:22:12.228754 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:22:12.228754 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:22:12.228754 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:22:12.228754 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:22:12.228754 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:22:12.228754 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:22:12.228754 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:22:12.228754 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:22:12.229697 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:22:12.229697 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:22:12.229697 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:22:12.229697 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:22:12.229697 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:22:12.229697 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:22:12.229697 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:22:12.229697 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:22:12.229697 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:22:12.229697 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:22:12.229697 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:22:12.229697 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:22:12.229697 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:22:12.229697 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:22:12.229697 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:22:12.229697 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:22:12.229697 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:22:12.235404 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:22:12.235404 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:22:12.235404 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:22:12.235404 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:22:12.235404 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 534/1076] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:22:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:22:12.236532 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a7079a-0a47-4e96-ab89-1ccc4376b1ea None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:12.293602 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:12.340281 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a7079a-0a47-4e96-ab89-1ccc4376b1ea None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:12.374820 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f92b07-75de-497d-8eb5-c93dc4b9726e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:12.375480 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f92b07-75de-497d-8eb5-c93dc4b9726e None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:12.375766 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f92b07-75de-497d-8eb5-c93dc4b9726e None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:12.376044 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f92b07-75de-497d-8eb5-c93dc4b9726e None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:12.376848 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f92b07-75de-497d-8eb5-c93dc4b9726e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:12.377172 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f92b07-75de-497d-8eb5-c93dc4b9726e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:12.378531 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f92b07-75de-497d-8eb5-c93dc4b9726e None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:12.396237 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 543/1077] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:22:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:22:12.750930 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160bc11-3234-4e76-8d4a-9cb69e15cc01 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:12.751398 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160bc11-3234-4e76-8d4a-9cb69e15cc01 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:12.751501 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160bc11-3234-4e76-8d4a-9cb69e15cc01 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:12.753098 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 535/1078] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:22:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:22:12.758165 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f341d2-fef3-4b03-907b-24f889716dc5 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:12.758557 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f341d2-fef3-4b03-907b-24f889716dc5 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:12.758733 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f341d2-fef3-4b03-907b-24f889716dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:12.775394 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-01f341d2-fef3-4b03-907b-24f889716dc5 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:22:12.776567 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-01f341d2-fef3-4b03-907b-24f889716dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:22:12.843941 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 544/1079] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:22:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:22:12.866933 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5160bc11-3234-4e76-8d4a-9cb69e15cc01 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:12.967145 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5160bc11-3234-4e76-8d4a-9cb69e15cc01 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:12.984953 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:13.002215 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63effb49-8ea0-4483-838d-9cb9a643d0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:13.002971 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63effb49-8ea0-4483-838d-9cb9a643d0de None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:13.003253 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63effb49-8ea0-4483-838d-9cb9a643d0de None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:13.003527 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63effb49-8ea0-4483-838d-9cb9a643d0de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:13.013612 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63effb49-8ea0-4483-838d-9cb9a643d0de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:22:13.021724 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-63effb49-8ea0-4483-838d-9cb9a643d0de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:22:13.021724 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:13.021724 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:22:13.021724 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:22:13.021724 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:22:13.021724 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:22:13.021724 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:22:13.021724 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:22:13.021724 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:22:13.021724 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:22:13.021724 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:22:13.021724 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:22:13.021724 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:22:13.021724 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:22:13.021724 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:22:13.021724 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:22:13.022675 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:22:13.022675 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:22:13.022675 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:22:13.022675 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:22:13.022675 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:22:13.022675 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:22:13.022675 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:22:13.022675 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:22:13.022675 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:22:13.022675 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:22:13.022675 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:22:13.022675 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:22:13.022675 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:22:13.022675 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:22:13.022675 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:22:13.022675 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:22:13.023550 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:22:13.023550 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:22:13.023550 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:22:13.023550 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:22:13.023550 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:22:13.023550 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:22:13.023550 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:22:13.023550 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:22:13.023550 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:22:13.023550 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:22:13.023550 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:22:13.023550 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:22:13.023550 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 536/1080] 10.222.0.16 () {56 vars in 1096 bytes} [Thu May 26 12:22:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:22:13.029045 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f341d2-fef3-4b03-907b-24f889716dc5 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:13.072487 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:13.125896 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f341d2-fef3-4b03-907b-24f889716dc5 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:13.158715 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29fe5bc-ada9-4617-b14c-61b0d0ccf6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:13.159371 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fe5bc-ada9-4617-b14c-61b0d0ccf6f7 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:13.159661 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fe5bc-ada9-4617-b14c-61b0d0ccf6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:13.159937 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fe5bc-ada9-4617-b14c-61b0d0ccf6f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:13.160681 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29fe5bc-ada9-4617-b14c-61b0d0ccf6f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:13.161170 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29fe5bc-ada9-4617-b14c-61b0d0ccf6f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:13.162543 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29fe5bc-ada9-4617-b14c-61b0d0ccf6f7 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:13.170974 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 545/1081] 10.222.0.16 () {56 vars in 1099 bytes} [Thu May 26 12:22:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:13.177549 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63effb49-8ea0-4483-838d-9cb9a643d0de None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:13.278025 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63effb49-8ea0-4483-838d-9cb9a643d0de None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:13.310660 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f041a42-c7d0-423f-a571-db3439593951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:13.311529 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f041a42-c7d0-423f-a571-db3439593951 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:13.311809 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f041a42-c7d0-423f-a571-db3439593951 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:13.312082 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f041a42-c7d0-423f-a571-db3439593951 None admin] PATH_INFO: `/v3/users/6fab3cce2e3447839cb3b52f2c4bdbb2` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:13.313297 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f041a42-c7d0-423f-a571-db3439593951 None admin] RBAC: Authorizing `identity:get_user(user_id=6fab3cce2e3447839cb3b52f2c4bdbb2)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:13.315288 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f041a42-c7d0-423f-a571-db3439593951 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:13.316939 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 537/1082] 10.222.0.16 () {56 vars in 1177 bytes} [Thu May 26 12:22:13 2022] GET /identity/v3/users/6fab3cce2e3447839cb3b52f2c4bdbb2 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:13.322590 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29fe5bc-ada9-4617-b14c-61b0d0ccf6f7 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:13.371042 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30460813-abbd-4915-8caa-3dd841018c69 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:13.371323 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30460813-abbd-4915-8caa-3dd841018c69 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:13.371603 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30460813-abbd-4915-8caa-3dd841018c69 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:13.372994 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 538/1083] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:22:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:22:13.377887 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccef9dd-599d-49dc-bcd6-e3d46f24c1bc None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:13.378175 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccef9dd-599d-49dc-bcd6-e3d46f24c1bc None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:13.378460 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccef9dd-599d-49dc-bcd6-e3d46f24c1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:13.394642 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-9ccef9dd-599d-49dc-bcd6-e3d46f24c1bc None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:22:13.395826 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9ccef9dd-599d-49dc-bcd6-e3d46f24c1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:22:13.421863 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29fe5bc-ada9-4617-b14c-61b0d0ccf6f7 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:13.430161 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:13.438589 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:13.457424 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba10847-9fd8-46cc-8f4d-4d5de479a571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:13.458281 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba10847-9fd8-46cc-8f4d-4d5de479a571 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:13.458566 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba10847-9fd8-46cc-8f4d-4d5de479a571 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:13.458841 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba10847-9fd8-46cc-8f4d-4d5de479a571 None admin] PATH_INFO: `/v3/projects/32613a2d0b4e49988a08ac9fea5fb88a` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:13.460026 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba10847-9fd8-46cc-8f4d-4d5de479a571 None admin] RBAC: Authorizing `identity:get_project(project_id=32613a2d0b4e49988a08ac9fea5fb88a)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:13.461486 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba10847-9fd8-46cc-8f4d-4d5de479a571 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:13.463211 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 546/1084] 10.222.0.16 () {56 vars in 1186 bytes} [Thu May 26 12:22:13 2022] GET /identity/v3/projects/32613a2d0b4e49988a08ac9fea5fb88a => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:22:13.463643 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 539/1085] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:22:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:22:13.468953 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba10847-9fd8-46cc-8f4d-4d5de479a571 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:13.487514 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccef9dd-599d-49dc-bcd6-e3d46f24c1bc None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:13.568722 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba10847-9fd8-46cc-8f4d-4d5de479a571 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:13.585514 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccef9dd-599d-49dc-bcd6-e3d46f24c1bc None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:13.601394 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c66eb-88af-4696-b96b-ca4cc258b6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:13.602271 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c66eb-88af-4696-b96b-ca4cc258b6d5 None admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:13.602552 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c66eb-88af-4696-b96b-ca4cc258b6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:13.602824 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c66eb-88af-4696-b96b-ca4cc258b6d5 None admin] PATH_INFO: `/v3/projects/32613a2d0b4e49988a08ac9fea5fb88a/users/6fab3cce2e3447839cb3b52f2c4bdbb2/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:13.604764 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c66eb-88af-4696-b96b-ca4cc258b6d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=32613a2d0b4e49988a08ac9fea5fb88a, user_id=6fab3cce2e3447839cb3b52f2c4bdbb2, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:13.606211 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c66eb-88af-4696-b96b-ca4cc258b6d5 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:13.619124 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 547/1086] 10.222.0.16 () {58 vars in 1439 bytes} [Thu May 26 12:22:13 2022] PUT /identity/v3/projects/32613a2d0b4e49988a08ac9fea5fb88a/users/6fab3cce2e3447839cb3b52f2c4bdbb2/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:22:13.620141 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c3c74-b0f4-4875-b213-178257a423fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:13.620985 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c3c74-b0f4-4875-b213-178257a423fa None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:13.621273 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c3c74-b0f4-4875-b213-178257a423fa None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:13.621549 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c3c74-b0f4-4875-b213-178257a423fa None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:13.633539 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9c3c74-b0f4-4875-b213-178257a423fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:22:13.642508 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-df9c3c74-b0f4-4875-b213-178257a423fa None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 12:22:13.642508 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:13.642508 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:22:13.642508 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:22:13.642508 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:22:13.642508 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:22:13.642508 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:22:13.642508 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:22:13.642508 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:22:13.642508 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:22:13.642508 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:22:13.642508 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:22:13.642508 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:22:13.642508 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:22:13.642508 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:22:13.642508 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:22:13.643590 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:22:13.643590 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:22:13.643590 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:22:13.643590 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:22:13.643590 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:22:13.643590 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:22:13.643590 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:22:13.643590 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:22:13.643590 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:22:13.643590 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:22:13.643590 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:22:13.643590 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:22:13.643590 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:22:13.643590 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:22:13.643590 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:22:13.643590 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:22:13.644442 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:22:13.644442 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:22:13.644442 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:22:13.644442 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:22:13.644442 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:22:13.644442 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:22:13.644442 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:22:13.644442 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:22:13.644442 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:22:13.644442 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:22:13.644442 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 12:22:13.644442 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:22:13.644442 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 540/1087] 10.222.0.16 () {56 vars in 1120 bytes} [Thu May 26 12:22:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:22:13.650137 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c66eb-88af-4696-b96b-ca4cc258b6d5 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:13.686727 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:13.760509 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c66eb-88af-4696-b96b-ca4cc258b6d5 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:13.796360 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4362bb3-b408-4c18-bd35-e3edfdbbdd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:13.797054 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4362bb3-b408-4c18-bd35-e3edfdbbdd5d None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:13.797335 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4362bb3-b408-4c18-bd35-e3edfdbbdd5d None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:13.797608 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4362bb3-b408-4c18-bd35-e3edfdbbdd5d None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:13.798894 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4362bb3-b408-4c18-bd35-e3edfdbbdd5d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:13.799198 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4362bb3-b408-4c18-bd35-e3edfdbbdd5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:13.800562 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4362bb3-b408-4c18-bd35-e3edfdbbdd5d None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:13.808921 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 548/1088] 10.222.0.16 () {56 vars in 1115 bytes} [Thu May 26 12:22:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:13.814800 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c3c74-b0f4-4875-b213-178257a423fa None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:13.852508 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:13.915026 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c3c74-b0f4-4875-b213-178257a423fa None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:13.946537 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37935392-ae91-4f47-8500-cad2581ab8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:13.947315 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37935392-ae91-4f47-8500-cad2581ab8e1 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:13.947592 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37935392-ae91-4f47-8500-cad2581ab8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:13.947859 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37935392-ae91-4f47-8500-cad2581ab8e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:13.958623 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37935392-ae91-4f47-8500-cad2581ab8e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:13.960059 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37935392-ae91-4f47-8500-cad2581ab8e1 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:13.977186 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-37935392-ae91-4f47-8500-cad2581ab8e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:22:13.977186 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:13.977186 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:22:13.977186 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:22:13.977186 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:22:13.977186 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:22:13.977186 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:22:13.977186 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:22:13.977186 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:22:13.977186 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:22:13.977186 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:22:13.977186 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:22:13.977186 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:22:13.977186 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:22:13.977186 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:22:13.978258 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:22:13.978258 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:22:13.978258 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:22:13.978258 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:22:13.978258 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:22:13.978258 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:22:13.978258 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:22:13.978258 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:22:13.978258 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:22:13.978258 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:22:13.978258 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:22:13.978258 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:22:13.978258 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:22:13.978258 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:22:13.978258 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:22:13.978258 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:22:13.978258 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:22:13.979284 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:22:13.979284 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:22:13.979284 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:22:13.979284 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:22:13.979284 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 541/1089] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:22:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:22:13.984063 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4362bb3-b408-4c18-bd35-e3edfdbbdd5d None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:14.074706 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:14.080832 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4362bb3-b408-4c18-bd35-e3edfdbbdd5d None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:14.113474 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e03a2-4043-4659-b18d-081d98bed033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:14.114048 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e03a2-4043-4659-b18d-081d98bed033 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:14.114326 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e03a2-4043-4659-b18d-081d98bed033 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:14.114595 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e03a2-4043-4659-b18d-081d98bed033 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:14.115309 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9e03a2-4043-4659-b18d-081d98bed033 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:14.115607 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9e03a2-4043-4659-b18d-081d98bed033 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:14.116982 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9e03a2-4043-4659-b18d-081d98bed033 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:14.128831 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 549/1090] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:22:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:22:14.134546 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37935392-ae91-4f47-8500-cad2581ab8e1 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:14.219187 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:14.231848 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37935392-ae91-4f47-8500-cad2581ab8e1 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:14.264046 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245769ad-837e-47bd-85bb-8e735395ca2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:14.264830 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245769ad-837e-47bd-85bb-8e735395ca2d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:14.265135 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245769ad-837e-47bd-85bb-8e735395ca2d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:14.265404 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245769ad-837e-47bd-85bb-8e735395ca2d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:14.272689 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245769ad-837e-47bd-85bb-8e735395ca2d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:14.274179 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245769ad-837e-47bd-85bb-8e735395ca2d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:14.288290 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-245769ad-837e-47bd-85bb-8e735395ca2d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 12:22:14.288290 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:14.288290 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:22:14.288290 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:22:14.288290 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:22:14.288290 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:22:14.288290 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:22:14.288290 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:22:14.288290 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:22:14.288290 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:22:14.288290 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:22:14.288290 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:22:14.288290 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:22:14.288290 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:22:14.288290 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:22:14.288290 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:22:14.289269 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:22:14.289269 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:22:14.289269 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:22:14.289269 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:22:14.289269 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:22:14.289269 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:22:14.289269 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:22:14.289269 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:22:14.289269 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:22:14.289269 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:22:14.289269 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:22:14.289269 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:22:14.289269 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:22:14.289269 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:22:14.289269 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:22:14.289269 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:22:14.289269 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:22:14.289269 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:22:14.290224 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:22:14.290224 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:22:14.290224 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:22:14.290224 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:22:14.290224 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:22:14.290224 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:22:14.290224 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:22:14.290224 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:22:14.290224 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 12:22:14.290224 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:22:14.290224 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 542/1091] 10.222.0.16 () {56 vars in 1093 bytes} [Thu May 26 12:22:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:22:14.295364 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e03a2-4043-4659-b18d-081d98bed033 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:14.392800 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e03a2-4043-4659-b18d-081d98bed033 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:14.425725 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ced583-fc72-4162-b700-3953de465c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:14.426375 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ced583-fc72-4162-b700-3953de465c88 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:14.426650 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ced583-fc72-4162-b700-3953de465c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:14.426917 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ced583-fc72-4162-b700-3953de465c88 None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:14.427742 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ced583-fc72-4162-b700-3953de465c88 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:14.428047 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ced583-fc72-4162-b700-3953de465c88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:14.429499 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ced583-fc72-4162-b700-3953de465c88 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:14.446446 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 550/1092] 10.222.0.16 () {56 vars in 1133 bytes} [Thu May 26 12:22:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:14.452245 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245769ad-837e-47bd-85bb-8e735395ca2d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:14.552646 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245769ad-837e-47bd-85bb-8e735395ca2d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:14.585235 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc7070-ac2e-48d3-bdb4-f598c02daf93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:14.585880 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc7070-ac2e-48d3-bdb4-f598c02daf93 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:14.586168 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc7070-ac2e-48d3-bdb4-f598c02daf93 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:14.586497 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc7070-ac2e-48d3-bdb4-f598c02daf93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:14.603615 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:14.651972 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfc7070-ac2e-48d3-bdb4-f598c02daf93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:14.653408 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfc7070-ac2e-48d3-bdb4-f598c02daf93 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:14.755802 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 543/1093] 10.222.0.16 () {58 vars in 1282 bytes} [Thu May 26 12:22:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:22:14.757314 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ced583-fc72-4162-b700-3953de465c88 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:14.772795 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:14.856132 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ced583-fc72-4162-b700-3953de465c88 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:14.890827 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f93f42f-d30e-4781-82f0-799c489e82e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:14.891608 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f93f42f-d30e-4781-82f0-799c489e82e3 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:14.892458 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f93f42f-d30e-4781-82f0-799c489e82e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:14.892732 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f93f42f-d30e-4781-82f0-799c489e82e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:14.902598 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f93f42f-d30e-4781-82f0-799c489e82e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:14.903976 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f93f42f-d30e-4781-82f0-799c489e82e3 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:14.920887 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-4f93f42f-d30e-4781-82f0-799c489e82e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:22:14.920887 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:14.920887 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:22:14.920887 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:22:14.920887 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:22:14.920887 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:22:14.920887 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:22:14.920887 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:22:14.920887 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:22:14.920887 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:22:14.920887 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:22:14.920887 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:22:14.920887 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:22:14.920887 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:22:14.920887 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:22:14.921910 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:22:14.921910 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:22:14.921910 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:22:14.921910 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:22:14.921910 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:22:14.921910 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:22:14.921910 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:22:14.921910 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:22:14.921910 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:22:14.921910 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:22:14.921910 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:22:14.921910 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:22:14.921910 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:22:14.921910 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:22:14.921910 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:22:14.921910 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:22:14.921910 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:22:14.922928 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:22:14.922928 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:22:14.922928 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:22:14.922928 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:22:14.922928 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 551/1094] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:22:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:22:14.927875 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc7070-ac2e-48d3-bdb4-f598c02daf93 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:14.975149 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:15.024603 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc7070-ac2e-48d3-bdb4-f598c02daf93 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:15.057370 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed5807-986a-4915-839f-57356e0dbf16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:15.058017 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed5807-986a-4915-839f-57356e0dbf16 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:15.058298 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed5807-986a-4915-839f-57356e0dbf16 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:15.058571 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed5807-986a-4915-839f-57356e0dbf16 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:15.059285 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ed5807-986a-4915-839f-57356e0dbf16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:15.059591 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ed5807-986a-4915-839f-57356e0dbf16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:15.060998 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ed5807-986a-4915-839f-57356e0dbf16 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:15.072375 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 544/1095] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:22:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:15.077861 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f93f42f-d30e-4781-82f0-799c489e82e3 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:15.141534 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:15.175877 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f93f42f-d30e-4781-82f0-799c489e82e3 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:15.208612 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f428ad60-afdf-4ae9-ab3f-8e60e2857abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:15.209428 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428ad60-afdf-4ae9-ab3f-8e60e2857abe None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:15.209709 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428ad60-afdf-4ae9-ab3f-8e60e2857abe None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:15.209981 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428ad60-afdf-4ae9-ab3f-8e60e2857abe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:15.216501 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f428ad60-afdf-4ae9-ab3f-8e60e2857abe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:15.217968 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f428ad60-afdf-4ae9-ab3f-8e60e2857abe None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:15.231542 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-f428ad60-afdf-4ae9-ab3f-8e60e2857abe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:22:15.231542 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:15.231542 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:22:15.231542 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:22:15.231542 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:22:15.231542 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:22:15.231542 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:22:15.231542 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:22:15.231542 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:22:15.231542 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:22:15.231542 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:22:15.231542 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:22:15.231542 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:22:15.231542 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:22:15.231542 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:22:15.232584 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:22:15.232584 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:22:15.232584 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:22:15.232584 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:22:15.232584 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:22:15.232584 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:22:15.232584 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:22:15.232584 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:22:15.232584 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:22:15.232584 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:22:15.232584 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:22:15.232584 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:22:15.232584 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:22:15.232584 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:22:15.232584 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:22:15.232584 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:22:15.232584 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:22:15.233915 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:22:15.233915 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:22:15.233915 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:22:15.233915 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:22:15.233915 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:22:15.233915 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:22:15.233915 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:22:15.233915 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:22:15.233915 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 552/1096] 10.222.0.16 () {56 vars in 1111 bytes} [Thu May 26 12:22:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:22:15.239029 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed5807-986a-4915-839f-57356e0dbf16 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:15.337496 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed5807-986a-4915-839f-57356e0dbf16 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:15.346688 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:15.371721 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d6475b-027b-4231-a7c0-aa29ec9a4748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:15.372378 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6475b-027b-4231-a7c0-aa29ec9a4748 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:15.372662 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6475b-027b-4231-a7c0-aa29ec9a4748 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:15.372968 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6475b-027b-4231-a7c0-aa29ec9a4748 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:15.373753 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d6475b-027b-4231-a7c0-aa29ec9a4748 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:15.374064 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d6475b-027b-4231-a7c0-aa29ec9a4748 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:15.375615 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d6475b-027b-4231-a7c0-aa29ec9a4748 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:15.388130 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 545/1097] 10.222.0.16 () {56 vars in 1148 bytes} [Thu May 26 12:22:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:15.394489 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f428ad60-afdf-4ae9-ab3f-8e60e2857abe None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:15.494091 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f428ad60-afdf-4ae9-ab3f-8e60e2857abe None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:15.518873 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:15.527811 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb76dd-8816-49b1-843f-e448974992c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:15.528461 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb76dd-8816-49b1-843f-e448974992c2 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:15.528744 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb76dd-8816-49b1-843f-e448974992c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:15.529050 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb76dd-8816-49b1-843f-e448974992c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:15.529875 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb76dd-8816-49b1-843f-e448974992c2 None admin] RBAC: Adding query filter params (role.id=d2c069ef8eed4c73a7fa3aa932c60945, scope.project.id=42e6c693bd224d92b8a0fe4ad0cc586d, user.id=536f68ff77794352adf41aaacdc0645c) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:15.530186 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb76dd-8816-49b1-843f-e448974992c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:15.531605 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb76dd-8816-49b1-843f-e448974992c2 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:15.537451 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 553/1098] 10.222.0.16 () {56 vars in 1374 bytes} [Thu May 26 12:22:15 2022] GET /identity/v3/role_assignments?user.id=536f68ff77794352adf41aaacdc0645c&scope.project.id=42e6c693bd224d92b8a0fe4ad0cc586d&role.id=d2c069ef8eed4c73a7fa3aa932c60945 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:15.826440 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceabf299-a75c-46a2-a6a3-a1f5bb17cc69 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:15.826725 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceabf299-a75c-46a2-a6a3-a1f5bb17cc69 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:15.827079 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceabf299-a75c-46a2-a6a3-a1f5bb17cc69 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:15.828389 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 546/1099] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:22:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:22:15.833967 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca343b-e37d-4a16-814c-29d9fd08d968 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:15.834438 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca343b-e37d-4a16-814c-29d9fd08d968 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:15.834538 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca343b-e37d-4a16-814c-29d9fd08d968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:15.851945 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-27ca343b-e37d-4a16-814c-29d9fd08d968 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:22:15.853153 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-27ca343b-e37d-4a16-814c-29d9fd08d968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:22:15.919589 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 554/1100] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:22:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:22:15.942776 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceabf299-a75c-46a2-a6a3-a1f5bb17cc69 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:16.044984 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceabf299-a75c-46a2-a6a3-a1f5bb17cc69 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:16.077949 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf0f4c7-d0de-4ff9-8b6b-9f39abadf8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:16.078739 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0f4c7-d0de-4ff9-8b6b-9f39abadf8de None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:16.079022 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0f4c7-d0de-4ff9-8b6b-9f39abadf8de None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:16.079813 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0f4c7-d0de-4ff9-8b6b-9f39abadf8de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:16.089867 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf0f4c7-d0de-4ff9-8b6b-9f39abadf8de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:22:16.098023 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-abf0f4c7-d0de-4ff9-8b6b-9f39abadf8de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:22:16.098023 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:16.098023 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:22:16.098023 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:22:16.098023 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:22:16.098023 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:22:16.098023 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:22:16.098023 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:22:16.098023 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:22:16.098023 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:22:16.098023 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:22:16.098023 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:22:16.098023 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:22:16.098023 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:22:16.098023 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:22:16.098023 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:22:16.099039 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:22:16.099039 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:22:16.099039 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:22:16.099039 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:22:16.099039 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:22:16.099039 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:22:16.099039 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:22:16.099039 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:22:16.099039 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:22:16.099039 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:22:16.099039 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:22:16.099039 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:22:16.099039 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:22:16.099039 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:22:16.099039 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:22:16.099039 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:22:16.099914 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:22:16.099914 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:22:16.099914 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:22:16.099914 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:22:16.099914 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:22:16.099914 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:22:16.099914 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:22:16.099914 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:22:16.099914 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:22:16.099914 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:22:16.099914 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:22:16.099914 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:22:16.101135 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 547/1101] 10.222.0.16 () {56 vars in 1096 bytes} [Thu May 26 12:22:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:22:16.105691 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca343b-e37d-4a16-814c-29d9fd08d968 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:16.206642 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca343b-e37d-4a16-814c-29d9fd08d968 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:16.226941 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:16.241821 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d4af28-c0ba-4358-8b19-e285aeb5f2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:16.242486 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4af28-c0ba-4358-8b19-e285aeb5f2d1 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:16.242766 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4af28-c0ba-4358-8b19-e285aeb5f2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:16.243040 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4af28-c0ba-4358-8b19-e285aeb5f2d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:16.243789 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d4af28-c0ba-4358-8b19-e285aeb5f2d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:16.244089 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d4af28-c0ba-4358-8b19-e285aeb5f2d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:16.245474 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d4af28-c0ba-4358-8b19-e285aeb5f2d1 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:16.254281 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 555/1102] 10.222.0.16 () {56 vars in 1099 bytes} [Thu May 26 12:22:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:16.260279 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf0f4c7-d0de-4ff9-8b6b-9f39abadf8de None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:16.290155 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:16.367590 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf0f4c7-d0de-4ff9-8b6b-9f39abadf8de None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:16.401312 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179bbd38-7eba-464d-a50e-ed33a0191ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:16.402193 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179bbd38-7eba-464d-a50e-ed33a0191ec5 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:16.402477 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179bbd38-7eba-464d-a50e-ed33a0191ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:16.402754 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179bbd38-7eba-464d-a50e-ed33a0191ec5 None admin] PATH_INFO: `/v3/users/6fab3cce2e3447839cb3b52f2c4bdbb2` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:16.403948 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179bbd38-7eba-464d-a50e-ed33a0191ec5 None admin] RBAC: Authorizing `identity:get_user(user_id=6fab3cce2e3447839cb3b52f2c4bdbb2)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:16.405444 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179bbd38-7eba-464d-a50e-ed33a0191ec5 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:16.407083 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 548/1103] 10.222.0.16 () {56 vars in 1177 bytes} [Thu May 26 12:22:16 2022] GET /identity/v3/users/6fab3cce2e3447839cb3b52f2c4bdbb2 => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:16.413604 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d4af28-c0ba-4358-8b19-e285aeb5f2d1 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:16.511984 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d4af28-c0ba-4358-8b19-e285aeb5f2d1 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:16.546814 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ace181-d38b-45f1-9036-cf38a1f103f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:16.547445 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ace181-d38b-45f1-9036-cf38a1f103f2 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:16.547726 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ace181-d38b-45f1-9036-cf38a1f103f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:16.548000 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ace181-d38b-45f1-9036-cf38a1f103f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:16.594645 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:16.614332 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ace181-d38b-45f1-9036-cf38a1f103f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:16.615765 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ace181-d38b-45f1-9036-cf38a1f103f2 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:16.709573 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 556/1104] 10.222.0.16 () {58 vars in 1282 bytes} [Thu May 26 12:22:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:22:16.715311 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179bbd38-7eba-464d-a50e-ed33a0191ec5 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:16.807226 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:16.814591 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179bbd38-7eba-464d-a50e-ed33a0191ec5 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:16.848747 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c1b59f-5b56-4c87-8b0f-c320c24c17d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:16.849637 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1b59f-5b56-4c87-8b0f-c320c24c17d1 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:16.849927 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1b59f-5b56-4c87-8b0f-c320c24c17d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:16.850199 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1b59f-5b56-4c87-8b0f-c320c24c17d1 None admin] PATH_INFO: `/v3/projects/32613a2d0b4e49988a08ac9fea5fb88a` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:16.851393 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c1b59f-5b56-4c87-8b0f-c320c24c17d1 None admin] RBAC: Authorizing `identity:get_project(project_id=32613a2d0b4e49988a08ac9fea5fb88a)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:16.852861 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c1b59f-5b56-4c87-8b0f-c320c24c17d1 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:16.854583 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 549/1105] 10.222.0.16 () {56 vars in 1186 bytes} [Thu May 26 12:22:16 2022] GET /identity/v3/projects/32613a2d0b4e49988a08ac9fea5fb88a => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:16.860730 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ace181-d38b-45f1-9036-cf38a1f103f2 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:16.940170 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:16.958207 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ace181-d38b-45f1-9036-cf38a1f103f2 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:16.990701 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd25766-30d3-4e0d-939a-030d59c9e452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:16.991340 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd25766-30d3-4e0d-939a-030d59c9e452 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:16.991618 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd25766-30d3-4e0d-939a-030d59c9e452 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:16.991889 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd25766-30d3-4e0d-939a-030d59c9e452 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:16.992700 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd25766-30d3-4e0d-939a-030d59c9e452 None admin] RBAC: Adding query filter params (role.id=1a8e523ecbc84d818c2a9af0fb54da74, scope.project.id=32613a2d0b4e49988a08ac9fea5fb88a, user.id=6fab3cce2e3447839cb3b52f2c4bdbb2) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:16.993040 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd25766-30d3-4e0d-939a-030d59c9e452 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:16.994448 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd25766-30d3-4e0d-939a-030d59c9e452 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:17.000092 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 557/1106] 10.222.0.16 () {56 vars in 1374 bytes} [Thu May 26 12:22:16 2022] GET /identity/v3/role_assignments?user.id=6fab3cce2e3447839cb3b52f2c4bdbb2&scope.project.id=32613a2d0b4e49988a08ac9fea5fb88a&role.id=1a8e523ecbc84d818c2a9af0fb54da74 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:19.186250 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75511e96-7a6f-47fa-9c4e-ab4c48f22e30 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:19.186764 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75511e96-7a6f-47fa-9c4e-ab4c48f22e30 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:19.186764 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75511e96-7a6f-47fa-9c4e-ab4c48f22e30 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:19.188127 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 550/1107] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:22:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:22:19.193563 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490e168-a561-4eeb-93cb-f2a5ae82bc0d None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:19.193986 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490e168-a561-4eeb-93cb-f2a5ae82bc0d None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:19.194125 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490e168-a561-4eeb-93cb-f2a5ae82bc0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:19.211154 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-9490e168-a561-4eeb-93cb-f2a5ae82bc0d None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:22:19.212336 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-9490e168-a561-4eeb-93cb-f2a5ae82bc0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:22:19.276898 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 558/1108] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:22:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:22:19.301398 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75511e96-7a6f-47fa-9c4e-ab4c48f22e30 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:19.401159 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75511e96-7a6f-47fa-9c4e-ab4c48f22e30 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:19.433844 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3913ce2e-e02a-465a-a0b8-40b01b043669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:19.434617 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913ce2e-e02a-465a-a0b8-40b01b043669 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:19.434900 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913ce2e-e02a-465a-a0b8-40b01b043669 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:19.435173 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913ce2e-e02a-465a-a0b8-40b01b043669 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:19.436390 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3913ce2e-e02a-465a-a0b8-40b01b043669 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:19.437800 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3913ce2e-e02a-465a-a0b8-40b01b043669 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:19.439933 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 551/1109] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:22:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:19.445625 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9490e168-a561-4eeb-93cb-f2a5ae82bc0d None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:19.519790 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:19.541840 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9490e168-a561-4eeb-93cb-f2a5ae82bc0d None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:19.575367 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d42764-c48c-4c47-9e72-e907c6720125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:19.576027 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d42764-c48c-4c47-9e72-e907c6720125 None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:19.576312 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d42764-c48c-4c47-9e72-e907c6720125 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:19.576589 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d42764-c48c-4c47-9e72-e907c6720125 None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:19.577328 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d42764-c48c-4c47-9e72-e907c6720125 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:19.578752 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d42764-c48c-4c47-9e72-e907c6720125 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:19.598497 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 559/1110] 10.222.0.16 () {60 vars in 1132 bytes} [Thu May 26 12:22:19 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:22:21.801619 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8f037-edc7-47bf-981c-33b940d4bf3f None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:21.802091 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8f037-edc7-47bf-981c-33b940d4bf3f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:21.802198 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8f037-edc7-47bf-981c-33b940d4bf3f None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:21.803533 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 552/1111] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:22:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:22:21.808742 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c462b-0e60-42ca-85e5-d7d8ec0ef4e6 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:21.809208 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c462b-0e60-42ca-85e5-d7d8ec0ef4e6 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:21.809303 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c462b-0e60-42ca-85e5-d7d8ec0ef4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:21.825601 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-587c462b-0e60-42ca-85e5-d7d8ec0ef4e6 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:22:21.826761 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-587c462b-0e60-42ca-85e5-d7d8ec0ef4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:22:21.890201 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 560/1112] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:22:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:22:21.914121 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d8f037-edc7-47bf-981c-33b940d4bf3f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:21.944254 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:22.014844 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d8f037-edc7-47bf-981c-33b940d4bf3f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:22.047115 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b6457b-cea3-42d5-828b-4d52640c207b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:22.047959 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6457b-cea3-42d5-828b-4d52640c207b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:22.048281 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6457b-cea3-42d5-828b-4d52640c207b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:22.048555 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6457b-cea3-42d5-828b-4d52640c207b None admin] PATH_INFO: `/v3/roles/e0f421b5486c47aebb20ea10342cb1e3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:22.050026 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b6457b-cea3-42d5-828b-4d52640c207b None admin] RBAC: Authorizing `identity:get_role(role_id=e0f421b5486c47aebb20ea10342cb1e3)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:22.051390 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b6457b-cea3-42d5-828b-4d52640c207b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:22.052735 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 553/1113] 10.222.0.16 () {56 vars in 1177 bytes} [Thu May 26 12:22:21 2022] GET /identity/v3/roles/e0f421b5486c47aebb20ea10342cb1e3 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:22.058507 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c462b-0e60-42ca-85e5-d7d8ec0ef4e6 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:22.118547 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:22.156007 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c462b-0e60-42ca-85e5-d7d8ec0ef4e6 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:22.189077 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76660f3d-5ac1-473b-8e4e-92fd79ea0cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:22.189933 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76660f3d-5ac1-473b-8e4e-92fd79ea0cdd None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:22.190214 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76660f3d-5ac1-473b-8e4e-92fd79ea0cdd None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:22.190487 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76660f3d-5ac1-473b-8e4e-92fd79ea0cdd None admin] PATH_INFO: `/v3/users/18b19cf5c2034f47ab6eca71efe39ed2` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:22.203260 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76660f3d-5ac1-473b-8e4e-92fd79ea0cdd None admin] RBAC: Authorizing `identity:get_user(user_id=18b19cf5c2034f47ab6eca71efe39ed2)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:22.205212 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76660f3d-5ac1-473b-8e4e-92fd79ea0cdd None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:22.206849 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 561/1114] 10.222.0.16 () {56 vars in 1177 bytes} [Thu May 26 12:22:22 2022] GET /identity/v3/users/18b19cf5c2034f47ab6eca71efe39ed2 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:22.212502 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b6457b-cea3-42d5-828b-4d52640c207b None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:22.305530 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:22.308352 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b6457b-cea3-42d5-828b-4d52640c207b None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:22.342058 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb08d21-18f5-4149-9187-e7870192e558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:22.342687 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb08d21-18f5-4149-9187-e7870192e558 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:22.342964 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb08d21-18f5-4149-9187-e7870192e558 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:22.343234 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb08d21-18f5-4149-9187-e7870192e558 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:22.406447 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb08d21-18f5-4149-9187-e7870192e558 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:22.407909 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb08d21-18f5-4149-9187-e7870192e558 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:22.499573 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:22.503135 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 554/1115] 10.222.0.16 () {58 vars in 1282 bytes} [Thu May 26 12:22:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:22:22.509012 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76660f3d-5ac1-473b-8e4e-92fd79ea0cdd None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:22.604790 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76660f3d-5ac1-473b-8e4e-92fd79ea0cdd None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:22.624105 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:22.638468 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56fc5c7-833a-4713-b659-dc1896662f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:22.639305 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56fc5c7-833a-4713-b659-dc1896662f3c None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:22.639584 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56fc5c7-833a-4713-b659-dc1896662f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:22.639853 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56fc5c7-833a-4713-b659-dc1896662f3c None admin] PATH_INFO: `/v3/projects/32613a2d0b4e49988a08ac9fea5fb88a` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:22.641026 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56fc5c7-833a-4713-b659-dc1896662f3c None admin] RBAC: Authorizing `identity:get_project(project_id=32613a2d0b4e49988a08ac9fea5fb88a)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:22.643024 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56fc5c7-833a-4713-b659-dc1896662f3c None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:22.644682 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 562/1116] 10.222.0.16 () {56 vars in 1186 bytes} [Thu May 26 12:22:22 2022] GET /identity/v3/projects/32613a2d0b4e49988a08ac9fea5fb88a => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:22.650596 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb08d21-18f5-4149-9187-e7870192e558 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:22.745702 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb08d21-18f5-4149-9187-e7870192e558 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:22.778699 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a435a-e4a6-4ce8-b425-75fc937d6419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:22.779346 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a435a-e4a6-4ce8-b425-75fc937d6419 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:22.779630 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a435a-e4a6-4ce8-b425-75fc937d6419 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:22.779906 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a435a-e4a6-4ce8-b425-75fc937d6419 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:22.780732 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9a435a-e4a6-4ce8-b425-75fc937d6419 None admin] RBAC: Adding query filter params (role.id=e0f421b5486c47aebb20ea10342cb1e3, scope.project.id=32613a2d0b4e49988a08ac9fea5fb88a, user.id=18b19cf5c2034f47ab6eca71efe39ed2) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:22.781081 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9a435a-e4a6-4ce8-b425-75fc937d6419 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:22.782538 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9a435a-e4a6-4ce8-b425-75fc937d6419 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:22.787858 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 555/1117] 10.222.0.16 () {56 vars in 1374 bytes} [Thu May 26 12:22:22 2022] GET /identity/v3/role_assignments?user.id=18b19cf5c2034f47ab6eca71efe39ed2&scope.project.id=32613a2d0b4e49988a08ac9fea5fb88a&role.id=e0f421b5486c47aebb20ea10342cb1e3 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:24.902414 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f6bce-da85-4ab6-883c-7768e67ec241 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:24.902928 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f6bce-da85-4ab6-883c-7768e67ec241 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:24.903055 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f6bce-da85-4ab6-883c-7768e67ec241 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:24.904325 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 563/1118] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:22:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:22:24.910193 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51227c6e-2da5-4517-9daf-51b557b4140b None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:24.910605 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51227c6e-2da5-4517-9daf-51b557b4140b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:24.910751 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51227c6e-2da5-4517-9daf-51b557b4140b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:24.927730 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-51227c6e-2da5-4517-9daf-51b557b4140b None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:22:24.928970 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-51227c6e-2da5-4517-9daf-51b557b4140b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:22:24.987058 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:24.995538 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 556/1119] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:22:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:22:25.018484 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f6bce-da85-4ab6-883c-7768e67ec241 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:25.116539 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f6bce-da85-4ab6-883c-7768e67ec241 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:25.149062 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43292c7a-2139-41cc-9a56-55218e879b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:25.149892 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43292c7a-2139-41cc-9a56-55218e879b0c None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:25.150171 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43292c7a-2139-41cc-9a56-55218e879b0c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:25.150439 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43292c7a-2139-41cc-9a56-55218e879b0c None admin] PATH_INFO: `/v3/roles/e0f421b5486c47aebb20ea10342cb1e3` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:25.151889 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43292c7a-2139-41cc-9a56-55218e879b0c None admin] RBAC: Authorizing `identity:get_role(role_id=e0f421b5486c47aebb20ea10342cb1e3)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:25.153273 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43292c7a-2139-41cc-9a56-55218e879b0c None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:25.154617 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 564/1120] 10.222.0.16 () {56 vars in 1177 bytes} [Thu May 26 12:22:25 2022] GET /identity/v3/roles/e0f421b5486c47aebb20ea10342cb1e3 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:25.160733 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51227c6e-2da5-4517-9daf-51b557b4140b None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:25.255469 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51227c6e-2da5-4517-9daf-51b557b4140b None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:25.288350 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d0c14-b0dd-499b-84b9-66d6ecc7ca72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:25.289180 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d0c14-b0dd-499b-84b9-66d6ecc7ca72 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:25.289465 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d0c14-b0dd-499b-84b9-66d6ecc7ca72 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:25.289741 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d0c14-b0dd-499b-84b9-66d6ecc7ca72 None admin] PATH_INFO: `/v3/users/18b19cf5c2034f47ab6eca71efe39ed2` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:25.290915 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069d0c14-b0dd-499b-84b9-66d6ecc7ca72 None admin] RBAC: Authorizing `identity:get_user(user_id=18b19cf5c2034f47ab6eca71efe39ed2)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:25.292351 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069d0c14-b0dd-499b-84b9-66d6ecc7ca72 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:25.293968 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 557/1121] 10.222.0.16 () {56 vars in 1177 bytes} [Thu May 26 12:22:25 2022] GET /identity/v3/users/18b19cf5c2034f47ab6eca71efe39ed2 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:25.299738 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43292c7a-2139-41cc-9a56-55218e879b0c None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:25.358020 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:25.401143 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43292c7a-2139-41cc-9a56-55218e879b0c None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:25.441354 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e4b676-a62e-4e52-bf8b-7f14f3e08804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:25.442215 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4b676-a62e-4e52-bf8b-7f14f3e08804 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:25.442500 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4b676-a62e-4e52-bf8b-7f14f3e08804 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:25.442775 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4b676-a62e-4e52-bf8b-7f14f3e08804 None admin] PATH_INFO: `/v3/projects/32613a2d0b4e49988a08ac9fea5fb88a` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:25.443946 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e4b676-a62e-4e52-bf8b-7f14f3e08804 None admin] RBAC: Authorizing `identity:get_project(project_id=32613a2d0b4e49988a08ac9fea5fb88a)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:25.445402 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e4b676-a62e-4e52-bf8b-7f14f3e08804 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:25.447092 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 565/1122] 10.222.0.16 () {56 vars in 1186 bytes} [Thu May 26 12:22:25 2022] GET /identity/v3/projects/32613a2d0b4e49988a08ac9fea5fb88a => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:25.452975 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d0c14-b0dd-499b-84b9-66d6ecc7ca72 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:25.512367 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:25.549684 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d0c14-b0dd-499b-84b9-66d6ecc7ca72 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:25.582632 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a171b39b-d9af-4c32-82ae-4b3b5a3a935f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:25.583499 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171b39b-d9af-4c32-82ae-4b3b5a3a935f None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:25.583781 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171b39b-d9af-4c32-82ae-4b3b5a3a935f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:25.584053 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171b39b-d9af-4c32-82ae-4b3b5a3a935f None admin] PATH_INFO: `/v3/projects/32613a2d0b4e49988a08ac9fea5fb88a/users/18b19cf5c2034f47ab6eca71efe39ed2/roles/e0f421b5486c47aebb20ea10342cb1e3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:25.586258 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a171b39b-d9af-4c32-82ae-4b3b5a3a935f None admin] RBAC: Authorizing `identity:create_grant(project_id=32613a2d0b4e49988a08ac9fea5fb88a, user_id=18b19cf5c2034f47ab6eca71efe39ed2, role_id=e0f421b5486c47aebb20ea10342cb1e3)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:25.587693 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a171b39b-d9af-4c32-82ae-4b3b5a3a935f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:25.599968 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 558/1123] 10.222.0.16 () {58 vars in 1439 bytes} [Thu May 26 12:22:25 2022] PUT /identity/v3/projects/32613a2d0b4e49988a08ac9fea5fb88a/users/18b19cf5c2034f47ab6eca71efe39ed2/roles/e0f421b5486c47aebb20ea10342cb1e3 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:22:27.756622 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a63c8-06ae-4c7e-b605-d31947d84aeb None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:27.757115 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a63c8-06ae-4c7e-b605-d31947d84aeb None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:27.757211 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a63c8-06ae-4c7e-b605-d31947d84aeb None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:27.758557 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 566/1124] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:22:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:22:27.763685 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89baa3a7-3f1a-44cc-aace-b28b687cbb0b None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:27.764088 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89baa3a7-3f1a-44cc-aace-b28b687cbb0b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:27.764242 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89baa3a7-3f1a-44cc-aace-b28b687cbb0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:27.781190 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-89baa3a7-3f1a-44cc-aace-b28b687cbb0b None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:22:27.782382 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-89baa3a7-3f1a-44cc-aace-b28b687cbb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:22:27.846503 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 559/1125] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:22:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:22:27.869253 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614a63c8-06ae-4c7e-b605-d31947d84aeb None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:27.968762 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614a63c8-06ae-4c7e-b605-d31947d84aeb None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:27.991959 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:28.003364 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc89f98-467f-44cd-bdf6-fa345e469e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:28.004151 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc89f98-467f-44cd-bdf6-fa345e469e60 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:28.004462 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc89f98-467f-44cd-bdf6-fa345e469e60 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:28.004762 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc89f98-467f-44cd-bdf6-fa345e469e60 None admin] PATH_INFO: `/v3/roles/e0f421b5486c47aebb20ea10342cb1e3` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:28.006252 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc89f98-467f-44cd-bdf6-fa345e469e60 None admin] RBAC: Authorizing `identity:get_role(role_id=e0f421b5486c47aebb20ea10342cb1e3)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:28.007634 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc89f98-467f-44cd-bdf6-fa345e469e60 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:28.009049 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 567/1126] 10.222.0.16 () {56 vars in 1177 bytes} [Thu May 26 12:22:27 2022] GET /identity/v3/roles/e0f421b5486c47aebb20ea10342cb1e3 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:28.015059 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89baa3a7-3f1a-44cc-aace-b28b687cbb0b None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:28.066238 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:28.112278 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89baa3a7-3f1a-44cc-aace-b28b687cbb0b None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:28.144758 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccaf304-4537-461c-a3dc-0fd8fdd83902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:28.145754 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccaf304-4537-461c-a3dc-0fd8fdd83902 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:28.146037 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccaf304-4537-461c-a3dc-0fd8fdd83902 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:28.146311 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccaf304-4537-461c-a3dc-0fd8fdd83902 None admin] PATH_INFO: `/v3/users/18b19cf5c2034f47ab6eca71efe39ed2` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:28.147489 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccaf304-4537-461c-a3dc-0fd8fdd83902 None admin] RBAC: Authorizing `identity:get_user(user_id=18b19cf5c2034f47ab6eca71efe39ed2)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:28.148965 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccaf304-4537-461c-a3dc-0fd8fdd83902 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:28.150575 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 560/1127] 10.222.0.16 () {56 vars in 1177 bytes} [Thu May 26 12:22:28 2022] GET /identity/v3/users/18b19cf5c2034f47ab6eca71efe39ed2 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:28.156140 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc89f98-467f-44cd-bdf6-fa345e469e60 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:28.251522 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc89f98-467f-44cd-bdf6-fa345e469e60 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:28.284458 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236f299-ef6a-452f-adfa-26f6ad5f7473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:28.285051 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236f299-ef6a-452f-adfa-26f6ad5f7473 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:28.285335 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236f299-ef6a-452f-adfa-26f6ad5f7473 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:28.285611 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236f299-ef6a-452f-adfa-26f6ad5f7473 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:28.341758 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:28.352142 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0236f299-ef6a-452f-adfa-26f6ad5f7473 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:28.353632 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0236f299-ef6a-452f-adfa-26f6ad5f7473 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:28.447545 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 568/1128] 10.222.0.16 () {58 vars in 1282 bytes} [Thu May 26 12:22:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 12:22:28.453353 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccaf304-4537-461c-a3dc-0fd8fdd83902 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:28.548722 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccaf304-4537-461c-a3dc-0fd8fdd83902 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:28.567992 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:28.582197 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266c3fc-be3a-4013-a6a7-33cd952d7716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:28.583039 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266c3fc-be3a-4013-a6a7-33cd952d7716 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:28.583322 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266c3fc-be3a-4013-a6a7-33cd952d7716 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:28.583596 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266c3fc-be3a-4013-a6a7-33cd952d7716 None admin] PATH_INFO: `/v3/projects/32613a2d0b4e49988a08ac9fea5fb88a` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:28.584759 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1266c3fc-be3a-4013-a6a7-33cd952d7716 None admin] RBAC: Authorizing `identity:get_project(project_id=32613a2d0b4e49988a08ac9fea5fb88a)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:28.586215 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1266c3fc-be3a-4013-a6a7-33cd952d7716 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:28.587881 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 561/1129] 10.222.0.16 () {56 vars in 1186 bytes} [Thu May 26 12:22:28 2022] GET /identity/v3/projects/32613a2d0b4e49988a08ac9fea5fb88a => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:28.593796 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236f299-ef6a-452f-adfa-26f6ad5f7473 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:28.681583 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:28.690816 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236f299-ef6a-452f-adfa-26f6ad5f7473 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:28.723406 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a47cb-acc4-441d-a83c-a51290c53de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:28.724041 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a47cb-acc4-441d-a83c-a51290c53de7 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:28.724324 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a47cb-acc4-441d-a83c-a51290c53de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:28.724600 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a47cb-acc4-441d-a83c-a51290c53de7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:28.725449 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a47cb-acc4-441d-a83c-a51290c53de7 None admin] RBAC: Adding query filter params (role.id=e0f421b5486c47aebb20ea10342cb1e3, scope.project.id=32613a2d0b4e49988a08ac9fea5fb88a, user.id=18b19cf5c2034f47ab6eca71efe39ed2) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:28.725762 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a47cb-acc4-441d-a83c-a51290c53de7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:28.727186 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a47cb-acc4-441d-a83c-a51290c53de7 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:28.732875 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 569/1130] 10.222.0.16 () {56 vars in 1374 bytes} [Thu May 26 12:22:28 2022] GET /identity/v3/role_assignments?user.id=18b19cf5c2034f47ab6eca71efe39ed2&scope.project.id=32613a2d0b4e49988a08ac9fea5fb88a&role.id=e0f421b5486c47aebb20ea10342cb1e3 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:30.924486 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effea25-5d7e-46f0-925d-eb770cc57ed1 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:30.925053 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effea25-5d7e-46f0-925d-eb770cc57ed1 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:30.925053 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effea25-5d7e-46f0-925d-eb770cc57ed1 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:30.926407 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 562/1131] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:22:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:22:30.931830 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27fc341-de9f-4bfa-a5b6-96520ea5d739 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:30.932270 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27fc341-de9f-4bfa-a5b6-96520ea5d739 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:30.932378 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27fc341-de9f-4bfa-a5b6-96520ea5d739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:30.948720 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-b27fc341-de9f-4bfa-a5b6-96520ea5d739 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:22:30.949927 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-b27fc341-de9f-4bfa-a5b6-96520ea5d739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:22:31.015642 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 570/1132] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:22:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:22:31.039191 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1effea25-5d7e-46f0-925d-eb770cc57ed1 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:31.136149 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1effea25-5d7e-46f0-925d-eb770cc57ed1 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:31.169402 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146679b-d95d-4904-adea-7e20f4259e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:31.170182 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146679b-d95d-4904-adea-7e20f4259e45 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:31.170467 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146679b-d95d-4904-adea-7e20f4259e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:31.170746 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146679b-d95d-4904-adea-7e20f4259e45 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:31.171914 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7146679b-d95d-4904-adea-7e20f4259e45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:31.173413 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7146679b-d95d-4904-adea-7e20f4259e45 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:31.175020 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 563/1133] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:22:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:31.180726 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27fc341-de9f-4bfa-a5b6-96520ea5d739 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:31.262016 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:31.276607 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27fc341-de9f-4bfa-a5b6-96520ea5d739 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:31.310112 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f9409-a4b7-48c6-a5cb-d790c5f9ec86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:31.310760 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f9409-a4b7-48c6-a5cb-d790c5f9ec86 None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:31.311046 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f9409-a4b7-48c6-a5cb-d790c5f9ec86 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:31.311327 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f9409-a4b7-48c6-a5cb-d790c5f9ec86 None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:31.312022 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952f9409-a4b7-48c6-a5cb-d790c5f9ec86 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:31.313473 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952f9409-a4b7-48c6-a5cb-d790c5f9ec86 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:31.338006 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 571/1134] 10.222.0.16 () {60 vars in 1141 bytes} [Thu May 26 12:22:31 2022] POST /identity/v3/projects => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:22:33.525224 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf66bea-3677-4956-9788-24cf63b748e4 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:33.525779 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf66bea-3677-4956-9788-24cf63b748e4 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:33.525779 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf66bea-3677-4956-9788-24cf63b748e4 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:33.527148 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 564/1135] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:22:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:22:33.532301 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a64411-2924-4922-b6ee-d6039639b78d None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:33.532779 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a64411-2924-4922-b6ee-d6039639b78d None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:33.533405 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a64411-2924-4922-b6ee-d6039639b78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:33.549704 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-f6a64411-2924-4922-b6ee-d6039639b78d None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:22:33.550882 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-f6a64411-2924-4922-b6ee-d6039639b78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:22:33.614743 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 572/1136] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:22:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:22:33.639727 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf66bea-3677-4956-9788-24cf63b748e4 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:33.696128 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:33.739217 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf66bea-3677-4956-9788-24cf63b748e4 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:33.772717 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c0e1f-b8d3-4a33-8d71-c212d4b20c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:33.773533 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c0e1f-b8d3-4a33-8d71-c212d4b20c57 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:33.773819 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c0e1f-b8d3-4a33-8d71-c212d4b20c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:33.774096 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c0e1f-b8d3-4a33-8d71-c212d4b20c57 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:33.775318 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c0e1f-b8d3-4a33-8d71-c212d4b20c57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:33.776706 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c0e1f-b8d3-4a33-8d71-c212d4b20c57 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:33.778368 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 565/1137] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:22:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:33.783984 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a64411-2924-4922-b6ee-d6039639b78d None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:33.848435 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:33.881408 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a64411-2924-4922-b6ee-d6039639b78d None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:33.913684 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dddaa6b-23c3-4c58-a541-58767703cca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:33.914328 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dddaa6b-23c3-4c58-a541-58767703cca8 None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:33.914607 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dddaa6b-23c3-4c58-a541-58767703cca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:33.914879 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dddaa6b-23c3-4c58-a541-58767703cca8 None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:33.915569 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dddaa6b-23c3-4c58-a541-58767703cca8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:33.917003 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dddaa6b-23c3-4c58-a541-58767703cca8 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:33.936704 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 573/1138] 10.222.0.16 () {60 vars in 1132 bytes} [Thu May 26 12:22:33 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:22:36.138771 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32cd88-c819-4247-abdc-9a3a0cd73d25 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:36.139278 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32cd88-c819-4247-abdc-9a3a0cd73d25 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:36.139278 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32cd88-c819-4247-abdc-9a3a0cd73d25 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:36.140604 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 566/1139] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:22:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:22:36.146033 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884fba7-ac5d-4737-a8e3-4c2933912b6d None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:36.146410 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884fba7-ac5d-4737-a8e3-4c2933912b6d None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:36.146584 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884fba7-ac5d-4737-a8e3-4c2933912b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:36.163459 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-e884fba7-ac5d-4737-a8e3-4c2933912b6d None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:22:36.164632 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-e884fba7-ac5d-4737-a8e3-4c2933912b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:22:36.229586 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 574/1140] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:22:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:22:36.252693 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32cd88-c819-4247-abdc-9a3a0cd73d25 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:36.349958 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32cd88-c819-4247-abdc-9a3a0cd73d25 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:36.372536 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:36.383429 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f085403-4bb1-4969-a077-287618ad5591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:36.384205 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f085403-4bb1-4969-a077-287618ad5591 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:36.384486 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f085403-4bb1-4969-a077-287618ad5591 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:36.384760 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f085403-4bb1-4969-a077-287618ad5591 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:36.394619 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f085403-4bb1-4969-a077-287618ad5591 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:22:36.402200 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-2f085403-4bb1-4969-a077-287618ad5591 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:22:36.402200 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:36.402200 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:22:36.402200 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:22:36.402200 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:22:36.402200 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:22:36.402200 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:22:36.402200 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:22:36.402200 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:22:36.402200 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:22:36.402200 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:22:36.402200 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:22:36.402200 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:22:36.402200 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:22:36.402200 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:22:36.402200 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:22:36.403302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:22:36.403302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:22:36.403302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:22:36.403302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:22:36.403302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:22:36.403302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:22:36.403302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:22:36.403302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:22:36.403302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:22:36.403302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:22:36.403302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:22:36.403302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:22:36.403302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:22:36.403302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:22:36.403302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:22:36.403302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:22:36.404394 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:22:36.404394 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:22:36.404394 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:22:36.404394 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:22:36.404394 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:22:36.404394 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:22:36.404394 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:22:36.404394 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:22:36.404394 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:22:36.404394 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:22:36.404394 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:22:36.404394 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:22:36.404394 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 567/1141] 10.222.0.16 () {56 vars in 1096 bytes} [Thu May 26 12:22:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:22:36.409468 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e884fba7-ac5d-4737-a8e3-4c2933912b6d None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:36.462199 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:36.506356 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e884fba7-ac5d-4737-a8e3-4c2933912b6d None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:36.538302 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706b2a42-08fb-4fce-8d26-7673f24070b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:36.538950 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706b2a42-08fb-4fce-8d26-7673f24070b6 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:36.539232 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706b2a42-08fb-4fce-8d26-7673f24070b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:36.539504 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706b2a42-08fb-4fce-8d26-7673f24070b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:36.540237 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706b2a42-08fb-4fce-8d26-7673f24070b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:36.540539 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706b2a42-08fb-4fce-8d26-7673f24070b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:36.541920 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706b2a42-08fb-4fce-8d26-7673f24070b6 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:36.550213 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 575/1142] 10.222.0.16 () {56 vars in 1099 bytes} [Thu May 26 12:22:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:36.555842 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f085403-4bb1-4969-a077-287618ad5591 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:36.652039 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f085403-4bb1-4969-a077-287618ad5591 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:36.684768 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb559b-a913-47fd-b72c-e7d977881473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:36.685639 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb559b-a913-47fd-b72c-e7d977881473 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:36.685922 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb559b-a913-47fd-b72c-e7d977881473 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:36.686197 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb559b-a913-47fd-b72c-e7d977881473 None admin] PATH_INFO: `/v3/users/630b902569734b0e94f3776975be508e` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:36.698760 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abb559b-a913-47fd-b72c-e7d977881473 None admin] RBAC: Authorizing `identity:get_user(user_id=630b902569734b0e94f3776975be508e)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:36.700211 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abb559b-a913-47fd-b72c-e7d977881473 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:36.701851 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 568/1143] 10.222.0.16 () {56 vars in 1177 bytes} [Thu May 26 12:22:36 2022] GET /identity/v3/users/630b902569734b0e94f3776975be508e => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:36.707364 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706b2a42-08fb-4fce-8d26-7673f24070b6 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:36.806283 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706b2a42-08fb-4fce-8d26-7673f24070b6 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:36.821557 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:36.838965 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75147f38-1130-495f-8f6e-9d91a75eee82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:36.839602 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75147f38-1130-495f-8f6e-9d91a75eee82 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:36.839887 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75147f38-1130-495f-8f6e-9d91a75eee82 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:36.840166 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75147f38-1130-495f-8f6e-9d91a75eee82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:36.905079 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75147f38-1130-495f-8f6e-9d91a75eee82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:36.906467 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75147f38-1130-495f-8f6e-9d91a75eee82 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:37.002009 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 576/1144] 10.222.0.16 () {58 vars in 1282 bytes} [Thu May 26 12:22:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:22:37.007866 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb559b-a913-47fd-b72c-e7d977881473 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:37.049864 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:37.104627 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb559b-a913-47fd-b72c-e7d977881473 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:37.136587 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb19a0-5715-45b3-8a9a-f5af6fe192f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:37.137466 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb19a0-5715-45b3-8a9a-f5af6fe192f9 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:37.137751 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb19a0-5715-45b3-8a9a-f5af6fe192f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:37.138027 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb19a0-5715-45b3-8a9a-f5af6fe192f9 None admin] PATH_INFO: `/v3/projects/ae96967feae347b5b244ffe7132a336e` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:37.139195 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb19a0-5715-45b3-8a9a-f5af6fe192f9 None admin] RBAC: Authorizing `identity:get_project(project_id=ae96967feae347b5b244ffe7132a336e)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:37.140633 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb19a0-5715-45b3-8a9a-f5af6fe192f9 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:37.142869 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 569/1145] 10.222.0.16 () {56 vars in 1186 bytes} [Thu May 26 12:22:37 2022] GET /identity/v3/projects/ae96967feae347b5b244ffe7132a336e => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:37.148797 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75147f38-1130-495f-8f6e-9d91a75eee82 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:37.166083 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:37.243818 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75147f38-1130-495f-8f6e-9d91a75eee82 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:37.276160 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008bc680-93c3-4b81-adbf-31352b129c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:37.276812 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008bc680-93c3-4b81-adbf-31352b129c57 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:37.277119 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008bc680-93c3-4b81-adbf-31352b129c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:37.277396 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008bc680-93c3-4b81-adbf-31352b129c57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:37.278247 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008bc680-93c3-4b81-adbf-31352b129c57 None admin] RBAC: Adding query filter params (role.id=1a8e523ecbc84d818c2a9af0fb54da74, scope.project.id=ae96967feae347b5b244ffe7132a336e, user.id=630b902569734b0e94f3776975be508e) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:37.278558 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008bc680-93c3-4b81-adbf-31352b129c57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:37.279988 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008bc680-93c3-4b81-adbf-31352b129c57 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:37.285972 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 577/1146] 10.222.0.16 () {56 vars in 1374 bytes} [Thu May 26 12:22:37 2022] GET /identity/v3/role_assignments?user.id=630b902569734b0e94f3776975be508e&scope.project.id=ae96967feae347b5b244ffe7132a336e&role.id=1a8e523ecbc84d818c2a9af0fb54da74 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:39.418332 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55772c-fda3-4988-b698-9774c7c7287d None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:39.418893 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55772c-fda3-4988-b698-9774c7c7287d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:39.418893 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55772c-fda3-4988-b698-9774c7c7287d None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:39.420236 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 570/1147] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:22:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:22:39.425419 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36e4ea-df43-4d0d-a64a-0f750734309b None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:39.425817 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36e4ea-df43-4d0d-a64a-0f750734309b None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:39.425975 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36e4ea-df43-4d0d-a64a-0f750734309b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:39.442368 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-4d36e4ea-df43-4d0d-a64a-0f750734309b None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:22:39.443554 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-4d36e4ea-df43-4d0d-a64a-0f750734309b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:22:39.508575 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 578/1148] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:22:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:22:39.531218 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c55772c-fda3-4988-b698-9774c7c7287d None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:39.630753 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c55772c-fda3-4988-b698-9774c7c7287d None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:39.641060 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:39.664171 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b55b31-5008-462e-a73b-1514e4fa0979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:39.664991 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b55b31-5008-462e-a73b-1514e4fa0979 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:39.665277 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b55b31-5008-462e-a73b-1514e4fa0979 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:39.665553 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b55b31-5008-462e-a73b-1514e4fa0979 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:39.675368 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b55b31-5008-462e-a73b-1514e4fa0979 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:22:39.682884 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-26b55b31-5008-462e-a73b-1514e4fa0979 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:22:39.682884 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:39.682884 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:22:39.682884 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:22:39.682884 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:22:39.682884 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:22:39.682884 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:22:39.682884 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:22:39.682884 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:22:39.682884 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:22:39.682884 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:22:39.682884 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:22:39.682884 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:22:39.682884 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:22:39.682884 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:22:39.682884 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:22:39.683956 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:22:39.683956 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:22:39.683956 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:22:39.683956 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:22:39.683956 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:22:39.683956 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:22:39.683956 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:22:39.683956 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:22:39.683956 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:22:39.683956 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:22:39.683956 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:22:39.683956 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:22:39.683956 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:22:39.683956 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:22:39.683956 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:22:39.683956 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:22:39.685029 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:22:39.685029 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:22:39.685029 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:22:39.685029 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:22:39.685029 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:22:39.685029 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:22:39.685029 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:22:39.685029 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:22:39.685029 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:22:39.685029 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:22:39.685029 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:22:39.685029 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:22:39.685029 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 571/1149] 10.222.0.16 () {56 vars in 1096 bytes} [Thu May 26 12:22:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:22:39.690642 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36e4ea-df43-4d0d-a64a-0f750734309b None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:39.701969 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:39.788100 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36e4ea-df43-4d0d-a64a-0f750734309b None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:39.820944 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f856b-ba7f-4d24-aee0-033de0115c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:39.821600 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f856b-ba7f-4d24-aee0-033de0115c3d None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:39.821884 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f856b-ba7f-4d24-aee0-033de0115c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:39.822161 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f856b-ba7f-4d24-aee0-033de0115c3d None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:39.822911 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2f856b-ba7f-4d24-aee0-033de0115c3d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:39.823219 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2f856b-ba7f-4d24-aee0-033de0115c3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:39.824577 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2f856b-ba7f-4d24-aee0-033de0115c3d None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:39.833002 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 579/1150] 10.222.0.16 () {56 vars in 1099 bytes} [Thu May 26 12:22:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:39.838831 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b55b31-5008-462e-a73b-1514e4fa0979 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:39.936471 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b55b31-5008-462e-a73b-1514e4fa0979 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:39.968936 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ab4c1-e354-4048-9464-c160dcbb0798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:39.969785 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ab4c1-e354-4048-9464-c160dcbb0798 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:39.970067 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ab4c1-e354-4048-9464-c160dcbb0798 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:39.970366 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ab4c1-e354-4048-9464-c160dcbb0798 None admin] PATH_INFO: `/v3/users/630b902569734b0e94f3776975be508e` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:39.971795 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00ab4c1-e354-4048-9464-c160dcbb0798 None admin] RBAC: Authorizing `identity:get_user(user_id=630b902569734b0e94f3776975be508e)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:39.973267 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00ab4c1-e354-4048-9464-c160dcbb0798 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:39.974858 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 572/1151] 10.222.0.16 () {56 vars in 1177 bytes} [Thu May 26 12:22:39 2022] GET /identity/v3/users/630b902569734b0e94f3776975be508e => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:39.980387 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f856b-ba7f-4d24-aee0-033de0115c3d None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:40.048231 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:40.077306 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f856b-ba7f-4d24-aee0-033de0115c3d None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:40.108827 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b65835-b073-4310-ab01-1fae778e3059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:40.109686 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b65835-b073-4310-ab01-1fae778e3059 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:40.109964 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b65835-b073-4310-ab01-1fae778e3059 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:40.110232 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b65835-b073-4310-ab01-1fae778e3059 None admin] PATH_INFO: `/v3/projects/ae96967feae347b5b244ffe7132a336e` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:40.111906 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b65835-b073-4310-ab01-1fae778e3059 None admin] RBAC: Authorizing `identity:get_project(project_id=ae96967feae347b5b244ffe7132a336e)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:40.113349 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b65835-b073-4310-ab01-1fae778e3059 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:40.115004 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 580/1152] 10.222.0.16 () {56 vars in 1186 bytes} [Thu May 26 12:22:39 2022] GET /identity/v3/projects/ae96967feae347b5b244ffe7132a336e => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:40.120750 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ab4c1-e354-4048-9464-c160dcbb0798 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:40.159518 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:40.216866 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ab4c1-e354-4048-9464-c160dcbb0798 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:40.248608 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c60d989-f6f9-4a6c-9604-da969b837910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:40.249498 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c60d989-f6f9-4a6c-9604-da969b837910 None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:40.249777 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c60d989-f6f9-4a6c-9604-da969b837910 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:40.250048 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c60d989-f6f9-4a6c-9604-da969b837910 None admin] PATH_INFO: `/v3/projects/ae96967feae347b5b244ffe7132a336e/users/630b902569734b0e94f3776975be508e/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:40.252600 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c60d989-f6f9-4a6c-9604-da969b837910 None admin] RBAC: Authorizing `identity:create_grant(project_id=ae96967feae347b5b244ffe7132a336e, user_id=630b902569734b0e94f3776975be508e, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:40.254053 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c60d989-f6f9-4a6c-9604-da969b837910 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:40.266108 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 573/1153] 10.222.0.16 () {58 vars in 1439 bytes} [Thu May 26 12:22:40 2022] PUT /identity/v3/projects/ae96967feae347b5b244ffe7132a336e/users/630b902569734b0e94f3776975be508e/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:22:42.410886 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8b253-eec9-4207-8099-59181fb32684 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:42.411420 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8b253-eec9-4207-8099-59181fb32684 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:42.411420 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8b253-eec9-4207-8099-59181fb32684 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:42.412784 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 581/1154] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:22:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:22:42.418040 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3f43f-4e97-4251-9b89-0f5cbc5d443e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:42.418448 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3f43f-4e97-4251-9b89-0f5cbc5d443e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:42.418601 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3f43f-4e97-4251-9b89-0f5cbc5d443e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:42.434918 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-86f3f43f-4e97-4251-9b89-0f5cbc5d443e None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:22:42.436115 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-86f3f43f-4e97-4251-9b89-0f5cbc5d443e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:22:42.500922 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 574/1155] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:22:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:22:42.524173 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc8b253-eec9-4207-8099-59181fb32684 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:42.628888 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc8b253-eec9-4207-8099-59181fb32684 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:42.661198 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842adb5f-f4c2-4dec-bc02-8e275e28909b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:42.662175 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842adb5f-f4c2-4dec-bc02-8e275e28909b None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:42.662456 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842adb5f-f4c2-4dec-bc02-8e275e28909b None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:42.662735 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842adb5f-f4c2-4dec-bc02-8e275e28909b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:42.670159 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:42.674614 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842adb5f-f4c2-4dec-bc02-8e275e28909b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:22:42.682376 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-842adb5f-f4c2-4dec-bc02-8e275e28909b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:22:42.682376 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:42.682376 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:22:42.682376 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:22:42.682376 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:22:42.682376 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:22:42.682376 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:22:42.682376 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:22:42.682376 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:22:42.682376 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:22:42.682376 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:22:42.682376 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:22:42.682376 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:22:42.682376 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:22:42.682376 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:22:42.682376 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:22:42.683507 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:22:42.683507 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:22:42.683507 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:22:42.683507 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:22:42.683507 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:22:42.683507 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:22:42.683507 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:22:42.683507 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:22:42.683507 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:22:42.683507 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:22:42.683507 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:22:42.683507 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:22:42.683507 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:22:42.683507 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:22:42.683507 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:22:42.683507 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:22:42.684579 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:22:42.684579 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:22:42.684579 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:22:42.684579 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:22:42.684579 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:22:42.684579 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:22:42.684579 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:22:42.684579 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:22:42.684579 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:22:42.684579 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:22:42.684579 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:22:42.684579 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:22:42.684579 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 582/1156] 10.222.0.16 () {56 vars in 1096 bytes} [Thu May 26 12:22:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:22:42.690177 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f3f43f-4e97-4251-9b89-0f5cbc5d443e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:42.717245 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:42.788108 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f3f43f-4e97-4251-9b89-0f5cbc5d443e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:42.820791 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a16bc3-46e9-481e-9081-e235eb5fc4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:42.821490 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a16bc3-46e9-481e-9081-e235eb5fc4e2 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:42.821774 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a16bc3-46e9-481e-9081-e235eb5fc4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:42.822048 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a16bc3-46e9-481e-9081-e235eb5fc4e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:42.822794 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a16bc3-46e9-481e-9081-e235eb5fc4e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:42.823101 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a16bc3-46e9-481e-9081-e235eb5fc4e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:42.824473 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a16bc3-46e9-481e-9081-e235eb5fc4e2 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:42.832891 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 575/1157] 10.222.0.16 () {56 vars in 1099 bytes} [Thu May 26 12:22:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:42.838589 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842adb5f-f4c2-4dec-bc02-8e275e28909b None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:42.934867 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842adb5f-f4c2-4dec-bc02-8e275e28909b None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:42.967561 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc25c7-3012-4439-ae4d-ec1272b6f56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:42.968409 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc25c7-3012-4439-ae4d-ec1272b6f56d None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:42.968696 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc25c7-3012-4439-ae4d-ec1272b6f56d None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:42.968999 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc25c7-3012-4439-ae4d-ec1272b6f56d None admin] PATH_INFO: `/v3/users/630b902569734b0e94f3776975be508e` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:42.970165 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fc25c7-3012-4439-ae4d-ec1272b6f56d None admin] RBAC: Authorizing `identity:get_user(user_id=630b902569734b0e94f3776975be508e)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:42.971882 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fc25c7-3012-4439-ae4d-ec1272b6f56d None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:42.973513 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 583/1158] 10.222.0.16 () {56 vars in 1177 bytes} [Thu May 26 12:22:42 2022] GET /identity/v3/users/630b902569734b0e94f3776975be508e => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:42.979067 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a16bc3-46e9-481e-9081-e235eb5fc4e2 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:43.066892 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:43.076653 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a16bc3-46e9-481e-9081-e235eb5fc4e2 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:43.110123 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb66a3-7a9d-4dfa-91ec-2478b363bfb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:43.110754 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb66a3-7a9d-4dfa-91ec-2478b363bfb5 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:43.111562 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb66a3-7a9d-4dfa-91ec-2478b363bfb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:43.111840 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb66a3-7a9d-4dfa-91ec-2478b363bfb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:43.175982 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beb66a3-7a9d-4dfa-91ec-2478b363bfb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:43.177450 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beb66a3-7a9d-4dfa-91ec-2478b363bfb5 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:43.261509 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:43.271728 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 576/1159] 10.222.0.16 () {58 vars in 1282 bytes} [Thu May 26 12:22:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:22:43.277576 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc25c7-3012-4439-ae4d-ec1272b6f56d None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:43.342149 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:43.374575 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc25c7-3012-4439-ae4d-ec1272b6f56d None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:43.407470 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74146701-258c-4561-a0dd-f3cc179ca2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:43.408336 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74146701-258c-4561-a0dd-f3cc179ca2c9 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:43.408617 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74146701-258c-4561-a0dd-f3cc179ca2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:43.408921 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74146701-258c-4561-a0dd-f3cc179ca2c9 None admin] PATH_INFO: `/v3/projects/ae96967feae347b5b244ffe7132a336e` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:43.410082 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74146701-258c-4561-a0dd-f3cc179ca2c9 None admin] RBAC: Authorizing `identity:get_project(project_id=ae96967feae347b5b244ffe7132a336e)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:43.411494 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74146701-258c-4561-a0dd-f3cc179ca2c9 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:43.413190 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 584/1160] 10.222.0.16 () {56 vars in 1186 bytes} [Thu May 26 12:22:43 2022] GET /identity/v3/projects/ae96967feae347b5b244ffe7132a336e => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:43.419176 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb66a3-7a9d-4dfa-91ec-2478b363bfb5 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:43.514053 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb66a3-7a9d-4dfa-91ec-2478b363bfb5 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:43.546339 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de03b6e6-f32c-4dc2-9ca1-ff9653c540e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:43.546970 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de03b6e6-f32c-4dc2-9ca1-ff9653c540e5 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:43.547250 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de03b6e6-f32c-4dc2-9ca1-ff9653c540e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:43.547525 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de03b6e6-f32c-4dc2-9ca1-ff9653c540e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:43.548338 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de03b6e6-f32c-4dc2-9ca1-ff9653c540e5 None admin] RBAC: Adding query filter params (role.id=1a8e523ecbc84d818c2a9af0fb54da74, scope.project.id=ae96967feae347b5b244ffe7132a336e, user.id=630b902569734b0e94f3776975be508e) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:43.548671 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de03b6e6-f32c-4dc2-9ca1-ff9653c540e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:43.550129 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de03b6e6-f32c-4dc2-9ca1-ff9653c540e5 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:43.555734 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 577/1161] 10.222.0.16 () {56 vars in 1374 bytes} [Thu May 26 12:22:43 2022] GET /identity/v3/role_assignments?user.id=630b902569734b0e94f3776975be508e&scope.project.id=ae96967feae347b5b244ffe7132a336e&role.id=1a8e523ecbc84d818c2a9af0fb54da74 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:45.733783 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc398e41-de48-475a-a0bc-61bb0fbdb382 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:45.734418 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc398e41-de48-475a-a0bc-61bb0fbdb382 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:45.734418 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc398e41-de48-475a-a0bc-61bb0fbdb382 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:45.735712 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 585/1162] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:22:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:22:45.741434 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd242f4-d2a4-472e-a4ff-003d02d49565 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:45.741839 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd242f4-d2a4-472e-a4ff-003d02d49565 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:45.741984 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd242f4-d2a4-472e-a4ff-003d02d49565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:45.758399 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-3fd242f4-d2a4-472e-a4ff-003d02d49565 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:22:45.759579 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3fd242f4-d2a4-472e-a4ff-003d02d49565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:22:45.807302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:45.824378 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 578/1163] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:22:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:22:45.846564 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc398e41-de48-475a-a0bc-61bb0fbdb382 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:45.943476 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc398e41-de48-475a-a0bc-61bb0fbdb382 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:45.976309 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390db51c-89bf-492c-9b7f-6b47686375eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:45.976955 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390db51c-89bf-492c-9b7f-6b47686375eb None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:45.977235 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390db51c-89bf-492c-9b7f-6b47686375eb None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:45.977505 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390db51c-89bf-492c-9b7f-6b47686375eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:45.980771 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:46.041232 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390db51c-89bf-492c-9b7f-6b47686375eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:46.042595 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390db51c-89bf-492c-9b7f-6b47686375eb None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:46.136576 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 586/1164] 10.222.0.16 () {58 vars in 1282 bytes} [Thu May 26 12:22:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:22:46.143077 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd242f4-d2a4-472e-a4ff-003d02d49565 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:46.238697 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd242f4-d2a4-472e-a4ff-003d02d49565 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:46.271345 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a907dd-fda0-4764-98df-9f77fb150c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:46.272124 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a907dd-fda0-4764-98df-9f77fb150c0b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:46.272410 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a907dd-fda0-4764-98df-9f77fb150c0b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:46.272697 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a907dd-fda0-4764-98df-9f77fb150c0b None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:46.279180 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a907dd-fda0-4764-98df-9f77fb150c0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:46.280665 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a907dd-fda0-4764-98df-9f77fb150c0b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:46.294619 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-f2a907dd-fda0-4764-98df-9f77fb150c0b None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 26 12:22:46.294619 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:46.294619 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 26 12:22:46.294619 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 26 12:22:46.294619 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:22:46.294619 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:22:46.294619 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:22:46.294619 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:22:46.294619 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 26 12:22:46.294619 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:22:46.294619 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:22:46.294619 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:22:46.294619 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:46.294619 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:22:46.294619 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:22:46.294619 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:22:46.294619 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:22:46.295863 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:22:46.295863 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:22:46.295863 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:22:46.295863 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:22:46.295863 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:22:46.295863 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:22:46.295863 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:22:46.295863 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:22:46.295863 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:22:46.295863 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:22:46.295863 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:22:46.295863 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:22:46.295863 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:22:46.295863 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:22:46.295863 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:22:46.295863 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:22:46.296875 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:22:46.296875 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:22:46.296875 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:22:46.296875 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:22:46.296875 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:22:46.296875 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:22:46.296875 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:22:46.296875 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:22:46.296875 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:22:46.296875 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:22:46.296875 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 26 12:22:46.296875 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:22:46.296875 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 26 12:22:46.296875 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:22:46.296875 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 579/1165] 10.222.0.16 () {56 vars in 1117 bytes} [Thu May 26 12:22:46 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:22:46.302175 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390db51c-89bf-492c-9b7f-6b47686375eb None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:46.335928 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:46.397911 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390db51c-89bf-492c-9b7f-6b47686375eb None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:46.430698 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1a86e9-2eec-4aea-a764-089aeeb8fd55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:46.431333 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a86e9-2eec-4aea-a764-089aeeb8fd55 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:46.431610 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a86e9-2eec-4aea-a764-089aeeb8fd55 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:46.431878 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a86e9-2eec-4aea-a764-089aeeb8fd55 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:46.432579 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1a86e9-2eec-4aea-a764-089aeeb8fd55 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:46.432905 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1a86e9-2eec-4aea-a764-089aeeb8fd55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:46.434259 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1a86e9-2eec-4aea-a764-089aeeb8fd55 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:46.441403 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 587/1166] 10.222.0.16 () {56 vars in 1115 bytes} [Thu May 26 12:22:46 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:48.595073 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ff222-c6bb-464b-810f-c060c708fd28 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:48.595633 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ff222-c6bb-464b-810f-c060c708fd28 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:48.595768 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ff222-c6bb-464b-810f-c060c708fd28 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:48.597433 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 580/1167] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:22:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:22:48.602675 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e54960-ef0e-4f71-a5f1-8ec0cab074eb None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:48.603122 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e54960-ef0e-4f71-a5f1-8ec0cab074eb None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:48.603218 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e54960-ef0e-4f71-a5f1-8ec0cab074eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:48.620341 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-f5e54960-ef0e-4f71-a5f1-8ec0cab074eb None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:22:48.621561 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-f5e54960-ef0e-4f71-a5f1-8ec0cab074eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:22:48.685522 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 588/1168] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:22:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:22:48.708287 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ff222-c6bb-464b-810f-c060c708fd28 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:48.753614 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:48.806420 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ff222-c6bb-464b-810f-c060c708fd28 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:48.839008 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c26b3-591c-4713-acbf-440879cd0873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:48.839648 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c26b3-591c-4713-acbf-440879cd0873 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:48.839928 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c26b3-591c-4713-acbf-440879cd0873 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:48.840201 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c26b3-591c-4713-acbf-440879cd0873 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:48.840945 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64c26b3-591c-4713-acbf-440879cd0873 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:48.842305 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64c26b3-591c-4713-acbf-440879cd0873 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:48.856356 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 581/1169] 10.222.0.16 () {60 vars in 1138 bytes} [Thu May 26 12:22:48 2022] POST /identity/v3/domains => generated 267 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:22:51.060120 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef57f5f-a664-45e0-b33b-560c0317bc84 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:51.060636 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef57f5f-a664-45e0-b33b-560c0317bc84 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:51.060636 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef57f5f-a664-45e0-b33b-560c0317bc84 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:51.062000 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 589/1170] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:22:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:22:51.067260 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3aab0a-e7ae-4545-800d-8f01c872bc8c None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:51.067659 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3aab0a-e7ae-4545-800d-8f01c872bc8c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:51.067823 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3aab0a-e7ae-4545-800d-8f01c872bc8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:51.084087 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-0c3aab0a-e7ae-4545-800d-8f01c872bc8c None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:22:51.085304 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0c3aab0a-e7ae-4545-800d-8f01c872bc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:22:51.149371 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 582/1171] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:22:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:22:51.172856 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef57f5f-a664-45e0-b33b-560c0317bc84 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:51.202639 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:51.273075 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef57f5f-a664-45e0-b33b-560c0317bc84 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:51.305869 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd4bfdf-6179-40c0-a7fd-d23973cba1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:51.306714 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4bfdf-6179-40c0-a7fd-d23973cba1eb None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:51.307000 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4bfdf-6179-40c0-a7fd-d23973cba1eb None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:51.307276 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4bfdf-6179-40c0-a7fd-d23973cba1eb None admin] PATH_INFO: `/v3/domains/6b56ecdd1d1246b68009cbd93989ad06` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:51.317457 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd4bfdf-6179-40c0-a7fd-d23973cba1eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=6b56ecdd1d1246b68009cbd93989ad06)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:51.318849 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd4bfdf-6179-40c0-a7fd-d23973cba1eb None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:51.320464 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 590/1172] 10.222.0.16 () {56 vars in 1183 bytes} [Thu May 26 12:22:51 2022] GET /identity/v3/domains/6b56ecdd1d1246b68009cbd93989ad06 => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:51.326192 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3aab0a-e7ae-4545-800d-8f01c872bc8c None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:51.359471 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:51.423241 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3aab0a-e7ae-4545-800d-8f01c872bc8c None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:51.456383 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd25706-29cb-43c7-af1c-658a5362b317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:51.457175 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd25706-29cb-43c7-af1c-658a5362b317 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:51.457459 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd25706-29cb-43c7-af1c-658a5362b317 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:51.457734 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd25706-29cb-43c7-af1c-658a5362b317 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:51.458429 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd25706-29cb-43c7-af1c-658a5362b317 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:51.459871 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd25706-29cb-43c7-af1c-658a5362b317 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:51.484595 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 583/1173] 10.222.0.16 () {60 vars in 1141 bytes} [Thu May 26 12:22:51 2022] POST /identity/v3/projects => generated 361 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:22:53.681863 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76606f-f193-4fa6-a65b-5d9f4aa13449 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:53.682424 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76606f-f193-4fa6-a65b-5d9f4aa13449 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:53.682424 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76606f-f193-4fa6-a65b-5d9f4aa13449 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:53.683811 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 591/1174] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:22:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:22:53.688993 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecfd545-0d1f-49f0-9e9b-61662ef6fd82 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:53.689970 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecfd545-0d1f-49f0-9e9b-61662ef6fd82 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:53.690118 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecfd545-0d1f-49f0-9e9b-61662ef6fd82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:53.706590 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-cecfd545-0d1f-49f0-9e9b-61662ef6fd82 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:22:53.707771 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-cecfd545-0d1f-49f0-9e9b-61662ef6fd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:22:53.772683 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 584/1175] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:22:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:22:53.798036 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d76606f-f193-4fa6-a65b-5d9f4aa13449 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:53.886974 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:53.897301 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d76606f-f193-4fa6-a65b-5d9f4aa13449 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:53.929995 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb02441-53ea-4fc9-8731-8068b05fab4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:53.930837 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb02441-53ea-4fc9-8731-8068b05fab4d None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:53.931116 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb02441-53ea-4fc9-8731-8068b05fab4d None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:53.931387 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb02441-53ea-4fc9-8731-8068b05fab4d None admin] PATH_INFO: `/v3/domains/6b56ecdd1d1246b68009cbd93989ad06` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:53.932581 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb02441-53ea-4fc9-8731-8068b05fab4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=6b56ecdd1d1246b68009cbd93989ad06)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:53.933978 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb02441-53ea-4fc9-8731-8068b05fab4d None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:53.935556 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 592/1176] 10.222.0.16 () {56 vars in 1183 bytes} [Thu May 26 12:22:53 2022] GET /identity/v3/domains/6b56ecdd1d1246b68009cbd93989ad06 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:53.941296 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecfd545-0d1f-49f0-9e9b-61662ef6fd82 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:53.958134 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:54.037266 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecfd545-0d1f-49f0-9e9b-61662ef6fd82 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:54.069899 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae663e0-0a61-4a7a-a6d1-55b977487e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:54.070557 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae663e0-0a61-4a7a-a6d1-55b977487e8b None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:54.070843 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae663e0-0a61-4a7a-a6d1-55b977487e8b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:54.071122 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae663e0-0a61-4a7a-a6d1-55b977487e8b None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:54.071828 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae663e0-0a61-4a7a-a6d1-55b977487e8b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:54.073298 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae663e0-0a61-4a7a-a6d1-55b977487e8b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:54.092375 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 585/1177] 10.222.0.16 () {60 vars in 1132 bytes} [Thu May 26 12:22:53 2022] POST /identity/v3/users => generated 311 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:22:56.285886 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656dcf65-943c-4025-b688-92266f01e5aa None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:56.286405 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656dcf65-943c-4025-b688-92266f01e5aa None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:56.286528 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656dcf65-943c-4025-b688-92266f01e5aa None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:56.287810 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 593/1178] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:22:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:22:56.293035 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e2f3c-66c0-4aba-9dff-e4eda7f1707d None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:56.293417 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e2f3c-66c0-4aba-9dff-e4eda7f1707d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:56.293581 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e2f3c-66c0-4aba-9dff-e4eda7f1707d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:56.310301 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-688e2f3c-66c0-4aba-9dff-e4eda7f1707d None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:22:56.311462 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-688e2f3c-66c0-4aba-9dff-e4eda7f1707d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:22:56.375967 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 586/1179] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:22:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:22:56.398535 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656dcf65-943c-4025-b688-92266f01e5aa None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:56.497989 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656dcf65-943c-4025-b688-92266f01e5aa None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:56.530145 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b24157c-4db2-4cd0-9882-bd4877f62b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:56.530916 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24157c-4db2-4cd0-9882-bd4877f62b17 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:56.531200 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24157c-4db2-4cd0-9882-bd4877f62b17 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:56.531478 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24157c-4db2-4cd0-9882-bd4877f62b17 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:56.542327 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b24157c-4db2-4cd0-9882-bd4877f62b17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:22:56.549853 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-4b24157c-4db2-4cd0-9882-bd4877f62b17 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:22:56.549853 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:56.549853 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:22:56.549853 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:22:56.549853 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:22:56.549853 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:22:56.549853 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:22:56.549853 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:22:56.549853 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:22:56.549853 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:22:56.549853 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:22:56.549853 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:22:56.549853 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:22:56.549853 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:22:56.549853 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:22:56.549853 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:22:56.550976 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:22:56.550976 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:22:56.550976 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:22:56.550976 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:22:56.550976 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:22:56.550976 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:22:56.550976 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:22:56.550976 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:22:56.550976 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:22:56.550976 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:22:56.550976 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:22:56.550976 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:22:56.550976 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:22:56.550976 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:22:56.550976 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:22:56.550976 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:22:56.551906 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:22:56.551906 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:22:56.551906 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:22:56.551906 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:22:56.551906 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:22:56.551906 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:22:56.551906 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:22:56.551906 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:22:56.551906 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:22:56.551906 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:22:56.551906 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:22:56.551906 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:22:56.551906 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 594/1180] 10.222.0.16 () {56 vars in 1096 bytes} [Thu May 26 12:22:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:22:56.556999 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e2f3c-66c0-4aba-9dff-e4eda7f1707d None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:56.559136 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:56.654218 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e2f3c-66c0-4aba-9dff-e4eda7f1707d None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:56.686788 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee08e0-5180-4b5e-b32f-24852d99c0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:56.687440 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee08e0-5180-4b5e-b32f-24852d99c0e2 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:56.687724 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee08e0-5180-4b5e-b32f-24852d99c0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:56.688001 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee08e0-5180-4b5e-b32f-24852d99c0e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:56.688745 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ee08e0-5180-4b5e-b32f-24852d99c0e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:56.689086 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ee08e0-5180-4b5e-b32f-24852d99c0e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:56.690488 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ee08e0-5180-4b5e-b32f-24852d99c0e2 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:56.698308 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 587/1181] 10.222.0.16 () {56 vars in 1099 bytes} [Thu May 26 12:22:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:56.703918 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b24157c-4db2-4cd0-9882-bd4877f62b17 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:56.723339 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:56.801462 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b24157c-4db2-4cd0-9882-bd4877f62b17 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:56.835007 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252354d6-adac-4474-9057-2ed0e065105a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:56.835856 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252354d6-adac-4474-9057-2ed0e065105a None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:56.836137 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252354d6-adac-4474-9057-2ed0e065105a None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:56.836407 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252354d6-adac-4474-9057-2ed0e065105a None admin] PATH_INFO: `/v3/users/3a0d687cf7384d0d93d273c2c3afcdd8` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:56.849144 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252354d6-adac-4474-9057-2ed0e065105a None admin] RBAC: Authorizing `identity:get_user(user_id=3a0d687cf7384d0d93d273c2c3afcdd8)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:56.850570 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252354d6-adac-4474-9057-2ed0e065105a None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:56.852177 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 595/1182] 10.222.0.16 () {56 vars in 1177 bytes} [Thu May 26 12:22:56 2022] GET /identity/v3/users/3a0d687cf7384d0d93d273c2c3afcdd8 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:56.858284 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee08e0-5180-4b5e-b32f-24852d99c0e2 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:56.918202 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:56.954589 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee08e0-5180-4b5e-b32f-24852d99c0e2 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:56.986526 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c7a1d-744e-495a-a85b-18ffe05fb8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:56.987154 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c7a1d-744e-495a-a85b-18ffe05fb8b1 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:56.987431 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c7a1d-744e-495a-a85b-18ffe05fb8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:56.987700 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c7a1d-744e-495a-a85b-18ffe05fb8b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:57.050772 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605c7a1d-744e-495a-a85b-18ffe05fb8b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:57.052256 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605c7a1d-744e-495a-a85b-18ffe05fb8b1 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:57.109759 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:57.146672 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 588/1183] 10.222.0.16 () {58 vars in 1282 bytes} [Thu May 26 12:22:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:22:57.152427 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252354d6-adac-4474-9057-2ed0e065105a None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:57.227072 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:57.249388 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252354d6-adac-4474-9057-2ed0e065105a None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:57.281703 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc09c56-92bd-4bbf-b224-019cea27c7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:57.282527 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc09c56-92bd-4bbf-b224-019cea27c7fd None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:57.282802 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc09c56-92bd-4bbf-b224-019cea27c7fd None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:57.283092 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc09c56-92bd-4bbf-b224-019cea27c7fd None admin] PATH_INFO: `/v3/projects/070652942bfc4c1f817ce9ab7ae4dc61` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:57.284230 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc09c56-92bd-4bbf-b224-019cea27c7fd None admin] RBAC: Authorizing `identity:get_project(project_id=070652942bfc4c1f817ce9ab7ae4dc61)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:57.285692 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc09c56-92bd-4bbf-b224-019cea27c7fd None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:57.287337 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 596/1184] 10.222.0.16 () {56 vars in 1186 bytes} [Thu May 26 12:22:57 2022] GET /identity/v3/projects/070652942bfc4c1f817ce9ab7ae4dc61 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:57.293479 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c7a1d-744e-495a-a85b-18ffe05fb8b1 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:57.389465 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c7a1d-744e-495a-a85b-18ffe05fb8b1 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:57.421239 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c4cb9a-467d-490b-8d0e-000e276e5d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:57.421876 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4cb9a-467d-490b-8d0e-000e276e5d38 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:57.422164 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4cb9a-467d-490b-8d0e-000e276e5d38 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:57.422438 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4cb9a-467d-490b-8d0e-000e276e5d38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:57.423255 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c4cb9a-467d-490b-8d0e-000e276e5d38 None admin] RBAC: Adding query filter params (role.id=1a8e523ecbc84d818c2a9af0fb54da74, scope.project.id=070652942bfc4c1f817ce9ab7ae4dc61, user.id=3a0d687cf7384d0d93d273c2c3afcdd8) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:57.423565 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c4cb9a-467d-490b-8d0e-000e276e5d38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:57.425514 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c4cb9a-467d-490b-8d0e-000e276e5d38 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:57.430747 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 589/1185] 10.222.0.16 () {56 vars in 1374 bytes} [Thu May 26 12:22:57 2022] GET /identity/v3/role_assignments?user.id=3a0d687cf7384d0d93d273c2c3afcdd8&scope.project.id=070652942bfc4c1f817ce9ab7ae4dc61&role.id=1a8e523ecbc84d818c2a9af0fb54da74 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:59.585965 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f3303-f7da-42cc-a094-c1e7a575d1dd None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:59.586521 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f3303-f7da-42cc-a094-c1e7a575d1dd None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:59.586521 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f3303-f7da-42cc-a094-c1e7a575d1dd None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:59.587918 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 597/1186] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:22:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:22:59.593242 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5162d-a026-43a2-80a0-8599f42f94d5 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:59.593632 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5162d-a026-43a2-80a0-8599f42f94d5 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:59.593794 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5162d-a026-43a2-80a0-8599f42f94d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:59.610302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-80b5162d-a026-43a2-80a0-8599f42f94d5 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:22:59.611967 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-80b5162d-a026-43a2-80a0-8599f42f94d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:22:59.634250 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:59.677023 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 590/1187] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:22:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:22:59.700195 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f3303-f7da-42cc-a094-c1e7a575d1dd None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:59.799264 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f3303-f7da-42cc-a094-c1e7a575d1dd None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:59.833025 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ddbe79-d3b3-4942-ae95-3b79fa24306c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:59.833807 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ddbe79-d3b3-4942-ae95-3b79fa24306c None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:59.834092 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ddbe79-d3b3-4942-ae95-3b79fa24306c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:59.834369 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ddbe79-d3b3-4942-ae95-3b79fa24306c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:59.844337 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ddbe79-d3b3-4942-ae95-3b79fa24306c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:22:59.852615 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-74ddbe79-d3b3-4942-ae95-3b79fa24306c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:22:59.852615 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:59.852615 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:22:59.852615 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:22:59.852615 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:22:59.852615 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:22:59.852615 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:22:59.852615 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:22:59.852615 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:22:59.852615 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:22:59.852615 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:22:59.852615 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:22:59.852615 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:22:59.852615 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:22:59.852615 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:22:59.852615 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:22:59.853774 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:22:59.853774 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:22:59.853774 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:22:59.853774 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:22:59.853774 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:22:59.853774 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:22:59.853774 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:22:59.853774 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:22:59.853774 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:22:59.853774 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:22:59.853774 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:22:59.853774 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:22:59.853774 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:22:59.853774 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:22:59.853774 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:22:59.853774 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:22:59.854924 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:22:59.854924 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:22:59.854924 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:22:59.854924 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:22:59.854924 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:22:59.854924 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:22:59.854924 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:22:59.854924 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:22:59.854924 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:22:59.854924 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:22:59.854924 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:22:59.854924 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:22:59.854924 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 598/1188] 10.222.0.16 () {56 vars in 1096 bytes} [Thu May 26 12:22:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:22:59.859825 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b5162d-a026-43a2-80a0-8599f42f94d5 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:59.954116 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b5162d-a026-43a2-80a0-8599f42f94d5 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:59.987150 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d18d1ce-d759-4d7e-a80a-9560d2b80e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:59.987798 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d18d1ce-d759-4d7e-a80a-9560d2b80e5c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:59.988085 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d18d1ce-d759-4d7e-a80a-9560d2b80e5c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:59.988359 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d18d1ce-d759-4d7e-a80a-9560d2b80e5c None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:59.989127 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d18d1ce-d759-4d7e-a80a-9560d2b80e5c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:59.989434 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d18d1ce-d759-4d7e-a80a-9560d2b80e5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:59.990798 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d18d1ce-d759-4d7e-a80a-9560d2b80e5c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:59.998503 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 591/1189] 10.222.0.16 () {56 vars in 1099 bytes} [Thu May 26 12:22:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:00.004044 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ddbe79-d3b3-4942-ae95-3b79fa24306c None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:00.007695 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:00.101208 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ddbe79-d3b3-4942-ae95-3b79fa24306c None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:00.133239 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2140456-4603-4bae-afea-365cd2d3dd96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:00.134089 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2140456-4603-4bae-afea-365cd2d3dd96 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:00.134371 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2140456-4603-4bae-afea-365cd2d3dd96 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:00.134643 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2140456-4603-4bae-afea-365cd2d3dd96 None admin] PATH_INFO: `/v3/users/3a0d687cf7384d0d93d273c2c3afcdd8` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:00.135805 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2140456-4603-4bae-afea-365cd2d3dd96 None admin] RBAC: Authorizing `identity:get_user(user_id=3a0d687cf7384d0d93d273c2c3afcdd8)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:00.137245 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2140456-4603-4bae-afea-365cd2d3dd96 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:00.138838 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 599/1190] 10.222.0.16 () {56 vars in 1177 bytes} [Thu May 26 12:23:00 2022] GET /identity/v3/users/3a0d687cf7384d0d93d273c2c3afcdd8 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:00.144414 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d18d1ce-d759-4d7e-a80a-9560d2b80e5c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:00.166065 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:00.241952 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d18d1ce-d759-4d7e-a80a-9560d2b80e5c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:00.273770 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac4e4f9-6969-4933-8f09-0d7a0e87bc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:00.274614 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac4e4f9-6969-4933-8f09-0d7a0e87bc45 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:00.274893 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac4e4f9-6969-4933-8f09-0d7a0e87bc45 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:00.275166 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac4e4f9-6969-4933-8f09-0d7a0e87bc45 None admin] PATH_INFO: `/v3/projects/070652942bfc4c1f817ce9ab7ae4dc61` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:00.276313 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac4e4f9-6969-4933-8f09-0d7a0e87bc45 None admin] RBAC: Authorizing `identity:get_project(project_id=070652942bfc4c1f817ce9ab7ae4dc61)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:00.277764 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac4e4f9-6969-4933-8f09-0d7a0e87bc45 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:00.279411 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 592/1191] 10.222.0.16 () {56 vars in 1186 bytes} [Thu May 26 12:23:00 2022] GET /identity/v3/projects/070652942bfc4c1f817ce9ab7ae4dc61 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:00.285715 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2140456-4603-4bae-afea-365cd2d3dd96 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:00.353236 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:00.381335 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2140456-4603-4bae-afea-365cd2d3dd96 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:00.413791 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b733c18-22c8-4abe-8624-3702367e162a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:00.414655 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b733c18-22c8-4abe-8624-3702367e162a None admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:00.414936 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b733c18-22c8-4abe-8624-3702367e162a None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:00.415209 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b733c18-22c8-4abe-8624-3702367e162a None admin] PATH_INFO: `/v3/projects/070652942bfc4c1f817ce9ab7ae4dc61/users/3a0d687cf7384d0d93d273c2c3afcdd8/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:00.417149 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b733c18-22c8-4abe-8624-3702367e162a None admin] RBAC: Authorizing `identity:create_grant(project_id=070652942bfc4c1f817ce9ab7ae4dc61, user_id=3a0d687cf7384d0d93d273c2c3afcdd8, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:00.418554 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b733c18-22c8-4abe-8624-3702367e162a None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:00.430368 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 600/1192] 10.222.0.16 () {58 vars in 1439 bytes} [Thu May 26 12:23:00 2022] PUT /identity/v3/projects/070652942bfc4c1f817ce9ab7ae4dc61/users/3a0d687cf7384d0d93d273c2c3afcdd8/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:23:02.575562 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a829f-8f27-4e55-ad4d-1b7aa7223e06 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:02.576092 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a829f-8f27-4e55-ad4d-1b7aa7223e06 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:02.576214 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a829f-8f27-4e55-ad4d-1b7aa7223e06 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:02.577517 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 593/1193] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:23:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:02.582784 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4a79c-b8ba-49aa-be2a-9f302f7d96b8 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:02.583202 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4a79c-b8ba-49aa-be2a-9f302f7d96b8 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:02.583345 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4a79c-b8ba-49aa-be2a-9f302f7d96b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:02.600008 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-9ba4a79c-b8ba-49aa-be2a-9f302f7d96b8 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:02.601226 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-9ba4a79c-b8ba-49aa-be2a-9f302f7d96b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:02.665785 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 601/1194] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:23:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:23:02.690361 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a829f-8f27-4e55-ad4d-1b7aa7223e06 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:02.777014 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:02.789490 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a829f-8f27-4e55-ad4d-1b7aa7223e06 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:02.822651 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eb9f1d-f002-4e1f-8ed0-f9e2c5367d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:02.823427 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb9f1d-f002-4e1f-8ed0-f9e2c5367d2a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:02.823705 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb9f1d-f002-4e1f-8ed0-f9e2c5367d2a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:02.823977 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb9f1d-f002-4e1f-8ed0-f9e2c5367d2a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:02.833684 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eb9f1d-f002-4e1f-8ed0-f9e2c5367d2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:02.841120 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-75eb9f1d-f002-4e1f-8ed0-f9e2c5367d2a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:23:02.841120 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:02.841120 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:02.841120 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:02.841120 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:02.841120 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:02.841120 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:02.841120 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:02.841120 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:02.841120 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:02.841120 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:02.841120 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:02.841120 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:02.841120 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:02.841120 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:02.841120 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:02.842193 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:02.842193 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:02.842193 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:02.842193 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:02.842193 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:02.842193 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:02.842193 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:02.842193 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:02.842193 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:02.842193 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:02.842193 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:02.842193 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:23:02.842193 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:02.842193 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:02.842193 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:02.842193 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:02.843462 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:02.843462 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:02.843462 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:02.843462 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:02.843462 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:02.843462 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:02.843462 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:02.843462 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:02.843462 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:02.843462 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:02.843462 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:23:02.843462 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:23:02.843462 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 594/1195] 10.222.0.16 () {56 vars in 1096 bytes} [Thu May 26 12:23:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:23:02.849043 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba4a79c-b8ba-49aa-be2a-9f302f7d96b8 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:02.907618 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:02.946770 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba4a79c-b8ba-49aa-be2a-9f302f7d96b8 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:02.979613 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b3326-7a5d-45c2-a93b-3d4b5cdedf9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:02.980262 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b3326-7a5d-45c2-a93b-3d4b5cdedf9f None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:02.980569 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b3326-7a5d-45c2-a93b-3d4b5cdedf9f None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:02.980869 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b3326-7a5d-45c2-a93b-3d4b5cdedf9f None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:02.981608 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b3326-7a5d-45c2-a93b-3d4b5cdedf9f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:02.981911 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b3326-7a5d-45c2-a93b-3d4b5cdedf9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:02.983267 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b3326-7a5d-45c2-a93b-3d4b5cdedf9f None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:02.991659 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 602/1196] 10.222.0.16 () {56 vars in 1099 bytes} [Thu May 26 12:23:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:02.997407 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eb9f1d-f002-4e1f-8ed0-f9e2c5367d2a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:03.090911 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eb9f1d-f002-4e1f-8ed0-f9e2c5367d2a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:03.123143 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534b5c17-6098-49fe-ae23-803c5670ab1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:03.123984 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b5c17-6098-49fe-ae23-803c5670ab1f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:03.124263 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b5c17-6098-49fe-ae23-803c5670ab1f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:03.124530 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b5c17-6098-49fe-ae23-803c5670ab1f None admin] PATH_INFO: `/v3/users/3a0d687cf7384d0d93d273c2c3afcdd8` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:03.125707 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534b5c17-6098-49fe-ae23-803c5670ab1f None admin] RBAC: Authorizing `identity:get_user(user_id=3a0d687cf7384d0d93d273c2c3afcdd8)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:03.127150 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534b5c17-6098-49fe-ae23-803c5670ab1f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:03.128715 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 595/1197] 10.222.0.16 () {56 vars in 1177 bytes} [Thu May 26 12:23:02 2022] GET /identity/v3/users/3a0d687cf7384d0d93d273c2c3afcdd8 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:03.134338 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b3326-7a5d-45c2-a93b-3d4b5cdedf9f None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:03.231413 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b3326-7a5d-45c2-a93b-3d4b5cdedf9f None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:03.253224 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:03.263951 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b1926-ae52-4428-8310-3a9c308ab265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:03.264601 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b1926-ae52-4428-8310-3a9c308ab265 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:03.265893 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b1926-ae52-4428-8310-3a9c308ab265 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:03.265893 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b1926-ae52-4428-8310-3a9c308ab265 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:03.328891 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b1926-ae52-4428-8310-3a9c308ab265 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:03.330849 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b1926-ae52-4428-8310-3a9c308ab265 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:03.424269 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 603/1198] 10.222.0.16 () {58 vars in 1282 bytes} [Thu May 26 12:23:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:23:03.430026 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534b5c17-6098-49fe-ae23-803c5670ab1f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:03.447555 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:03.525450 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534b5c17-6098-49fe-ae23-803c5670ab1f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:03.557084 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b718eb4c-d617-41a0-91b9-995d9e90cd9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:03.557923 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b718eb4c-d617-41a0-91b9-995d9e90cd9c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:03.558200 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b718eb4c-d617-41a0-91b9-995d9e90cd9c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:03.558476 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b718eb4c-d617-41a0-91b9-995d9e90cd9c None admin] PATH_INFO: `/v3/projects/070652942bfc4c1f817ce9ab7ae4dc61` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:03.559621 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b718eb4c-d617-41a0-91b9-995d9e90cd9c None admin] RBAC: Authorizing `identity:get_project(project_id=070652942bfc4c1f817ce9ab7ae4dc61)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:03.561073 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b718eb4c-d617-41a0-91b9-995d9e90cd9c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:03.562727 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 596/1199] 10.222.0.16 () {56 vars in 1186 bytes} [Thu May 26 12:23:03 2022] GET /identity/v3/projects/070652942bfc4c1f817ce9ab7ae4dc61 => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:03.569144 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b1926-ae52-4428-8310-3a9c308ab265 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:03.593129 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:03.664433 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b1926-ae52-4428-8310-3a9c308ab265 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:03.696566 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc2fb9-d165-4005-8e8c-c71ce312c344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:03.697168 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc2fb9-d165-4005-8e8c-c71ce312c344 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:03.697448 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc2fb9-d165-4005-8e8c-c71ce312c344 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:03.697720 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc2fb9-d165-4005-8e8c-c71ce312c344 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:03.698535 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadc2fb9-d165-4005-8e8c-c71ce312c344 None admin] RBAC: Adding query filter params (role.id=1a8e523ecbc84d818c2a9af0fb54da74, scope.project.id=070652942bfc4c1f817ce9ab7ae4dc61, user.id=3a0d687cf7384d0d93d273c2c3afcdd8) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:03.698841 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadc2fb9-d165-4005-8e8c-c71ce312c344 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:03.700241 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadc2fb9-d165-4005-8e8c-c71ce312c344 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:03.706431 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 604/1200] 10.222.0.16 () {56 vars in 1374 bytes} [Thu May 26 12:23:03 2022] GET /identity/v3/role_assignments?user.id=3a0d687cf7384d0d93d273c2c3afcdd8&scope.project.id=070652942bfc4c1f817ce9ab7ae4dc61&role.id=1a8e523ecbc84d818c2a9af0fb54da74 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:13.553116 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=58 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:13.703339 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=56 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:03.463318 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748856e5-1c3f-4c8e-8936-3c872ec43120 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:03.463927 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748856e5-1c3f-4c8e-8936-3c872ec43120 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:03.463927 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748856e5-1c3f-4c8e-8936-3c872ec43120 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:03.465792 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 597/1201] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:24:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:03.471219 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af14550-8e75-4d83-be65-fb13a107fed3 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:03.471684 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af14550-8e75-4d83-be65-fb13a107fed3 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:03.471794 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af14550-8e75-4d83-be65-fb13a107fed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:03.498949 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-0af14550-8e75-4d83-be65-fb13a107fed3 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:03.500378 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-0af14550-8e75-4d83-be65-fb13a107fed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:03.588883 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 605/1202] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:24:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:24:03.616041 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748856e5-1c3f-4c8e-8936-3c872ec43120 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:03.754308 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748856e5-1c3f-4c8e-8936-3c872ec43120 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:03.798849 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc0766-2c83-4dc1-9025-794d7daf1db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:03.799757 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc0766-2c83-4dc1-9025-794d7daf1db3 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:03.800616 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc0766-2c83-4dc1-9025-794d7daf1db3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:03.800961 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc0766-2c83-4dc1-9025-794d7daf1db3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:03.813226 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc0766-2c83-4dc1-9025-794d7daf1db3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:03.815039 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc0766-2c83-4dc1-9025-794d7daf1db3 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:03.835084 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-6cdc0766-2c83-4dc1-9025-794d7daf1db3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:03.835084 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:03.835084 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:03.835084 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:03.835084 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:03.835084 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:03.835084 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:03.835084 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:03.835084 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:03.835084 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:03.835084 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:03.835084 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:03.835084 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:03.835084 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:03.835084 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:03.836153 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:03.836153 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:03.836153 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:03.836153 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:03.836153 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:03.836153 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:03.836153 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:03.836153 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:03.836153 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:24:03.836153 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:03.836153 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:03.836153 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:03.836153 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:03.836153 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:03.836153 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:03.836153 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:03.836153 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:03.842733 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:03.842733 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:03.842733 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:03.842733 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:24:03.842733 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 598/1203] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:24:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:03.843122 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af14550-8e75-4d83-be65-fb13a107fed3 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:03.974779 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af14550-8e75-4d83-be65-fb13a107fed3 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:04.012893 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:04.021510 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d0bed-5924-43fb-9adc-e025a7418e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:04.022417 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d0bed-5924-43fb-9adc-e025a7418e75 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:04.022819 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d0bed-5924-43fb-9adc-e025a7418e75 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:04.023102 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d0bed-5924-43fb-9adc-e025a7418e75 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:04.023839 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69d0bed-5924-43fb-9adc-e025a7418e75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:04.024293 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69d0bed-5924-43fb-9adc-e025a7418e75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:04.026019 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69d0bed-5924-43fb-9adc-e025a7418e75 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:04.049845 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 606/1204] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:24:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:04.052001 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc0766-2c83-4dc1-9025-794d7daf1db3 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:04.120792 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:04.194857 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc0766-2c83-4dc1-9025-794d7daf1db3 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:04.244056 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74adcf6-b52a-43de-b3bf-b7d6a6a60c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:04.244741 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74adcf6-b52a-43de-b3bf-b7d6a6a60c25 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:04.245059 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74adcf6-b52a-43de-b3bf-b7d6a6a60c25 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:04.245339 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74adcf6-b52a-43de-b3bf-b7d6a6a60c25 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:04.246045 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74adcf6-b52a-43de-b3bf-b7d6a6a60c25 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:04.247661 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74adcf6-b52a-43de-b3bf-b7d6a6a60c25 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:04.281034 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 599/1205] 10.222.0.16 () {60 vars in 1132 bytes} [Thu May 26 12:24:04 2022] POST /identity/v3/users => generated 251 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:24:06.687575 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4182480-0120-4930-a697-8000460373bf None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:06.688134 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4182480-0120-4930-a697-8000460373bf None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:06.688134 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4182480-0120-4930-a697-8000460373bf None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:06.689566 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 607/1206] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:24:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:06.696772 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1aa693-a660-4fcf-be20-b06f1cf4c224 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:06.696772 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1aa693-a660-4fcf-be20-b06f1cf4c224 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:06.696772 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1aa693-a660-4fcf-be20-b06f1cf4c224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:06.716039 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-3e1aa693-a660-4fcf-be20-b06f1cf4c224 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:06.717316 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3e1aa693-a660-4fcf-be20-b06f1cf4c224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:06.805516 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 600/1207] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:24:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:24:06.829201 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4182480-0120-4930-a697-8000460373bf None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:06.947837 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4182480-0120-4930-a697-8000460373bf None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:06.986936 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49296e-b4a2-40fb-9334-7e2496c7e622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:06.987816 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49296e-b4a2-40fb-9334-7e2496c7e622 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:06.988136 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49296e-b4a2-40fb-9334-7e2496c7e622 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:06.988413 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49296e-b4a2-40fb-9334-7e2496c7e622 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:07.000004 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49296e-b4a2-40fb-9334-7e2496c7e622 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:07.008573 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-3d49296e-b4a2-40fb-9334-7e2496c7e622 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:07.008573 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:07.008573 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:07.008573 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:07.008573 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:07.008573 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:07.008573 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:07.008573 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:07.008573 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:07.008573 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:07.008573 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:07.008573 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:07.008573 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:07.008573 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:07.008573 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:07.008573 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:07.009730 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:07.009730 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:07.009730 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:07.009730 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:07.009730 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:07.009730 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:07.009730 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:07.009730 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:07.009730 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:07.009730 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:07.009730 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:07.009730 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:24:07.009730 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:07.009730 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:07.009730 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:07.009730 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:07.010622 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:07.010622 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:07.010622 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:07.010622 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:07.010622 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:07.010622 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:07.010622 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:07.010622 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:07.010622 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:07.010622 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:07.010622 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:07.010622 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:24:07.010622 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 608/1208] 10.222.0.16 () {56 vars in 1102 bytes} [Thu May 26 12:24:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:07.016334 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1aa693-a660-4fcf-be20-b06f1cf4c224 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:07.063909 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:07.135479 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1aa693-a660-4fcf-be20-b06f1cf4c224 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:07.181898 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7629e8c7-bdd5-4c3e-b03e-6081cadc6915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:07.182661 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629e8c7-bdd5-4c3e-b03e-6081cadc6915 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:07.182993 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629e8c7-bdd5-4c3e-b03e-6081cadc6915 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:07.183338 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629e8c7-bdd5-4c3e-b03e-6081cadc6915 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:07.184082 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7629e8c7-bdd5-4c3e-b03e-6081cadc6915 None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:07.184389 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7629e8c7-bdd5-4c3e-b03e-6081cadc6915 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:07.186296 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7629e8c7-bdd5-4c3e-b03e-6081cadc6915 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:07.195622 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 601/1209] 10.222.0.16 () {56 vars in 1103 bytes} [Thu May 26 12:24:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:07.202100 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49296e-b4a2-40fb-9334-7e2496c7e622 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:07.282222 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:07.352944 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49296e-b4a2-40fb-9334-7e2496c7e622 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:07.399654 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb7f189-a508-4691-8af2-42b6522e4678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:07.400885 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7f189-a508-4691-8af2-42b6522e4678 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:07.401038 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7f189-a508-4691-8af2-42b6522e4678 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:07.401227 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7f189-a508-4691-8af2-42b6522e4678 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:07.423620 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb7f189-a508-4691-8af2-42b6522e4678 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:07.425463 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb7f189-a508-4691-8af2-42b6522e4678 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:07.447121 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-fdb7f189-a508-4691-8af2-42b6522e4678 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:07.447121 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:07.447121 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:07.447121 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:07.447121 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:07.447121 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:07.447121 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:07.447121 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:07.447121 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:07.447121 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:07.447121 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:07.447121 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:07.447121 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:07.447121 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:07.447121 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:07.448132 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:07.448132 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:07.448132 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:07.448132 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:07.448132 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:07.448132 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:07.448132 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:07.448132 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:07.448132 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:24:07.448132 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:07.448132 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:07.448132 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:07.448132 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:07.448132 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:07.448132 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:07.448132 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:07.448132 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:07.455602 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:07.455602 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:07.455602 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:07.455602 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:24:07.455602 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 609/1210] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:24:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:07.456087 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7629e8c7-bdd5-4c3e-b03e-6081cadc6915 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:07.577566 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:07.581925 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7629e8c7-bdd5-4c3e-b03e-6081cadc6915 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:07.625276 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848bf80-8659-4a6c-b2dc-01164b7e4fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:07.626098 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848bf80-8659-4a6c-b2dc-01164b7e4fe6 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:07.626479 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848bf80-8659-4a6c-b2dc-01164b7e4fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:07.626916 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848bf80-8659-4a6c-b2dc-01164b7e4fe6 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:07.627778 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4848bf80-8659-4a6c-b2dc-01164b7e4fe6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:07.628201 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4848bf80-8659-4a6c-b2dc-01164b7e4fe6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:07.629781 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4848bf80-8659-4a6c-b2dc-01164b7e4fe6 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:07.643699 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 602/1211] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:24:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:07.649726 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb7f189-a508-4691-8af2-42b6522e4678 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:07.766960 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb7f189-a508-4691-8af2-42b6522e4678 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:07.769274 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:07.805885 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d81cbc1-2413-459d-8641-b46dcd4e9eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:07.806687 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81cbc1-2413-459d-8641-b46dcd4e9eda None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:07.807035 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81cbc1-2413-459d-8641-b46dcd4e9eda None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:07.807334 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81cbc1-2413-459d-8641-b46dcd4e9eda None admin] PATH_INFO: `/v3/users/placement` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:07.816075 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d81cbc1-2413-459d-8641-b46dcd4e9eda None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:07.817670 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d81cbc1-2413-459d-8641-b46dcd4e9eda None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:07.832898 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-0d81cbc1-2413-459d-8641-b46dcd4e9eda None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 12:24:07.832898 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:07.832898 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:07.832898 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:07.832898 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:07.832898 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:07.832898 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:07.832898 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:07.832898 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:07.832898 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:07.832898 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:07.832898 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:07.832898 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:24:07.832898 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:24:07.832898 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:24:07.832898 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:24:07.833920 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:07.833920 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:07.833920 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:24:07.833920 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:07.833920 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:24:07.833920 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:07.833920 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:07.833920 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:07.833920 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:07.833920 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:07.833920 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:07.833920 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:24:07.833920 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:07.833920 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:07.833920 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:07.833920 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:07.833920 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:07.833920 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:07.834903 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:07.834903 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:07.834903 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:24:07.834903 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:24:07.834903 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:24:07.834903 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:24:07.834903 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:24:07.834903 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:24:07.834903 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 12:24:07.834903 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:24:07.837168 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 610/1212] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:24:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:07.839807 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848bf80-8659-4a6c-b2dc-01164b7e4fe6 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:07.955146 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848bf80-8659-4a6c-b2dc-01164b7e4fe6 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:08.000730 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7938b9-419d-46cc-bc48-77d6efcba382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:08.001427 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7938b9-419d-46cc-bc48-77d6efcba382 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:08.001711 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7938b9-419d-46cc-bc48-77d6efcba382 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:08.002064 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7938b9-419d-46cc-bc48-77d6efcba382 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:08.003084 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7938b9-419d-46cc-bc48-77d6efcba382 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:08.003481 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7938b9-419d-46cc-bc48-77d6efcba382 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:08.004985 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7938b9-419d-46cc-bc48-77d6efcba382 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:08.025827 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 603/1213] 10.222.0.16 () {56 vars in 1143 bytes} [Thu May 26 12:24:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:08.031403 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d81cbc1-2413-459d-8641-b46dcd4e9eda None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:08.143686 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d81cbc1-2413-459d-8641-b46dcd4e9eda None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:08.182749 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64497b59-d0a7-4014-a6ae-2bfd059bfa26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:08.183402 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64497b59-d0a7-4014-a6ae-2bfd059bfa26 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:08.183681 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64497b59-d0a7-4014-a6ae-2bfd059bfa26 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:08.183951 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64497b59-d0a7-4014-a6ae-2bfd059bfa26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:08.220266 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:08.269896 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64497b59-d0a7-4014-a6ae-2bfd059bfa26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:08.271603 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64497b59-d0a7-4014-a6ae-2bfd059bfa26 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:08.396289 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 611/1214] 10.222.0.16 () {58 vars in 1282 bytes} [Thu May 26 12:24:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 12:24:08.398456 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7938b9-419d-46cc-bc48-77d6efcba382 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:08.420379 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:08.519857 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7938b9-419d-46cc-bc48-77d6efcba382 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:08.563148 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d774e4c1-51ff-472c-87cc-290af6d9a1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:08.564222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774e4c1-51ff-472c-87cc-290af6d9a1f7 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:08.564499 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774e4c1-51ff-472c-87cc-290af6d9a1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:08.564772 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774e4c1-51ff-472c-87cc-290af6d9a1f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:08.577262 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d774e4c1-51ff-472c-87cc-290af6d9a1f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:08.578753 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d774e4c1-51ff-472c-87cc-290af6d9a1f7 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:08.598103 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-d774e4c1-51ff-472c-87cc-290af6d9a1f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:08.598103 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:08.598103 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:08.598103 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:08.598103 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:08.598103 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:08.598103 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:08.598103 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:08.598103 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:08.598103 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:08.598103 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:08.598103 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:08.598103 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:08.598103 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:08.598103 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:08.599073 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:08.599073 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:08.599073 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:08.599073 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:08.599073 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:08.599073 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:08.599073 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:08.599073 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:08.599073 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:24:08.599073 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:08.599073 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:08.599073 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:08.599073 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:08.599073 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:08.599073 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:08.599073 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:08.599073 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:08.599994 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:08.599994 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:08.599994 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:08.599994 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:24:08.599994 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 604/1215] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:24:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:08.607666 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64497b59-d0a7-4014-a6ae-2bfd059bfa26 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:08.685583 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:08.732571 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64497b59-d0a7-4014-a6ae-2bfd059bfa26 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:08.774489 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d309194-a99c-45c3-a48e-0012bf26386d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:08.775330 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d309194-a99c-45c3-a48e-0012bf26386d None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:08.775589 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d309194-a99c-45c3-a48e-0012bf26386d None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:08.775894 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d309194-a99c-45c3-a48e-0012bf26386d None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:08.776627 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d309194-a99c-45c3-a48e-0012bf26386d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:08.776962 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d309194-a99c-45c3-a48e-0012bf26386d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:08.778333 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d309194-a99c-45c3-a48e-0012bf26386d None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:08.790738 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 612/1216] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:24:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:08.797001 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d774e4c1-51ff-472c-87cc-290af6d9a1f7 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:08.888170 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:08.926779 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d774e4c1-51ff-472c-87cc-290af6d9a1f7 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:08.971647 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295aaa42-cfe1-4d5e-9faa-c4689bbf61db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:08.973144 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295aaa42-cfe1-4d5e-9faa-c4689bbf61db None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:08.973551 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295aaa42-cfe1-4d5e-9faa-c4689bbf61db None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:08.973863 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295aaa42-cfe1-4d5e-9faa-c4689bbf61db None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:08.981352 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295aaa42-cfe1-4d5e-9faa-c4689bbf61db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:08.982811 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295aaa42-cfe1-4d5e-9faa-c4689bbf61db None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:08.997008 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-295aaa42-cfe1-4d5e-9faa-c4689bbf61db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:08.997008 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:08.997008 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:08.997008 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:08.997008 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:08.997008 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:08.997008 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:08.997008 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:08.997008 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:08.997008 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:08.997008 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:08.997008 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:08.997008 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:24:08.997008 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:24:08.997008 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:24:08.998154 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:24:08.998154 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:08.998154 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:08.998154 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:08.998154 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:08.998154 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:08.998154 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:08.998154 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:08.998154 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:24:08.998154 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:08.998154 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:08.998154 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:08.998154 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:08.998154 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:08.998154 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:08.998154 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:08.998154 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:09.004399 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:24:09.004399 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:24:09.004399 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:24:09.004399 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:24:09.004399 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:24:09.004399 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:24:09.004399 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:09.004399 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:24:09.004399 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 605/1217] 10.222.0.16 () {56 vars in 1111 bytes} [Thu May 26 12:24:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:09.005186 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d309194-a99c-45c3-a48e-0012bf26386d None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:09.125660 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d309194-a99c-45c3-a48e-0012bf26386d None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:09.152643 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:09.164993 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a364e5-fe98-4346-bd35-eb1ae5feda4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:09.165647 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a364e5-fe98-4346-bd35-eb1ae5feda4a None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:09.165932 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a364e5-fe98-4346-bd35-eb1ae5feda4a None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:09.166207 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a364e5-fe98-4346-bd35-eb1ae5feda4a None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:09.166985 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a364e5-fe98-4346-bd35-eb1ae5feda4a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:09.167295 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a364e5-fe98-4346-bd35-eb1ae5feda4a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:09.168710 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a364e5-fe98-4346-bd35-eb1ae5feda4a None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:09.182584 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 613/1218] 10.222.0.16 () {56 vars in 1148 bytes} [Thu May 26 12:24:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:09.189004 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295aaa42-cfe1-4d5e-9faa-c4689bbf61db None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:09.313592 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295aaa42-cfe1-4d5e-9faa-c4689bbf61db None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:09.350579 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:09.358707 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff30758-2f55-47b2-991a-8c332bcfc1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:09.359514 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff30758-2f55-47b2-991a-8c332bcfc1cd None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:09.359831 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff30758-2f55-47b2-991a-8c332bcfc1cd None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:09.360138 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff30758-2f55-47b2-991a-8c332bcfc1cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:09.361036 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff30758-2f55-47b2-991a-8c332bcfc1cd None admin] RBAC: Adding query filter params (role.id=2991da7c6ccc478bbfdc0ce47a959495, scope.project.id=42e6c693bd224d92b8a0fe4ad0cc586d, user.id=4327435c97834afeb7e6806ef02349a2) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:09.361352 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff30758-2f55-47b2-991a-8c332bcfc1cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:09.363297 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff30758-2f55-47b2-991a-8c332bcfc1cd None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:09.369354 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 606/1219] 10.222.0.16 () {56 vars in 1374 bytes} [Thu May 26 12:24:09 2022] GET /identity/v3/role_assignments?user.id=4327435c97834afeb7e6806ef02349a2&scope.project.id=42e6c693bd224d92b8a0fe4ad0cc586d&role.id=2991da7c6ccc478bbfdc0ce47a959495 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:11.826810 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7015d-eaaf-454c-a2df-3ad5f4529a68 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:11.827366 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7015d-eaaf-454c-a2df-3ad5f4529a68 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:11.827366 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7015d-eaaf-454c-a2df-3ad5f4529a68 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:11.828822 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 614/1220] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:24:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:11.834912 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3dc5b-e9cf-4628-90a5-cf42f2cb3b00 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:11.835330 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3dc5b-e9cf-4628-90a5-cf42f2cb3b00 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:11.835491 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3dc5b-e9cf-4628-90a5-cf42f2cb3b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:11.853055 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-85a3dc5b-e9cf-4628-90a5-cf42f2cb3b00 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:11.854257 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-85a3dc5b-e9cf-4628-90a5-cf42f2cb3b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:11.926553 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 607/1221] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:24:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:24:11.951360 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7015d-eaaf-454c-a2df-3ad5f4529a68 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:12.061251 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7015d-eaaf-454c-a2df-3ad5f4529a68 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:12.095455 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c236b0ca-d9eb-41c3-ab9a-ae00d2554bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:12.096318 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236b0ca-d9eb-41c3-ab9a-ae00d2554bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:12.096538 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236b0ca-d9eb-41c3-ab9a-ae00d2554bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:12.096786 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236b0ca-d9eb-41c3-ab9a-ae00d2554bb6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:12.108015 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c236b0ca-d9eb-41c3-ab9a-ae00d2554bb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:12.115867 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-c236b0ca-d9eb-41c3-ab9a-ae00d2554bb6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:12.115867 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:12.115867 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:12.115867 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:12.115867 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:12.115867 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:12.115867 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:12.115867 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:12.115867 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:12.115867 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:12.115867 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:12.115867 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:12.115867 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:12.115867 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:12.115867 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:12.115867 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:12.123359 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:12.123359 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:12.123359 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:12.123359 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:12.123359 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:12.123359 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:12.123359 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:12.123359 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:12.123359 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:12.123359 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:12.123359 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:12.123359 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:24:12.123359 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:12.123359 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:12.123359 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:12.123359 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:12.124451 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:12.124451 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:12.124451 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:12.124451 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:12.124451 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:12.124451 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:12.124451 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:12.124451 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:12.124451 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:12.124451 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:12.124451 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:12.124451 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:24:12.124451 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 615/1222] 10.222.0.16 () {56 vars in 1102 bytes} [Thu May 26 12:24:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:12.125553 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a3dc5b-e9cf-4628-90a5-cf42f2cb3b00 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:12.236619 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a3dc5b-e9cf-4628-90a5-cf42f2cb3b00 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:12.261584 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:12.275105 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e33d9f-fd86-4f9b-a85a-8489d9e502f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:12.275841 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e33d9f-fd86-4f9b-a85a-8489d9e502f0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:12.276186 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e33d9f-fd86-4f9b-a85a-8489d9e502f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:12.276517 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e33d9f-fd86-4f9b-a85a-8489d9e502f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:12.277415 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e33d9f-fd86-4f9b-a85a-8489d9e502f0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:12.277855 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e33d9f-fd86-4f9b-a85a-8489d9e502f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:12.279793 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e33d9f-fd86-4f9b-a85a-8489d9e502f0 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:12.289386 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 608/1223] 10.222.0.16 () {56 vars in 1103 bytes} [Thu May 26 12:24:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:12.295348 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c236b0ca-d9eb-41c3-ab9a-ae00d2554bb6 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:12.343527 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:12.405418 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c236b0ca-d9eb-41c3-ab9a-ae00d2554bb6 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:12.444854 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24645991-ef93-4c4b-b16e-0e6d9cdda3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:12.446051 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24645991-ef93-4c4b-b16e-0e6d9cdda3bb None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:12.446430 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24645991-ef93-4c4b-b16e-0e6d9cdda3bb None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:12.446819 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24645991-ef93-4c4b-b16e-0e6d9cdda3bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:12.458837 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24645991-ef93-4c4b-b16e-0e6d9cdda3bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:12.460426 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24645991-ef93-4c4b-b16e-0e6d9cdda3bb None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:12.486624 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-24645991-ef93-4c4b-b16e-0e6d9cdda3bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:12.486624 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:12.486624 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:12.486624 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:12.486624 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:12.486624 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:12.486624 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:12.486624 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:12.486624 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:12.486624 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:12.486624 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:12.486624 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:12.486624 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:12.486624 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:12.486624 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:12.488297 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:12.488297 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:12.488297 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:12.488297 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:12.488297 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:12.488297 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:12.488297 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:12.488297 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:12.488297 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:24:12.488297 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:12.488297 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:12.488297 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:12.488297 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:12.488297 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:12.488297 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:12.488297 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:12.488297 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:12.489413 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:12.489413 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:12.489413 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:12.489413 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:24:12.489733 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 616/1224] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:24:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:24:12.496405 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e33d9f-fd86-4f9b-a85a-8489d9e502f0 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:12.614115 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e33d9f-fd86-4f9b-a85a-8489d9e502f0 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:12.650349 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e7687-eeff-4c93-82cc-d29608915f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:12.651057 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e7687-eeff-4c93-82cc-d29608915f94 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:12.651298 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e7687-eeff-4c93-82cc-d29608915f94 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:12.651581 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e7687-eeff-4c93-82cc-d29608915f94 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:12.652305 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3e7687-eeff-4c93-82cc-d29608915f94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:12.652638 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3e7687-eeff-4c93-82cc-d29608915f94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:12.654028 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3e7687-eeff-4c93-82cc-d29608915f94 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:12.666913 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 609/1225] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:24:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:12.673518 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24645991-ef93-4c4b-b16e-0e6d9cdda3bb None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:12.787855 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:12.795176 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24645991-ef93-4c4b-b16e-0e6d9cdda3bb None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:12.837539 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a59df6d-cde9-4f00-b4bf-8d48536429d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:12.838443 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59df6d-cde9-4f00-b4bf-8d48536429d6 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:12.838760 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59df6d-cde9-4f00-b4bf-8d48536429d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:12.839070 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59df6d-cde9-4f00-b4bf-8d48536429d6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:12.848440 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a59df6d-cde9-4f00-b4bf-8d48536429d6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:12.850097 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a59df6d-cde9-4f00-b4bf-8d48536429d6 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:12.866244 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-4a59df6d-cde9-4f00-b4bf-8d48536429d6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 12:24:12.866244 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:12.866244 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:12.866244 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:12.866244 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:12.866244 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:12.866244 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:12.866244 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:12.866244 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:12.866244 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:12.866244 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:12.866244 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:12.866244 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:24:12.866244 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:24:12.866244 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:24:12.866244 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:24:12.867435 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:12.867435 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:12.867435 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:24:12.867435 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:12.867435 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:24:12.867435 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:12.867435 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:12.867435 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:12.867435 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:12.867435 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:12.867435 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:12.867435 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:24:12.867435 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:12.867435 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:12.867435 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:12.867435 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:12.867435 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:12.867435 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:12.868587 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:12.868587 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:12.868587 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:24:12.868587 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:24:12.868587 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:24:12.868587 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:24:12.868587 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:24:12.868587 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:24:12.868587 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 12:24:12.868587 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:24:12.872760 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 617/1226] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:24:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:12.873772 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e7687-eeff-4c93-82cc-d29608915f94 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:12.926193 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:12.991336 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e7687-eeff-4c93-82cc-d29608915f94 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:13.027627 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef41f825-27c1-4c8f-a7ee-be6d4581e2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:13.028298 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41f825-27c1-4c8f-a7ee-be6d4581e2c9 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:13.028580 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41f825-27c1-4c8f-a7ee-be6d4581e2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:13.028884 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41f825-27c1-4c8f-a7ee-be6d4581e2c9 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:13.029722 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef41f825-27c1-4c8f-a7ee-be6d4581e2c9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:13.030034 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef41f825-27c1-4c8f-a7ee-be6d4581e2c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:13.031595 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef41f825-27c1-4c8f-a7ee-be6d4581e2c9 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:13.049136 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 610/1227] 10.222.0.16 () {56 vars in 1143 bytes} [Thu May 26 12:24:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:13.055239 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a59df6d-cde9-4f00-b4bf-8d48536429d6 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:13.173871 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a59df6d-cde9-4f00-b4bf-8d48536429d6 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:13.208467 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf78df-ae8d-4869-874c-9ff6cf92d343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:13.209359 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf78df-ae8d-4869-874c-9ff6cf92d343 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:13.209714 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf78df-ae8d-4869-874c-9ff6cf92d343 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:13.209954 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf78df-ae8d-4869-874c-9ff6cf92d343 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:13.223493 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf78df-ae8d-4869-874c-9ff6cf92d343 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:13.224945 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf78df-ae8d-4869-874c-9ff6cf92d343 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:13.242756 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-abdf78df-ae8d-4869-874c-9ff6cf92d343 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:13.242756 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:13.242756 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:13.242756 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:13.242756 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:13.242756 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:13.242756 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:13.242756 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:13.242756 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:13.242756 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:13.242756 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:13.242756 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:13.242756 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:13.242756 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:13.242756 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:13.243853 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:13.243853 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:13.243853 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:13.243853 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:13.243853 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:13.243853 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:13.243853 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:13.243853 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:13.243853 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:24:13.243853 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:13.243853 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:13.243853 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:13.243853 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:13.243853 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:13.243853 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:13.243853 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:13.243853 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:13.244784 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:13.244784 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:13.244784 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:13.244784 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:24:13.244784 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 618/1228] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:24:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:13.250345 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef41f825-27c1-4c8f-a7ee-be6d4581e2c9 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:13.364543 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef41f825-27c1-4c8f-a7ee-be6d4581e2c9 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:13.367063 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:13.403133 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef80614-f4d0-457b-aa87-0015f64351bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:13.403800 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef80614-f4d0-457b-aa87-0015f64351bb None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:13.404111 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef80614-f4d0-457b-aa87-0015f64351bb None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:13.404370 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef80614-f4d0-457b-aa87-0015f64351bb None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:13.405133 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef80614-f4d0-457b-aa87-0015f64351bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:13.405442 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef80614-f4d0-457b-aa87-0015f64351bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:13.406829 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef80614-f4d0-457b-aa87-0015f64351bb None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:13.418804 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 611/1229] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:24:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:13.424998 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf78df-ae8d-4869-874c-9ff6cf92d343 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:13.434250 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:13.533205 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf78df-ae8d-4869-874c-9ff6cf92d343 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:13.571063 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba54fb8-4150-4e69-a7ae-ed988bac9ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:13.571851 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba54fb8-4150-4e69-a7ae-ed988bac9ad1 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:13.572130 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba54fb8-4150-4e69-a7ae-ed988bac9ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:13.572401 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba54fb8-4150-4e69-a7ae-ed988bac9ad1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:13.579533 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba54fb8-4150-4e69-a7ae-ed988bac9ad1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:13.581028 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba54fb8-4150-4e69-a7ae-ed988bac9ad1 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:13.597629 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-cba54fb8-4150-4e69-a7ae-ed988bac9ad1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:13.597629 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:13.597629 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:13.597629 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:13.597629 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:13.597629 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:13.597629 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:13.597629 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:13.597629 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:13.597629 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:13.597629 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:13.597629 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:13.597629 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:24:13.597629 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:24:13.597629 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:24:13.598829 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:24:13.598829 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:13.598829 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:13.598829 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:13.598829 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:13.598829 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:13.598829 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:13.598829 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:13.598829 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:24:13.598829 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:13.598829 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:13.598829 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:13.598829 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:13.598829 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:13.598829 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:13.598829 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:13.598829 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:13.599748 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:24:13.599748 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:24:13.599748 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:24:13.599748 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:24:13.599748 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:24:13.599748 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:24:13.599748 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:13.599748 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:24:13.599748 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 619/1230] 10.222.0.16 () {56 vars in 1111 bytes} [Thu May 26 12:24:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:13.605293 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef80614-f4d0-457b-aa87-0015f64351bb None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:13.712965 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef80614-f4d0-457b-aa87-0015f64351bb None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:13.749569 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a18553-386d-4614-a00d-c2919fad3585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:13.750458 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a18553-386d-4614-a00d-c2919fad3585 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:13.750581 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a18553-386d-4614-a00d-c2919fad3585 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:13.750769 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a18553-386d-4614-a00d-c2919fad3585 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:13.751565 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a18553-386d-4614-a00d-c2919fad3585 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:13.751871 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a18553-386d-4614-a00d-c2919fad3585 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:13.753907 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a18553-386d-4614-a00d-c2919fad3585 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:13.768754 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 612/1231] 10.222.0.16 () {56 vars in 1148 bytes} [Thu May 26 12:24:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:13.772449 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba54fb8-4150-4e69-a7ae-ed988bac9ad1 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:13.841248 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:13.879617 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba54fb8-4150-4e69-a7ae-ed988bac9ad1 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:13.914451 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10abfc1-2143-4ffa-a783-e6599e71734a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:13.915339 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10abfc1-2143-4ffa-a783-e6599e71734a None admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:13.915625 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10abfc1-2143-4ffa-a783-e6599e71734a None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:13.915901 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10abfc1-2143-4ffa-a783-e6599e71734a None admin] PATH_INFO: `/v3/projects/42e6c693bd224d92b8a0fe4ad0cc586d/users/4327435c97834afeb7e6806ef02349a2/roles/2991da7c6ccc478bbfdc0ce47a959495` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:13.930748 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10abfc1-2143-4ffa-a783-e6599e71734a None admin] RBAC: Authorizing `identity:create_grant(project_id=42e6c693bd224d92b8a0fe4ad0cc586d, user_id=4327435c97834afeb7e6806ef02349a2, role_id=2991da7c6ccc478bbfdc0ce47a959495)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:13.932219 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10abfc1-2143-4ffa-a783-e6599e71734a None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:13.944565 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 620/1232] 10.222.0.16 () {58 vars in 1439 bytes} [Thu May 26 12:24:13 2022] PUT /identity/v3/projects/42e6c693bd224d92b8a0fe4ad0cc586d/users/4327435c97834afeb7e6806ef02349a2/roles/2991da7c6ccc478bbfdc0ce47a959495 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:24:16.244647 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e38f15-269f-486e-bab8-cdca7108f4de None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:16.245213 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e38f15-269f-486e-bab8-cdca7108f4de None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:16.245213 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e38f15-269f-486e-bab8-cdca7108f4de None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:16.246576 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 613/1233] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:24:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:16.251867 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49cecb-96ad-4804-8f91-1bf12e264ed8 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:16.252294 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49cecb-96ad-4804-8f91-1bf12e264ed8 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:16.252394 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49cecb-96ad-4804-8f91-1bf12e264ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:16.269114 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-9d49cecb-96ad-4804-8f91-1bf12e264ed8 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:16.270265 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-9d49cecb-96ad-4804-8f91-1bf12e264ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:16.348959 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 621/1234] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:24:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:24:16.373204 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e38f15-269f-486e-bab8-cdca7108f4de None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:16.404269 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:16.488580 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e38f15-269f-486e-bab8-cdca7108f4de None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:16.528633 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a0445-31ab-49b4-b49e-3371486d9db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:16.529472 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a0445-31ab-49b4-b49e-3371486d9db2 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:16.529750 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a0445-31ab-49b4-b49e-3371486d9db2 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:16.529944 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a0445-31ab-49b4-b49e-3371486d9db2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:16.541536 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58a0445-31ab-49b4-b49e-3371486d9db2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:16.551040 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-b58a0445-31ab-49b4-b49e-3371486d9db2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:16.551040 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:16.551040 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:16.551040 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:16.551040 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:16.551040 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:16.551040 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:16.551040 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:16.551040 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:16.551040 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:16.551040 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:16.551040 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:16.551040 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:16.551040 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:16.551040 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:16.551040 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:16.552149 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:16.552149 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:16.552149 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:16.552149 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:16.552149 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:16.552149 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:16.552149 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:16.552149 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:16.552149 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:16.552149 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:16.552149 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:16.552149 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:24:16.552149 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:16.552149 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:16.552149 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:16.552149 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:16.557996 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:16.557996 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:16.557996 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:16.557996 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:16.557996 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:16.557996 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:16.557996 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:16.557996 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:16.557996 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:16.557996 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:16.557996 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:16.557996 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:24:16.557996 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 614/1235] 10.222.0.16 () {56 vars in 1102 bytes} [Thu May 26 12:24:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:16.558722 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d49cecb-96ad-4804-8f91-1bf12e264ed8 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:16.608819 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:16.665795 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d49cecb-96ad-4804-8f91-1bf12e264ed8 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:16.702198 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c40755-97f1-4d84-82fd-cc6769cfea99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:16.702906 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c40755-97f1-4d84-82fd-cc6769cfea99 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:16.703191 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c40755-97f1-4d84-82fd-cc6769cfea99 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:16.703469 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c40755-97f1-4d84-82fd-cc6769cfea99 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:16.704219 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c40755-97f1-4d84-82fd-cc6769cfea99 None admin] RBAC: Adding query filter params (name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:16.704526 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c40755-97f1-4d84-82fd-cc6769cfea99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:16.705950 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c40755-97f1-4d84-82fd-cc6769cfea99 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:16.717156 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 622/1236] 10.222.0.16 () {56 vars in 1103 bytes} [Thu May 26 12:24:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:16.722921 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a0445-31ab-49b4-b49e-3371486d9db2 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:16.816562 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:16.833298 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a0445-31ab-49b4-b49e-3371486d9db2 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:16.872604 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a217accf-17df-47f1-9c3a-5cdb3af0f040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:16.873432 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217accf-17df-47f1-9c3a-5cdb3af0f040 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:16.873786 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217accf-17df-47f1-9c3a-5cdb3af0f040 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:16.873999 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217accf-17df-47f1-9c3a-5cdb3af0f040 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:16.884732 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a217accf-17df-47f1-9c3a-5cdb3af0f040 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:16.886208 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a217accf-17df-47f1-9c3a-5cdb3af0f040 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:16.903850 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-a217accf-17df-47f1-9c3a-5cdb3af0f040 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:16.903850 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:16.903850 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:16.903850 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:16.903850 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:16.903850 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:16.903850 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:16.903850 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:16.903850 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:16.903850 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:16.903850 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:16.903850 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:16.903850 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:16.903850 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:16.903850 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:16.904824 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:16.904824 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:16.904824 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:16.904824 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:16.904824 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:16.904824 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:16.904824 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:16.904824 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:16.904824 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:24:16.904824 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:16.904824 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:16.904824 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:16.904824 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:16.904824 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:16.904824 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:16.904824 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:16.904824 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:16.905761 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:16.905761 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:16.905761 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:16.905761 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:24:16.905761 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 615/1237] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:24:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:16.911380 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c40755-97f1-4d84-82fd-cc6769cfea99 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:17.015726 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c40755-97f1-4d84-82fd-cc6769cfea99 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:17.029213 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:17.060111 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef8b62-1e4d-4bec-a5aa-8db71aa5860a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:17.060768 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef8b62-1e4d-4bec-a5aa-8db71aa5860a None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:17.061070 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef8b62-1e4d-4bec-a5aa-8db71aa5860a None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:17.061343 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef8b62-1e4d-4bec-a5aa-8db71aa5860a None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:17.062060 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef8b62-1e4d-4bec-a5aa-8db71aa5860a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:17.062361 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef8b62-1e4d-4bec-a5aa-8db71aa5860a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:17.063716 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef8b62-1e4d-4bec-a5aa-8db71aa5860a None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:17.077219 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 623/1238] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:24:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:17.084334 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a217accf-17df-47f1-9c3a-5cdb3af0f040 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:17.189198 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a217accf-17df-47f1-9c3a-5cdb3af0f040 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:17.225756 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b61e717-2e94-493e-b9f9-a522dab0eef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:17.226595 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61e717-2e94-493e-b9f9-a522dab0eef2 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:17.227094 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61e717-2e94-493e-b9f9-a522dab0eef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:17.227366 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61e717-2e94-493e-b9f9-a522dab0eef2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:17.230062 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:17.235866 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b61e717-2e94-493e-b9f9-a522dab0eef2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:17.237356 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b61e717-2e94-493e-b9f9-a522dab0eef2 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:17.251398 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-9b61e717-2e94-493e-b9f9-a522dab0eef2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 12:24:17.251398 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:17.251398 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:17.251398 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:17.251398 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:17.251398 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:17.251398 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:17.251398 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:17.251398 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:17.251398 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:17.251398 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:17.251398 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:17.251398 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:24:17.251398 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:24:17.251398 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:24:17.251398 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:24:17.252806 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:17.252806 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:17.252806 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:24:17.252806 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:17.252806 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:24:17.252806 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:17.252806 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:17.252806 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:17.252806 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:17.252806 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:17.252806 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:17.252806 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:24:17.252806 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:17.252806 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:17.252806 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:17.252806 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:17.252806 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:17.252806 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:17.254384 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:17.254384 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:17.254384 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:24:17.254384 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:24:17.254384 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:24:17.254384 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:24:17.254384 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:24:17.254384 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:24:17.254384 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 12:24:17.254384 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:24:17.254384 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 616/1239] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:24:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:17.259506 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef8b62-1e4d-4bec-a5aa-8db71aa5860a None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:17.370833 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef8b62-1e4d-4bec-a5aa-8db71aa5860a None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:17.409892 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc109c61-39a1-4c06-a839-c279db296f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:17.410581 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc109c61-39a1-4c06-a839-c279db296f3c None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:17.410861 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc109c61-39a1-4c06-a839-c279db296f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:17.411130 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc109c61-39a1-4c06-a839-c279db296f3c None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:17.411960 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc109c61-39a1-4c06-a839-c279db296f3c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:17.412267 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc109c61-39a1-4c06-a839-c279db296f3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:17.413720 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc109c61-39a1-4c06-a839-c279db296f3c None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:17.436307 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 624/1240] 10.222.0.16 () {56 vars in 1143 bytes} [Thu May 26 12:24:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:17.442839 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b61e717-2e94-493e-b9f9-a522dab0eef2 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:17.573731 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b61e717-2e94-493e-b9f9-a522dab0eef2 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:17.612198 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4424a-aa23-4d74-92e6-dc4aa8ca3f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:17.613463 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4424a-aa23-4d74-92e6-dc4aa8ca3f22 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:17.613757 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4424a-aa23-4d74-92e6-dc4aa8ca3f22 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:17.614033 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4424a-aa23-4d74-92e6-dc4aa8ca3f22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:17.679888 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:17.686723 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac4424a-aa23-4d74-92e6-dc4aa8ca3f22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:17.688172 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac4424a-aa23-4d74-92e6-dc4aa8ca3f22 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:17.804801 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 617/1241] 10.222.0.16 () {58 vars in 1282 bytes} [Thu May 26 12:24:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:24:17.806549 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc109c61-39a1-4c06-a839-c279db296f3c None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:17.841136 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:17.922908 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc109c61-39a1-4c06-a839-c279db296f3c None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:17.966105 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202eef52-2650-4040-a19c-fc929b693829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:17.967682 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202eef52-2650-4040-a19c-fc929b693829 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:17.967965 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202eef52-2650-4040-a19c-fc929b693829 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:17.968425 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202eef52-2650-4040-a19c-fc929b693829 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:17.981003 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202eef52-2650-4040-a19c-fc929b693829 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:17.983107 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202eef52-2650-4040-a19c-fc929b693829 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:18.002341 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-202eef52-2650-4040-a19c-fc929b693829 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:18.002341 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:18.002341 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:18.002341 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:18.002341 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:18.002341 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:18.002341 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:18.002341 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:18.002341 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:18.002341 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:18.002341 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:18.002341 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:18.002341 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:18.002341 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:18.002341 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:18.003391 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:18.003391 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:18.003391 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:18.003391 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:18.003391 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:18.003391 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:18.003391 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:18.003391 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:18.003391 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:24:18.003391 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:18.003391 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:18.003391 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:18.003391 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:18.003391 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:18.003391 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:18.003391 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:18.003391 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:18.004369 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:18.004369 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:18.004369 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:18.004369 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:24:18.008413 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 625/1242] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:24:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:18.009774 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4424a-aa23-4d74-92e6-dc4aa8ca3f22 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:18.115791 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:18.122488 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4424a-aa23-4d74-92e6-dc4aa8ca3f22 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:18.157968 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07bcef8-7520-42e5-aba1-05a6b0b3918f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:18.158627 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07bcef8-7520-42e5-aba1-05a6b0b3918f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:18.158986 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07bcef8-7520-42e5-aba1-05a6b0b3918f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:18.159237 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07bcef8-7520-42e5-aba1-05a6b0b3918f None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:18.160564 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07bcef8-7520-42e5-aba1-05a6b0b3918f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:18.160897 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07bcef8-7520-42e5-aba1-05a6b0b3918f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:18.162403 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07bcef8-7520-42e5-aba1-05a6b0b3918f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:18.176515 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 618/1243] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:24:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:18.183479 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202eef52-2650-4040-a19c-fc929b693829 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:18.278619 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:18.303623 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202eef52-2650-4040-a19c-fc929b693829 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:18.342107 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c395f-1707-4d37-9c63-a5376d63f51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:18.342964 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c395f-1707-4d37-9c63-a5376d63f51c None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:18.343243 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c395f-1707-4d37-9c63-a5376d63f51c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:18.343553 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c395f-1707-4d37-9c63-a5376d63f51c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:18.351034 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96c395f-1707-4d37-9c63-a5376d63f51c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:18.352886 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96c395f-1707-4d37-9c63-a5376d63f51c None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:18.366959 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-e96c395f-1707-4d37-9c63-a5376d63f51c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:18.366959 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:18.366959 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:18.366959 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:18.366959 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:18.366959 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:18.366959 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:18.366959 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:18.366959 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:18.366959 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:18.366959 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:18.366959 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:18.366959 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:24:18.366959 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:24:18.366959 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:24:18.367905 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:24:18.367905 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:18.367905 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:18.367905 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:18.367905 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:18.367905 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:18.367905 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:18.367905 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:18.367905 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:24:18.367905 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:18.367905 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:18.367905 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:18.367905 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:18.367905 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:18.367905 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:18.367905 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:18.367905 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:18.368861 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:24:18.368861 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:24:18.368861 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:24:18.368861 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:24:18.368861 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:24:18.368861 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:24:18.368861 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:18.368861 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:24:18.368861 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 626/1244] 10.222.0.16 () {56 vars in 1111 bytes} [Thu May 26 12:24:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:18.374272 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07bcef8-7520-42e5-aba1-05a6b0b3918f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:18.482089 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07bcef8-7520-42e5-aba1-05a6b0b3918f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:18.523565 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54608d96-8a87-4640-8a20-3de4c84f12e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:18.524239 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54608d96-8a87-4640-8a20-3de4c84f12e3 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:18.524625 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54608d96-8a87-4640-8a20-3de4c84f12e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:18.524893 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54608d96-8a87-4640-8a20-3de4c84f12e3 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:18.525746 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54608d96-8a87-4640-8a20-3de4c84f12e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:18.526100 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54608d96-8a87-4640-8a20-3de4c84f12e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:18.527699 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54608d96-8a87-4640-8a20-3de4c84f12e3 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:18.542905 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 619/1245] 10.222.0.16 () {56 vars in 1148 bytes} [Thu May 26 12:24:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:18.549820 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c395f-1707-4d37-9c63-a5376d63f51c None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:18.661061 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c395f-1707-4d37-9c63-a5376d63f51c None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:18.696585 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d99343-2314-4ff5-ba52-01dddfff8df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:18.697417 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d99343-2314-4ff5-ba52-01dddfff8df7 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:18.697733 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d99343-2314-4ff5-ba52-01dddfff8df7 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:18.698074 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d99343-2314-4ff5-ba52-01dddfff8df7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:18.699044 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d99343-2314-4ff5-ba52-01dddfff8df7 None admin] RBAC: Adding query filter params (role.id=2991da7c6ccc478bbfdc0ce47a959495, scope.project.id=42e6c693bd224d92b8a0fe4ad0cc586d, user.id=4327435c97834afeb7e6806ef02349a2) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:18.699424 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d99343-2314-4ff5-ba52-01dddfff8df7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:18.701175 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d99343-2314-4ff5-ba52-01dddfff8df7 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:18.707739 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 627/1246] 10.222.0.16 () {56 vars in 1374 bytes} [Thu May 26 12:24:18 2022] GET /identity/v3/role_assignments?user.id=4327435c97834afeb7e6806ef02349a2&scope.project.id=42e6c693bd224d92b8a0fe4ad0cc586d&role.id=2991da7c6ccc478bbfdc0ce47a959495 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:21.151817 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0fddf-472a-49b7-bbcf-426bd85f8aec None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:21.152397 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0fddf-472a-49b7-bbcf-426bd85f8aec None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:21.152397 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0fddf-472a-49b7-bbcf-426bd85f8aec None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:21.153962 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 620/1247] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:24:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:21.159657 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0880d6-b930-4a30-9af2-5a3a09a29c4f None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:21.160326 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0880d6-b930-4a30-9af2-5a3a09a29c4f None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:21.160606 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0880d6-b930-4a30-9af2-5a3a09a29c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:21.165761 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:21.179394 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-0f0880d6-b930-4a30-9af2-5a3a09a29c4f None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:21.180643 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-0f0880d6-b930-4a30-9af2-5a3a09a29c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:21.252954 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 628/1248] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:24:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:24:21.278112 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f0fddf-472a-49b7-bbcf-426bd85f8aec None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:21.297906 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:21.386762 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f0fddf-472a-49b7-bbcf-426bd85f8aec None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:21.425946 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97924304-9efb-4f60-a449-78720767ebc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:21.426734 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97924304-9efb-4f60-a449-78720767ebc6 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:21.427025 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97924304-9efb-4f60-a449-78720767ebc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:21.427301 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97924304-9efb-4f60-a449-78720767ebc6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:21.438677 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97924304-9efb-4f60-a449-78720767ebc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:21.446312 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-97924304-9efb-4f60-a449-78720767ebc6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:24:21.446312 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:21.446312 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:21.446312 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:21.446312 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:21.446312 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:21.446312 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:21.446312 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:21.446312 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:21.446312 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:21.446312 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:21.446312 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:21.446312 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:21.446312 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:21.446312 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:21.446312 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:21.447471 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:21.447471 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:21.447471 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:21.447471 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:21.447471 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:21.447471 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:21.447471 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:21.447471 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:21.447471 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:21.447471 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:21.447471 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:21.447471 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:24:21.447471 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:21.447471 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:21.447471 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:21.447471 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:21.448332 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:21.448332 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:21.448332 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:21.448332 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:21.448332 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:21.448332 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:21.448332 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:21.448332 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:21.448332 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:21.448332 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:21.448332 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:24:21.448332 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:24:21.448332 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 621/1249] 10.222.0.16 () {56 vars in 1096 bytes} [Thu May 26 12:24:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:21.453856 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0880d6-b930-4a30-9af2-5a3a09a29c4f None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:21.564573 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0880d6-b930-4a30-9af2-5a3a09a29c4f None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:21.596464 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:21.601860 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42cd1e4-6190-4e5b-9045-b97ee0741111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:21.602793 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42cd1e4-6190-4e5b-9045-b97ee0741111 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:21.603071 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42cd1e4-6190-4e5b-9045-b97ee0741111 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:21.603362 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42cd1e4-6190-4e5b-9045-b97ee0741111 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:21.604118 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42cd1e4-6190-4e5b-9045-b97ee0741111 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:21.604422 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42cd1e4-6190-4e5b-9045-b97ee0741111 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:21.605827 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42cd1e4-6190-4e5b-9045-b97ee0741111 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:21.614710 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 629/1250] 10.222.0.16 () {56 vars in 1099 bytes} [Thu May 26 12:24:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:21.620452 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97924304-9efb-4f60-a449-78720767ebc6 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:21.700867 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:21.726056 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97924304-9efb-4f60-a449-78720767ebc6 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:21.763572 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ada1f8-6d48-416e-8d26-05711d483971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:21.764382 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ada1f8-6d48-416e-8d26-05711d483971 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:21.764667 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ada1f8-6d48-416e-8d26-05711d483971 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:21.764984 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ada1f8-6d48-416e-8d26-05711d483971 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:21.777323 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ada1f8-6d48-416e-8d26-05711d483971 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:21.778822 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ada1f8-6d48-416e-8d26-05711d483971 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:21.797249 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-d7ada1f8-6d48-416e-8d26-05711d483971 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:21.797249 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:21.797249 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:21.797249 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:21.797249 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:21.797249 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:21.797249 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:21.797249 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:21.797249 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:21.797249 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:21.797249 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:21.797249 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:21.797249 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:21.797249 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:21.797249 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:21.798247 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:21.798247 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:21.798247 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:21.798247 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:21.798247 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:21.798247 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:21.798247 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:21.798247 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:21.798247 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:24:21.798247 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:21.798247 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:21.798247 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:21.798247 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:21.798247 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:21.798247 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:21.798247 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:21.798247 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:21.799153 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:21.799153 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:21.799153 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:21.799153 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:24:21.799153 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 622/1251] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:24:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:21.804455 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42cd1e4-6190-4e5b-9045-b97ee0741111 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:21.908778 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42cd1e4-6190-4e5b-9045-b97ee0741111 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:21.946249 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc094493-d343-4470-9885-c36b46f00974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:21.946912 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc094493-d343-4470-9885-c36b46f00974 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:21.947197 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc094493-d343-4470-9885-c36b46f00974 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:21.947478 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc094493-d343-4470-9885-c36b46f00974 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:21.948195 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc094493-d343-4470-9885-c36b46f00974 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:21.948501 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc094493-d343-4470-9885-c36b46f00974 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:21.949902 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc094493-d343-4470-9885-c36b46f00974 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:21.962478 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 630/1252] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:24:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:21.967901 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ada1f8-6d48-416e-8d26-05711d483971 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:22.068436 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ada1f8-6d48-416e-8d26-05711d483971 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:22.095260 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:22.106870 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caedf76c-22fd-4d5f-8caf-160f89b440f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:22.107673 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caedf76c-22fd-4d5f-8caf-160f89b440f9 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:22.107957 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caedf76c-22fd-4d5f-8caf-160f89b440f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:22.108237 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caedf76c-22fd-4d5f-8caf-160f89b440f9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:22.116493 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caedf76c-22fd-4d5f-8caf-160f89b440f9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:22.117992 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caedf76c-22fd-4d5f-8caf-160f89b440f9 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:22.132977 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-caedf76c-22fd-4d5f-8caf-160f89b440f9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 12:24:22.132977 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:22.132977 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:22.132977 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:22.132977 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:22.132977 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:22.132977 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:22.132977 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:22.132977 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:22.132977 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:22.132977 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:22.132977 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:22.132977 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:24:22.132977 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:24:22.132977 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:24:22.132977 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:24:22.134038 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:22.134038 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:22.134038 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:24:22.134038 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:22.134038 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:24:22.134038 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:22.134038 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:22.134038 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:22.134038 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:22.134038 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:22.134038 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:22.134038 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:24:22.134038 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:22.134038 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:22.134038 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:22.134038 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:22.134038 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:22.134038 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:22.135045 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:22.135045 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:22.135045 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:24:22.135045 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:24:22.135045 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:24:22.135045 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:24:22.135045 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:24:22.135045 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:24:22.135045 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 12:24:22.135045 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:24:22.135045 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 623/1253] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:24:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:22.140000 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc094493-d343-4470-9885-c36b46f00974 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:22.197268 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:22.240422 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc094493-d343-4470-9885-c36b46f00974 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:22.272977 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d22a75-0155-4bca-ba78-0bc7e0f43d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:22.273636 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d22a75-0155-4bca-ba78-0bc7e0f43d3d None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:22.273916 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d22a75-0155-4bca-ba78-0bc7e0f43d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:22.274187 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d22a75-0155-4bca-ba78-0bc7e0f43d3d None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:22.275016 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d22a75-0155-4bca-ba78-0bc7e0f43d3d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:22.275324 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d22a75-0155-4bca-ba78-0bc7e0f43d3d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:22.276759 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d22a75-0155-4bca-ba78-0bc7e0f43d3d None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:22.293825 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 631/1254] 10.222.0.16 () {56 vars in 1143 bytes} [Thu May 26 12:24:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:22.299621 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caedf76c-22fd-4d5f-8caf-160f89b440f9 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:22.395895 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caedf76c-22fd-4d5f-8caf-160f89b440f9 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:22.428474 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227857cb-aa00-4eac-97b6-ec9baa431692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:22.429117 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227857cb-aa00-4eac-97b6-ec9baa431692 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:22.429399 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227857cb-aa00-4eac-97b6-ec9baa431692 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:22.429671 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227857cb-aa00-4eac-97b6-ec9baa431692 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:22.481346 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:22.494364 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227857cb-aa00-4eac-97b6-ec9baa431692 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:22.495856 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227857cb-aa00-4eac-97b6-ec9baa431692 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:22.595506 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 624/1255] 10.222.0.16 () {58 vars in 1282 bytes} [Thu May 26 12:24:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:24:22.601915 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d22a75-0155-4bca-ba78-0bc7e0f43d3d None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:22.698455 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d22a75-0155-4bca-ba78-0bc7e0f43d3d None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:22.711503 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:22.733658 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31055d58-6d35-4aa8-b4f6-1fabcd9003d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:22.734441 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31055d58-6d35-4aa8-b4f6-1fabcd9003d2 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:22.734721 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31055d58-6d35-4aa8-b4f6-1fabcd9003d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:22.734992 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31055d58-6d35-4aa8-b4f6-1fabcd9003d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:22.744800 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31055d58-6d35-4aa8-b4f6-1fabcd9003d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:22.746244 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31055d58-6d35-4aa8-b4f6-1fabcd9003d2 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:22.763411 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-31055d58-6d35-4aa8-b4f6-1fabcd9003d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:22.763411 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:22.763411 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:22.763411 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:22.763411 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:22.763411 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:22.763411 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:22.763411 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:22.763411 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:22.763411 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:22.763411 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:22.763411 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:22.763411 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:22.763411 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:22.763411 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:22.764478 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:22.764478 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:22.764478 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:22.764478 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:22.764478 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:22.764478 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:22.764478 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:22.764478 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:22.764478 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:24:22.764478 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:22.764478 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:22.764478 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:22.764478 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:22.764478 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:22.764478 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:22.764478 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:22.764478 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:22.765628 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:22.765628 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:22.765628 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:22.765628 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:24:22.765628 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 632/1256] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:24:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:22.770702 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227857cb-aa00-4eac-97b6-ec9baa431692 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:22.854657 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:22.867136 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227857cb-aa00-4eac-97b6-ec9baa431692 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:22.900066 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8198b5d0-d008-48e0-9397-7003dd796f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:22.900711 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8198b5d0-d008-48e0-9397-7003dd796f3c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:22.901023 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8198b5d0-d008-48e0-9397-7003dd796f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:22.901300 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8198b5d0-d008-48e0-9397-7003dd796f3c None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:22.902013 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8198b5d0-d008-48e0-9397-7003dd796f3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:22.902314 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8198b5d0-d008-48e0-9397-7003dd796f3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:22.903682 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8198b5d0-d008-48e0-9397-7003dd796f3c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:22.915037 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 625/1257] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:24:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:22.920608 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31055d58-6d35-4aa8-b4f6-1fabcd9003d2 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:23.015317 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31055d58-6d35-4aa8-b4f6-1fabcd9003d2 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:23.048216 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54874f-f03b-46b9-a22e-97542fcf0531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:23.049004 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54874f-f03b-46b9-a22e-97542fcf0531 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:23.049284 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54874f-f03b-46b9-a22e-97542fcf0531 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:23.049556 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54874f-f03b-46b9-a22e-97542fcf0531 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:23.056008 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a54874f-f03b-46b9-a22e-97542fcf0531 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:23.057456 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a54874f-f03b-46b9-a22e-97542fcf0531 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:23.071263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-3a54874f-f03b-46b9-a22e-97542fcf0531 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:23.071263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:23.071263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:23.071263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:23.071263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:23.071263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:23.071263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:23.071263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:23.071263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:23.071263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:23.071263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:23.071263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:23.071263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:24:23.071263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:24:23.071263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:24:23.072298 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:24:23.072298 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:23.072298 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:23.072298 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:23.072298 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:23.072298 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:23.072298 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:23.072298 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:23.072298 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:24:23.072298 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:23.072298 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:23.072298 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:23.072298 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:23.072298 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:23.072298 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:23.072298 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:23.072298 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:23.077853 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:24:23.077853 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:24:23.077853 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:24:23.077853 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:24:23.077853 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:24:23.077853 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:24:23.077853 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:23.077853 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:24:23.077853 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 633/1258] 10.222.0.16 () {56 vars in 1111 bytes} [Thu May 26 12:24:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:23.078460 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8198b5d0-d008-48e0-9397-7003dd796f3c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:23.173883 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8198b5d0-d008-48e0-9397-7003dd796f3c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:23.205787 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b4543-b6fd-4d10-b97f-78f8d12a84ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:23.206427 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b4543-b6fd-4d10-b97f-78f8d12a84ac None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:23.207247 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b4543-b6fd-4d10-b97f-78f8d12a84ac None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:23.207522 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b4543-b6fd-4d10-b97f-78f8d12a84ac None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:23.208298 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b4543-b6fd-4d10-b97f-78f8d12a84ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:23.208604 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b4543-b6fd-4d10-b97f-78f8d12a84ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:23.210061 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b4543-b6fd-4d10-b97f-78f8d12a84ac None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:23.221421 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 626/1259] 10.222.0.16 () {56 vars in 1148 bytes} [Thu May 26 12:24:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:23.227462 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54874f-f03b-46b9-a22e-97542fcf0531 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:23.252008 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:23.323558 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54874f-f03b-46b9-a22e-97542fcf0531 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:23.355531 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f515d052-ef51-4451-9968-76188e95bb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:23.356155 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f515d052-ef51-4451-9968-76188e95bb00 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:23.356433 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f515d052-ef51-4451-9968-76188e95bb00 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:23.356710 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f515d052-ef51-4451-9968-76188e95bb00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:23.357553 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f515d052-ef51-4451-9968-76188e95bb00 None admin] RBAC: Adding query filter params (role.id=1a8e523ecbc84d818c2a9af0fb54da74, scope.project.id=42e6c693bd224d92b8a0fe4ad0cc586d, user.id=4327435c97834afeb7e6806ef02349a2) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:23.357861 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f515d052-ef51-4451-9968-76188e95bb00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:23.359264 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f515d052-ef51-4451-9968-76188e95bb00 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:23.364489 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 634/1260] 10.222.0.16 () {56 vars in 1374 bytes} [Thu May 26 12:24:23 2022] GET /identity/v3/role_assignments?user.id=4327435c97834afeb7e6806ef02349a2&scope.project.id=42e6c693bd224d92b8a0fe4ad0cc586d&role.id=1a8e523ecbc84d818c2a9af0fb54da74 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:25.501303 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc26db0-93e3-4306-a94c-1c26909fc46b None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:25.501834 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc26db0-93e3-4306-a94c-1c26909fc46b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:25.501995 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc26db0-93e3-4306-a94c-1c26909fc46b None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:25.504255 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 627/1261] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:24:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:25.510465 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22007aac-3d0c-4a3d-b8c0-085f068d7148 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:25.510888 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22007aac-3d0c-4a3d-b8c0-085f068d7148 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:25.511023 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22007aac-3d0c-4a3d-b8c0-085f068d7148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:25.534834 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-22007aac-3d0c-4a3d-b8c0-085f068d7148 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:25.536702 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-22007aac-3d0c-4a3d-b8c0-085f068d7148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:25.617472 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 635/1262] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:24:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:24:25.640480 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc26db0-93e3-4306-a94c-1c26909fc46b None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:25.651771 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:25.740730 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc26db0-93e3-4306-a94c-1c26909fc46b None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:25.774776 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833044e0-9f64-423f-8ad9-4a48e3349c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:25.775493 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833044e0-9f64-423f-8ad9-4a48e3349c46 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:25.775774 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833044e0-9f64-423f-8ad9-4a48e3349c46 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:25.776046 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833044e0-9f64-423f-8ad9-4a48e3349c46 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:25.785897 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833044e0-9f64-423f-8ad9-4a48e3349c46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:25.793578 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-833044e0-9f64-423f-8ad9-4a48e3349c46 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:24:25.793578 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:25.793578 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:25.793578 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:25.793578 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:25.793578 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:25.793578 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:25.793578 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:25.793578 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:25.793578 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:25.793578 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:25.793578 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:25.793578 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:25.793578 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:25.793578 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:25.793578 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:25.794684 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:25.794684 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:25.794684 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:25.794684 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:25.794684 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:25.794684 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:25.794684 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:25.794684 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:25.794684 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:25.794684 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:25.794684 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:25.794684 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:24:25.794684 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:25.794684 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:25.794684 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:25.794684 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:25.795650 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:25.795650 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:25.795650 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:25.795650 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:25.795650 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:25.795650 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:25.795650 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:25.795650 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:25.795650 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:25.795650 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:25.795650 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:24:25.795650 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:24:25.795650 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 628/1263] 10.222.0.16 () {56 vars in 1096 bytes} [Thu May 26 12:24:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:25.801459 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22007aac-3d0c-4a3d-b8c0-085f068d7148 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:25.819901 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:25.898523 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22007aac-3d0c-4a3d-b8c0-085f068d7148 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:25.933168 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa12bf4-a1c5-4607-bbd2-eb8350bfa6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:25.933835 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa12bf4-a1c5-4607-bbd2-eb8350bfa6ae None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:25.934118 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa12bf4-a1c5-4607-bbd2-eb8350bfa6ae None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:25.934391 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa12bf4-a1c5-4607-bbd2-eb8350bfa6ae None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:25.935147 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa12bf4-a1c5-4607-bbd2-eb8350bfa6ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:25.935455 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa12bf4-a1c5-4607-bbd2-eb8350bfa6ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:25.936826 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa12bf4-a1c5-4607-bbd2-eb8350bfa6ae None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:25.945455 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 636/1264] 10.222.0.16 () {56 vars in 1099 bytes} [Thu May 26 12:24:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:25.951297 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833044e0-9f64-423f-8ad9-4a48e3349c46 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:26.019384 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:26.053629 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833044e0-9f64-423f-8ad9-4a48e3349c46 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:26.086641 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95dc1d3-e8f7-4370-a464-9775267f8112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:26.087421 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95dc1d3-e8f7-4370-a464-9775267f8112 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:26.087699 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95dc1d3-e8f7-4370-a464-9775267f8112 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:26.087970 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95dc1d3-e8f7-4370-a464-9775267f8112 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:26.099001 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95dc1d3-e8f7-4370-a464-9775267f8112 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:26.100463 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95dc1d3-e8f7-4370-a464-9775267f8112 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:26.118170 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-b95dc1d3-e8f7-4370-a464-9775267f8112 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:26.118170 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:26.118170 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:26.118170 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:26.118170 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:26.118170 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:26.118170 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:26.118170 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:26.118170 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:26.118170 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:26.118170 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:26.118170 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:26.118170 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:26.118170 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:26.118170 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:26.119129 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:26.119129 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:26.119129 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:26.119129 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:26.119129 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:26.119129 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:26.119129 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:26.119129 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:26.119129 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:24:26.119129 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:26.119129 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:26.119129 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:26.119129 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:26.119129 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:26.119129 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:26.119129 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:26.119129 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:26.120137 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:26.120137 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:26.120137 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:26.120137 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:24:26.120137 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 629/1265] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:24:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:26.125180 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa12bf4-a1c5-4607-bbd2-eb8350bfa6ae None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:26.207758 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:26.226934 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa12bf4-a1c5-4607-bbd2-eb8350bfa6ae None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:26.259819 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad4555-40cd-47f8-8cf6-35f525798b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:26.260466 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad4555-40cd-47f8-8cf6-35f525798b0f None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:26.260746 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad4555-40cd-47f8-8cf6-35f525798b0f None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:26.261048 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad4555-40cd-47f8-8cf6-35f525798b0f None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:26.261762 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ad4555-40cd-47f8-8cf6-35f525798b0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:26.262064 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ad4555-40cd-47f8-8cf6-35f525798b0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:26.263419 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ad4555-40cd-47f8-8cf6-35f525798b0f None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:26.274760 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 637/1266] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:24:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:26.280387 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95dc1d3-e8f7-4370-a464-9775267f8112 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:26.377722 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95dc1d3-e8f7-4370-a464-9775267f8112 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:26.396293 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:26.410582 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403aebb3-2c7b-4c6b-8c84-b1fc3c570aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:26.411363 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403aebb3-2c7b-4c6b-8c84-b1fc3c570aff None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:26.411645 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403aebb3-2c7b-4c6b-8c84-b1fc3c570aff None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:26.411916 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403aebb3-2c7b-4c6b-8c84-b1fc3c570aff None admin] PATH_INFO: `/v3/users/placement` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:26.419125 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403aebb3-2c7b-4c6b-8c84-b1fc3c570aff None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:26.420567 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403aebb3-2c7b-4c6b-8c84-b1fc3c570aff None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:26.435070 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-403aebb3-2c7b-4c6b-8c84-b1fc3c570aff None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 12:24:26.435070 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:26.435070 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:26.435070 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:26.435070 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:26.435070 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:26.435070 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:26.435070 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:26.435070 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:26.435070 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:26.435070 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:26.435070 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:26.435070 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:24:26.435070 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:24:26.435070 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:24:26.435070 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:24:26.436158 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:26.436158 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:26.436158 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:24:26.436158 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:26.436158 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:24:26.436158 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:26.436158 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:26.436158 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:26.436158 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:26.436158 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:26.436158 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:26.436158 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:24:26.436158 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:26.436158 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:26.436158 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:26.436158 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:26.436158 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:26.436158 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:26.437397 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:26.437397 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:26.437397 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:24:26.437397 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:24:26.437397 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:24:26.437397 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:24:26.437397 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:24:26.437397 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:24:26.437397 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 12:24:26.437397 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:24:26.437397 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 630/1267] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:24:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:26.441959 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad4555-40cd-47f8-8cf6-35f525798b0f None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:26.546247 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad4555-40cd-47f8-8cf6-35f525798b0f None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:26.578445 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24219dff-8f2a-4327-b86f-6840b392abce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:26.579101 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24219dff-8f2a-4327-b86f-6840b392abce None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:26.579386 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24219dff-8f2a-4327-b86f-6840b392abce None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:26.579663 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24219dff-8f2a-4327-b86f-6840b392abce None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:26.580491 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24219dff-8f2a-4327-b86f-6840b392abce None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:26.580800 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24219dff-8f2a-4327-b86f-6840b392abce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:26.582737 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24219dff-8f2a-4327-b86f-6840b392abce None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:26.591170 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:26.600174 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 638/1268] 10.222.0.16 () {56 vars in 1143 bytes} [Thu May 26 12:24:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:26.606194 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403aebb3-2c7b-4c6b-8c84-b1fc3c570aff None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:26.701088 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403aebb3-2c7b-4c6b-8c84-b1fc3c570aff None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:26.734280 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5793eca-c877-422e-8aa4-52a4a576f53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:26.735058 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5793eca-c877-422e-8aa4-52a4a576f53e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:26.735343 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5793eca-c877-422e-8aa4-52a4a576f53e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:26.735617 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5793eca-c877-422e-8aa4-52a4a576f53e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:26.745825 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5793eca-c877-422e-8aa4-52a4a576f53e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:26.747283 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5793eca-c877-422e-8aa4-52a4a576f53e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:26.764246 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-c5793eca-c877-422e-8aa4-52a4a576f53e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:26.764246 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:26.764246 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:26.764246 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:26.764246 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:26.764246 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:26.764246 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:26.764246 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:26.764246 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:26.764246 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:26.764246 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:26.764246 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:26.764246 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:26.764246 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:26.764246 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:26.765335 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:26.765335 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:26.765335 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:26.765335 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:26.765335 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:26.765335 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:26.765335 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:26.765335 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:26.765335 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:24:26.765335 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:26.765335 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:26.765335 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:26.765335 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:26.765335 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:26.765335 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:26.765335 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:26.765335 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:26.766425 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:26.766425 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:26.766425 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:26.766425 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:24:26.766425 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 631/1269] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:24:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:26.771721 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24219dff-8f2a-4327-b86f-6840b392abce None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:26.867595 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24219dff-8f2a-4327-b86f-6840b392abce None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:26.902365 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13acb9ae-9ef8-4326-9931-d5e753f7e464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:26.903019 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acb9ae-9ef8-4326-9931-d5e753f7e464 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:26.903301 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acb9ae-9ef8-4326-9931-d5e753f7e464 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:26.903577 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acb9ae-9ef8-4326-9931-d5e753f7e464 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:26.904292 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13acb9ae-9ef8-4326-9931-d5e753f7e464 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:26.904598 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13acb9ae-9ef8-4326-9931-d5e753f7e464 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:26.905994 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13acb9ae-9ef8-4326-9931-d5e753f7e464 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:26.916984 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 639/1270] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:24:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:26.922733 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5793eca-c877-422e-8aa4-52a4a576f53e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:26.953880 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:27.020882 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5793eca-c877-422e-8aa4-52a4a576f53e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:27.052495 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27658a17-8426-4de8-8ded-5caa5d424a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:27.053281 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27658a17-8426-4de8-8ded-5caa5d424a0e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:27.053664 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27658a17-8426-4de8-8ded-5caa5d424a0e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:27.053844 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27658a17-8426-4de8-8ded-5caa5d424a0e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:27.060335 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27658a17-8426-4de8-8ded-5caa5d424a0e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:27.061823 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27658a17-8426-4de8-8ded-5caa5d424a0e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:27.076218 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-27658a17-8426-4de8-8ded-5caa5d424a0e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:27.076218 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:27.076218 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:27.076218 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:27.076218 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:27.076218 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:27.076218 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:27.076218 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:27.076218 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:27.076218 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:27.076218 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:27.076218 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:27.076218 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:24:27.076218 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:24:27.076218 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:24:27.077280 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:24:27.077280 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:27.077280 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:27.077280 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:27.077280 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:27.077280 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:27.077280 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:27.077280 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:27.077280 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:24:27.077280 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:27.077280 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:27.077280 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:27.077280 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:27.077280 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:27.077280 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:27.077280 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:27.077280 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:27.078407 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:24:27.078407 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:24:27.078407 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:24:27.078407 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:24:27.078407 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:24:27.078407 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:24:27.078407 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:27.078407 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:24:27.078407 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 632/1271] 10.222.0.16 () {56 vars in 1111 bytes} [Thu May 26 12:24:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:27.083847 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13acb9ae-9ef8-4326-9931-d5e753f7e464 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:27.141117 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:27.181734 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13acb9ae-9ef8-4326-9931-d5e753f7e464 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:27.214073 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b6a4ba-c4a5-4e36-ba46-24c3f6a6605f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:27.214655 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6a4ba-c4a5-4e36-ba46-24c3f6a6605f None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:27.214940 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6a4ba-c4a5-4e36-ba46-24c3f6a6605f None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:27.215216 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6a4ba-c4a5-4e36-ba46-24c3f6a6605f None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:27.215997 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b6a4ba-c4a5-4e36-ba46-24c3f6a6605f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:27.216306 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b6a4ba-c4a5-4e36-ba46-24c3f6a6605f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:27.217749 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b6a4ba-c4a5-4e36-ba46-24c3f6a6605f None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:27.229616 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 640/1272] 10.222.0.16 () {56 vars in 1148 bytes} [Thu May 26 12:24:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:27.235378 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27658a17-8426-4de8-8ded-5caa5d424a0e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:27.324416 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:27.333732 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27658a17-8426-4de8-8ded-5caa5d424a0e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:27.366424 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5cc62a-d049-4382-9be9-a47cbbd7567b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:27.367302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5cc62a-d049-4382-9be9-a47cbbd7567b None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:27.367580 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5cc62a-d049-4382-9be9-a47cbbd7567b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:27.367857 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5cc62a-d049-4382-9be9-a47cbbd7567b None admin] PATH_INFO: `/v3/projects/42e6c693bd224d92b8a0fe4ad0cc586d/users/4327435c97834afeb7e6806ef02349a2/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:27.369798 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5cc62a-d049-4382-9be9-a47cbbd7567b None admin] RBAC: Authorizing `identity:create_grant(project_id=42e6c693bd224d92b8a0fe4ad0cc586d, user_id=4327435c97834afeb7e6806ef02349a2, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:27.371228 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5cc62a-d049-4382-9be9-a47cbbd7567b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:27.383593 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 633/1273] 10.222.0.16 () {58 vars in 1439 bytes} [Thu May 26 12:24:27 2022] PUT /identity/v3/projects/42e6c693bd224d92b8a0fe4ad0cc586d/users/4327435c97834afeb7e6806ef02349a2/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:24:29.536518 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e2b2b-38bf-4c27-b8ce-c920b20b76a9 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:29.537081 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e2b2b-38bf-4c27-b8ce-c920b20b76a9 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:29.537081 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e2b2b-38bf-4c27-b8ce-c920b20b76a9 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:29.538604 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 641/1274] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:24:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:24:29.544868 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd5f8c-9c68-4630-9670-f8bc689db770 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:29.545350 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd5f8c-9c68-4630-9670-f8bc689db770 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:29.545747 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd5f8c-9c68-4630-9670-f8bc689db770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:29.563059 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-91dd5f8c-9c68-4630-9670-f8bc689db770 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:29.564260 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-91dd5f8c-9c68-4630-9670-f8bc689db770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:29.628994 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 634/1275] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:24:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:24:29.652329 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0e2b2b-38bf-4c27-b8ce-c920b20b76a9 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:29.750234 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0e2b2b-38bf-4c27-b8ce-c920b20b76a9 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:29.768105 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:29.785921 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe24fd-d2e5-49fe-917b-91f07920ebe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:29.786753 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe24fd-d2e5-49fe-917b-91f07920ebe0 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:29.786984 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe24fd-d2e5-49fe-917b-91f07920ebe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:29.787257 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe24fd-d2e5-49fe-917b-91f07920ebe0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:29.797039 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe24fd-d2e5-49fe-917b-91f07920ebe0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:29.804565 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-60fe24fd-d2e5-49fe-917b-91f07920ebe0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:24:29.804565 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:29.804565 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:29.804565 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:29.804565 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:29.804565 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:29.804565 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:29.804565 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:29.804565 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:29.804565 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:29.804565 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:29.804565 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:29.804565 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:29.804565 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:29.804565 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:29.804565 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:29.805729 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:29.805729 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:29.805729 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:29.805729 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:29.805729 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:29.805729 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:29.805729 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:29.805729 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:29.805729 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:29.805729 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:29.805729 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:29.805729 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:24:29.805729 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:29.805729 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:29.805729 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:29.805729 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:29.806846 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:29.806846 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:29.806846 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:29.806846 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:29.806846 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:29.806846 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:29.806846 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:29.806846 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:29.806846 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:29.806846 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:29.806846 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:24:29.806846 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:24:29.806846 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 642/1276] 10.222.0.16 () {56 vars in 1096 bytes} [Thu May 26 12:24:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:29.811690 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd5f8c-9c68-4630-9670-f8bc689db770 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:29.889907 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:29.908287 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd5f8c-9c68-4630-9670-f8bc689db770 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:29.940912 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d11caf-7593-4f2e-9b94-8b3558885ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:29.942062 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d11caf-7593-4f2e-9b94-8b3558885ed3 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:29.942344 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d11caf-7593-4f2e-9b94-8b3558885ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:29.942615 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d11caf-7593-4f2e-9b94-8b3558885ed3 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:29.943354 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d11caf-7593-4f2e-9b94-8b3558885ed3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:29.943658 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d11caf-7593-4f2e-9b94-8b3558885ed3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:29.945064 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d11caf-7593-4f2e-9b94-8b3558885ed3 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:29.952917 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 635/1277] 10.222.0.16 () {56 vars in 1099 bytes} [Thu May 26 12:24:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:29.959922 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe24fd-d2e5-49fe-917b-91f07920ebe0 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:30.058379 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe24fd-d2e5-49fe-917b-91f07920ebe0 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:30.091315 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77188268-8b7d-4d3d-a086-db0e8fc458d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:30.092099 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77188268-8b7d-4d3d-a086-db0e8fc458d1 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:30.092381 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77188268-8b7d-4d3d-a086-db0e8fc458d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:30.092654 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77188268-8b7d-4d3d-a086-db0e8fc458d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:30.103333 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77188268-8b7d-4d3d-a086-db0e8fc458d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:30.106654 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77188268-8b7d-4d3d-a086-db0e8fc458d1 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:30.122362 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-77188268-8b7d-4d3d-a086-db0e8fc458d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:30.122362 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:30.122362 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:30.122362 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:30.122362 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:30.122362 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:30.122362 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:30.122362 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:30.122362 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:30.122362 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:30.122362 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:30.122362 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:30.122362 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:30.122362 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:30.122362 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:30.123458 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:30.123458 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:30.123458 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:30.123458 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:30.123458 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:30.123458 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:30.123458 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:30.123458 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:30.123458 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:24:30.123458 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:30.123458 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:30.123458 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:30.123458 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:30.123458 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:30.123458 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:30.123458 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:30.123458 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:30.124749 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:30.124749 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:30.124749 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:30.124749 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:24:30.124749 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 643/1278] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:24:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:24:30.129852 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d11caf-7593-4f2e-9b94-8b3558885ed3 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:30.228572 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d11caf-7593-4f2e-9b94-8b3558885ed3 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:30.262268 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f59668-cb97-4f0a-9552-febca0b550cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:30.262937 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f59668-cb97-4f0a-9552-febca0b550cd None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:30.263222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f59668-cb97-4f0a-9552-febca0b550cd None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:30.263499 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f59668-cb97-4f0a-9552-febca0b550cd None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:30.264217 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f59668-cb97-4f0a-9552-febca0b550cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:30.264524 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f59668-cb97-4f0a-9552-febca0b550cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:30.265932 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f59668-cb97-4f0a-9552-febca0b550cd None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:30.277431 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 636/1279] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:24:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:30.283117 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77188268-8b7d-4d3d-a086-db0e8fc458d1 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:30.314448 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:30.382355 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77188268-8b7d-4d3d-a086-db0e8fc458d1 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:30.413859 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c97ac0-cc21-4d15-a263-42ded706187c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:30.414647 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c97ac0-cc21-4d15-a263-42ded706187c None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:30.414935 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c97ac0-cc21-4d15-a263-42ded706187c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:30.415211 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c97ac0-cc21-4d15-a263-42ded706187c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:30.422353 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c97ac0-cc21-4d15-a263-42ded706187c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:30.423774 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c97ac0-cc21-4d15-a263-42ded706187c None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:30.438341 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-f4c97ac0-cc21-4d15-a263-42ded706187c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 12:24:30.438341 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:30.438341 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:30.438341 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:30.438341 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:30.438341 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:30.438341 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:30.438341 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:30.438341 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:30.438341 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:30.438341 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:30.438341 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:30.438341 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:24:30.438341 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:24:30.438341 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:24:30.438341 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:24:30.439448 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:30.439448 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:30.439448 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:24:30.439448 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:30.439448 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:24:30.439448 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:30.439448 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:30.439448 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:30.439448 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:30.439448 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:30.439448 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:30.439448 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:24:30.439448 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:30.439448 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:30.439448 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:30.439448 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:30.439448 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:30.439448 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:30.440587 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:30.440587 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:30.440587 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:24:30.440587 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:24:30.440587 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:24:30.440587 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:24:30.440587 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:24:30.440587 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:24:30.440587 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 12:24:30.440587 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:24:30.440587 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 644/1280] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:24:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:30.445847 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f59668-cb97-4f0a-9552-febca0b550cd None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:30.449708 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:30.546883 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f59668-cb97-4f0a-9552-febca0b550cd None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:30.584552 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3fce35-456e-4ff0-9133-d447519171a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:30.585177 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3fce35-456e-4ff0-9133-d447519171a8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:30.585462 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3fce35-456e-4ff0-9133-d447519171a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:30.585741 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3fce35-456e-4ff0-9133-d447519171a8 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:30.586569 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3fce35-456e-4ff0-9133-d447519171a8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:30.586878 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3fce35-456e-4ff0-9133-d447519171a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:30.588300 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3fce35-456e-4ff0-9133-d447519171a8 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:30.605403 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 637/1281] 10.222.0.16 () {56 vars in 1143 bytes} [Thu May 26 12:24:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:30.611031 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c97ac0-cc21-4d15-a263-42ded706187c None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:30.698793 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:30.708321 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c97ac0-cc21-4d15-a263-42ded706187c None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:30.741796 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52585f2-5b83-4a48-9238-6c824388465e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:30.742436 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52585f2-5b83-4a48-9238-6c824388465e None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:30.742721 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52585f2-5b83-4a48-9238-6c824388465e None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:30.742997 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52585f2-5b83-4a48-9238-6c824388465e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:30.808905 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52585f2-5b83-4a48-9238-6c824388465e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:30.810354 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52585f2-5b83-4a48-9238-6c824388465e None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:30.895840 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:30.906517 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 645/1282] 10.222.0.16 () {58 vars in 1282 bytes} [Thu May 26 12:24:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:24:30.912879 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3fce35-456e-4ff0-9133-d447519171a8 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:30.974937 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:31.012530 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3fce35-456e-4ff0-9133-d447519171a8 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:31.046557 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a0e3a-7c3a-4058-90d8-46377c5e8687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:31.047350 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a0e3a-7c3a-4058-90d8-46377c5e8687 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:31.047635 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a0e3a-7c3a-4058-90d8-46377c5e8687 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:31.047912 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a0e3a-7c3a-4058-90d8-46377c5e8687 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:31.057800 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81a0e3a-7c3a-4058-90d8-46377c5e8687 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:31.059268 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81a0e3a-7c3a-4058-90d8-46377c5e8687 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:31.076376 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-b81a0e3a-7c3a-4058-90d8-46377c5e8687 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:31.076376 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:31.076376 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:31.076376 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:31.076376 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:31.076376 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:31.076376 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:31.076376 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:31.076376 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:31.076376 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:31.076376 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:31.076376 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:31.076376 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:31.076376 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:31.076376 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:31.077485 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:31.077485 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:31.077485 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:31.077485 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:31.077485 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:31.077485 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:31.077485 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:31.077485 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:31.077485 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:24:31.077485 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:31.077485 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:31.077485 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:31.077485 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:31.077485 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:31.077485 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:31.077485 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:31.077485 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:31.078644 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:31.078644 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:31.078644 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:31.078644 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:24:31.078644 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 638/1283] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:24:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:31.083808 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52585f2-5b83-4a48-9238-6c824388465e None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:31.182662 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52585f2-5b83-4a48-9238-6c824388465e None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:31.221359 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36846850-a1ec-48d1-b86b-a37af075f3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:31.222019 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36846850-a1ec-48d1-b86b-a37af075f3bd None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:31.222300 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36846850-a1ec-48d1-b86b-a37af075f3bd None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:31.223297 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36846850-a1ec-48d1-b86b-a37af075f3bd None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:31.224031 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36846850-a1ec-48d1-b86b-a37af075f3bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:31.224362 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36846850-a1ec-48d1-b86b-a37af075f3bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:31.225771 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36846850-a1ec-48d1-b86b-a37af075f3bd None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:31.237126 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 646/1284] 10.222.0.16 () {56 vars in 1109 bytes} [Thu May 26 12:24:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:31.242694 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a0e3a-7c3a-4058-90d8-46377c5e8687 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:31.346200 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a0e3a-7c3a-4058-90d8-46377c5e8687 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:31.362891 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:31.383815 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1607b4-9642-4ddb-945b-ccfeb5d27269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:31.384605 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1607b4-9642-4ddb-945b-ccfeb5d27269 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:31.384914 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1607b4-9642-4ddb-945b-ccfeb5d27269 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:31.385189 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1607b4-9642-4ddb-945b-ccfeb5d27269 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:31.391675 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1607b4-9642-4ddb-945b-ccfeb5d27269 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:31.393162 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1607b4-9642-4ddb-945b-ccfeb5d27269 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:31.411305 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-6d1607b4-9642-4ddb-945b-ccfeb5d27269 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:31.411305 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:31.411305 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:31.411305 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:31.411305 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:31.411305 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:31.411305 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:31.411305 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:31.411305 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:31.411305 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:31.411305 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:31.411305 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:31.411305 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:24:31.411305 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:24:31.411305 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:24:31.412433 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:24:31.412433 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:31.412433 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:31.412433 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:31.412433 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:31.412433 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:31.412433 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:31.412433 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:31.412433 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( May 26 12:24:31.412433 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:31.412433 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:31.412433 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:31.412433 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:31.412433 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:31.412433 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:31.412433 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:31.412433 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:31.413688 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:24:31.413688 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:24:31.413688 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:24:31.413688 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:24:31.413688 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:24:31.413688 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:24:31.413688 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:31.413688 dv-cinder-815146-11-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application May 26 12:24:31.413688 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 639/1285] 10.222.0.16 () {56 vars in 1111 bytes} [Thu May 26 12:24:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:24:31.418354 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36846850-a1ec-48d1-b86b-a37af075f3bd None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:31.467046 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:31.516381 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36846850-a1ec-48d1-b86b-a37af075f3bd None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:31.549569 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c5523-0cd2-4666-a8c8-fa20d4d7f969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:31.550222 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c5523-0cd2-4666-a8c8-fa20d4d7f969 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:31.550529 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c5523-0cd2-4666-a8c8-fa20d4d7f969 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:31.551324 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c5523-0cd2-4666-a8c8-fa20d4d7f969 None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:31.552107 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6c5523-0cd2-4666-a8c8-fa20d4d7f969 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:31.552414 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6c5523-0cd2-4666-a8c8-fa20d4d7f969 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:31.553863 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6c5523-0cd2-4666-a8c8-fa20d4d7f969 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:31.565508 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 647/1286] 10.222.0.16 () {56 vars in 1148 bytes} [Thu May 26 12:24:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:31.572345 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1607b4-9642-4ddb-945b-ccfeb5d27269 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:31.668048 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1607b4-9642-4ddb-945b-ccfeb5d27269 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:31.700446 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c5c31-80a0-4bea-a1e1-04ae1dfc0701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:31.701100 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c5c31-80a0-4bea-a1e1-04ae1dfc0701 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:31.701381 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c5c31-80a0-4bea-a1e1-04ae1dfc0701 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:31.701652 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c5c31-80a0-4bea-a1e1-04ae1dfc0701 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:31.702732 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2c5c31-80a0-4bea-a1e1-04ae1dfc0701 None admin] RBAC: Adding query filter params (role.id=1a8e523ecbc84d818c2a9af0fb54da74, scope.project.id=42e6c693bd224d92b8a0fe4ad0cc586d, user.id=4327435c97834afeb7e6806ef02349a2) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:31.703040 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2c5c31-80a0-4bea-a1e1-04ae1dfc0701 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:31.704468 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2c5c31-80a0-4bea-a1e1-04ae1dfc0701 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:31.710425 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 640/1287] 10.222.0.16 () {56 vars in 1374 bytes} [Thu May 26 12:24:31 2022] GET /identity/v3/role_assignments?user.id=4327435c97834afeb7e6806ef02349a2&scope.project.id=42e6c693bd224d92b8a0fe4ad0cc586d&role.id=1a8e523ecbc84d818c2a9af0fb54da74 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:33.891340 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574a35e-8019-4488-8e1a-1c5db8f3669d None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:33.891868 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574a35e-8019-4488-8e1a-1c5db8f3669d None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:33.891868 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574a35e-8019-4488-8e1a-1c5db8f3669d None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:33.893305 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 648/1288] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:24:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:33.898987 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b89012-b7c1-436a-beaf-7d9dabdb24b6 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:33.899444 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b89012-b7c1-436a-beaf-7d9dabdb24b6 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:33.899538 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b89012-b7c1-436a-beaf-7d9dabdb24b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:33.916722 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-61b89012-b7c1-436a-beaf-7d9dabdb24b6 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:33.917948 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-61b89012-b7c1-436a-beaf-7d9dabdb24b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:33.946714 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:33.984502 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 641/1289] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:24:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:24:34.008255 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2574a35e-8019-4488-8e1a-1c5db8f3669d None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:34.107982 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2574a35e-8019-4488-8e1a-1c5db8f3669d None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:34.118489 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:34.142697 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c366f2-a219-420c-abf4-e84301a407ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:34.143492 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c366f2-a219-420c-abf4-e84301a407ba None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:34.143777 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c366f2-a219-420c-abf4-e84301a407ba None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:34.144052 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c366f2-a219-420c-abf4-e84301a407ba None admin] PATH_INFO: `/v3/services/placement` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:34.145327 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c366f2-a219-420c-abf4-e84301a407ba None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:34.146688 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c366f2-a219-420c-abf4-e84301a407ba None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:34.158467 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-93c366f2-a219-420c-abf4-e84301a407ba None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 26 12:24:34.158467 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:34.158467 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:24:34.158467 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:24:34.158467 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:24:34.158467 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:24:34.158467 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:24:34.158467 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:24:34.158467 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 12:24:34.158467 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:24:34.158467 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:24:34.158467 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:24:34.158467 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:34.158467 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:34.158467 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:34.158467 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:34.158467 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:34.159677 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:34.159677 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:34.159677 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:34.159677 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:34.159677 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:34.159677 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:34.159677 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:24:34.159677 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:24:34.159677 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:24:34.159677 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:24:34.159677 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:34.159677 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:34.159677 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:34.159677 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:34.159677 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:34.159677 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:34.160933 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:34.160933 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:24:34.160933 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:34.160933 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:34.160933 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:34.160933 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:34.160933 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:34.160933 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:34.160933 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:34.160933 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:34.160933 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:24:34.160933 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:24:34.160933 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 12:24:34.160933 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:24:34.160933 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 649/1290] 10.222.0.16 () {56 vars in 1117 bytes} [Thu May 26 12:24:34 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:34.165822 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b89012-b7c1-436a-beaf-7d9dabdb24b6 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:34.263168 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b89012-b7c1-436a-beaf-7d9dabdb24b6 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:34.296540 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1c9b26-615f-4102-ba92-842858fc435e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:34.297230 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c9b26-615f-4102-ba92-842858fc435e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:34.297517 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c9b26-615f-4102-ba92-842858fc435e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:34.297796 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c9b26-615f-4102-ba92-842858fc435e None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:34.298501 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1c9b26-615f-4102-ba92-842858fc435e None admin] RBAC: Adding query filter params (name=placement) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:34.298809 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1c9b26-615f-4102-ba92-842858fc435e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:34.300193 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1c9b26-615f-4102-ba92-842858fc435e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:34.304972 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 642/1291] 10.222.0.16 () {56 vars in 1116 bytes} [Thu May 26 12:24:34 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:34.310687 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c366f2-a219-420c-abf4-e84301a407ba None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:34.409269 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c366f2-a219-420c-abf4-e84301a407ba None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:34.442555 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b34302-51c0-4af0-b566-4d7caa0a388e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:34.443198 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b34302-51c0-4af0-b566-4d7caa0a388e None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:34.443480 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b34302-51c0-4af0-b566-4d7caa0a388e None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:34.443754 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b34302-51c0-4af0-b566-4d7caa0a388e None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:34.444451 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b34302-51c0-4af0-b566-4d7caa0a388e None admin] RBAC: Adding query filter params (type=placement) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:34.444754 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b34302-51c0-4af0-b566-4d7caa0a388e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:34.446155 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b34302-51c0-4af0-b566-4d7caa0a388e None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:34.450572 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 650/1292] 10.222.0.16 () {56 vars in 1116 bytes} [Thu May 26 12:24:34 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:36.644182 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e352d5-d3e5-44d0-9f1b-28c5c3196e05 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:36.644754 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e352d5-d3e5-44d0-9f1b-28c5c3196e05 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:36.644754 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e352d5-d3e5-44d0-9f1b-28c5c3196e05 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:36.646159 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 643/1293] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:24:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:36.651279 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912d172-8e52-4f77-b916-568dfa80d761 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:36.651771 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912d172-8e52-4f77-b916-568dfa80d761 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:36.651900 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912d172-8e52-4f77-b916-568dfa80d761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:36.668249 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-c912d172-8e52-4f77-b916-568dfa80d761 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:36.669467 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-c912d172-8e52-4f77-b916-568dfa80d761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:36.701271 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:36.738772 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 651/1294] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:24:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:24:36.761999 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e352d5-d3e5-44d0-9f1b-28c5c3196e05 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:36.797855 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:36.880061 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e352d5-d3e5-44d0-9f1b-28c5c3196e05 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:36.918555 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc3e85a-8760-4d0d-99e8-0acdfd8ae53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:36.919255 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc3e85a-8760-4d0d-99e8-0acdfd8ae53d None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:36.919594 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc3e85a-8760-4d0d-99e8-0acdfd8ae53d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:36.919920 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc3e85a-8760-4d0d-99e8-0acdfd8ae53d None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:36.920830 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc3e85a-8760-4d0d-99e8-0acdfd8ae53d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:36.922477 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc3e85a-8760-4d0d-99e8-0acdfd8ae53d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:36.936462 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 644/1295] 10.222.0.16 () {60 vars in 1141 bytes} [Thu May 26 12:24:36 2022] POST /identity/v3/services => generated 246 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:24:39.145739 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afc8d3-1cee-41a7-a706-ba55c86b3d6f None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:39.146256 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afc8d3-1cee-41a7-a706-ba55c86b3d6f None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:39.146256 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afc8d3-1cee-41a7-a706-ba55c86b3d6f None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:39.147610 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 652/1296] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:24:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:39.152946 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cef2b1-69b6-4daf-bd21-bd937032e1c6 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:39.153359 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cef2b1-69b6-4daf-bd21-bd937032e1c6 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:39.153507 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cef2b1-69b6-4daf-bd21-bd937032e1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:39.170397 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-e4cef2b1-69b6-4daf-bd21-bd937032e1c6 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:39.171573 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e4cef2b1-69b6-4daf-bd21-bd937032e1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:39.241091 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 645/1297] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:24:39 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:24:39.263787 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5afc8d3-1cee-41a7-a706-ba55c86b3d6f None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:39.361260 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5afc8d3-1cee-41a7-a706-ba55c86b3d6f None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:39.394301 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b949984-f0d2-46d0-af12-820fcdf7e8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:39.395633 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b949984-f0d2-46d0-af12-820fcdf7e8fe None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:39.395962 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b949984-f0d2-46d0-af12-820fcdf7e8fe None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:39.396185 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b949984-f0d2-46d0-af12-820fcdf7e8fe None admin] PATH_INFO: `/v3/services/placement` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:39.396830 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b949984-f0d2-46d0-af12-820fcdf7e8fe None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:39.398202 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b949984-f0d2-46d0-af12-820fcdf7e8fe None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:39.409636 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-2b949984-f0d2-46d0-af12-820fcdf7e8fe None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 26 12:24:39.409636 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:39.409636 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:24:39.409636 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:24:39.409636 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:24:39.409636 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:24:39.409636 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:24:39.409636 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:24:39.409636 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 12:24:39.409636 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:24:39.409636 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:24:39.409636 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:24:39.409636 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:39.409636 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:39.409636 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:39.409636 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:39.409636 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:39.410799 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:39.410799 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:39.410799 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:39.410799 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:39.410799 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:39.410799 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:39.410799 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:24:39.410799 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:24:39.410799 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:24:39.410799 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:24:39.410799 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:39.410799 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:39.410799 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:39.410799 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:39.410799 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:39.410799 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:39.411866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:39.411866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:24:39.411866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:39.411866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:39.411866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:39.411866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:39.411866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:39.411866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:39.411866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:39.411866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:39.411866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:24:39.411866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:24:39.411866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 12:24:39.411866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:24:39.411866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 653/1298] 10.222.0.16 () {56 vars in 1117 bytes} [Thu May 26 12:24:39 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:39.417020 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cef2b1-69b6-4daf-bd21-bd937032e1c6 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:39.434860 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:39.515141 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cef2b1-69b6-4daf-bd21-bd937032e1c6 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:39.547508 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71dc077-068c-4632-92d2-230aca7342e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:39.548211 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71dc077-068c-4632-92d2-230aca7342e1 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:39.548493 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71dc077-068c-4632-92d2-230aca7342e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:39.548787 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71dc077-068c-4632-92d2-230aca7342e1 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:39.549513 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71dc077-068c-4632-92d2-230aca7342e1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:39.549816 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71dc077-068c-4632-92d2-230aca7342e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:39.551196 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71dc077-068c-4632-92d2-230aca7342e1 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:39.556142 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 646/1299] 10.222.0.16 () {56 vars in 1116 bytes} [Thu May 26 12:24:39 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:39.562086 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b949984-f0d2-46d0-af12-820fcdf7e8fe None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:39.593374 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:39.660106 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b949984-f0d2-46d0-af12-820fcdf7e8fe None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:39.693228 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28461a70-66ea-4422-803d-be04e42b81ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:39.693871 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28461a70-66ea-4422-803d-be04e42b81ca None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:39.694153 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28461a70-66ea-4422-803d-be04e42b81ca None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:39.694426 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28461a70-66ea-4422-803d-be04e42b81ca None admin] PATH_INFO: `/v3/endpoints` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:39.695206 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28461a70-66ea-4422-803d-be04e42b81ca None admin] RBAC: Adding query filter params (interface=public, service_id=c86233186df24f6ea0119a8bb090791f, region_id=RegionOne) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:39.695515 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28461a70-66ea-4422-803d-be04e42b81ca None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:39.696902 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28461a70-66ea-4422-803d-be04e42b81ca None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:39.701895 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 654/1300] 10.222.0.16 () {56 vars in 1251 bytes} [Thu May 26 12:24:39 2022] GET /identity/v3/endpoints?service_id=c86233186df24f6ea0119a8bb090791f&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:39.707511 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71dc077-068c-4632-92d2-230aca7342e1 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:39.789135 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:39.807305 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71dc077-068c-4632-92d2-230aca7342e1 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:39.839974 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bff648f-669d-46f6-a45e-d2d430ee54fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:39.840631 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff648f-669d-46f6-a45e-d2d430ee54fb None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:39.840943 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff648f-669d-46f6-a45e-d2d430ee54fb None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:39.841220 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff648f-669d-46f6-a45e-d2d430ee54fb None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:39.841897 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bff648f-669d-46f6-a45e-d2d430ee54fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:39.843266 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bff648f-669d-46f6-a45e-d2d430ee54fb None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:39.850447 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 647/1301] 10.222.0.16 () {56 vars in 1087 bytes} [Thu May 26 12:24:39 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:24:42.031055 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eedf98-eecb-4383-a5a8-2822f477e1bd None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:42.031562 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eedf98-eecb-4383-a5a8-2822f477e1bd None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:42.031562 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eedf98-eecb-4383-a5a8-2822f477e1bd None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:42.032916 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 655/1302] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:24:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:42.038241 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8aa8bf-9491-45b8-8b8f-d9e2b55a340a None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:42.038664 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8aa8bf-9491-45b8-8b8f-d9e2b55a340a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:42.038800 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8aa8bf-9491-45b8-8b8f-d9e2b55a340a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:42.055894 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-5e8aa8bf-9491-45b8-8b8f-d9e2b55a340a None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:42.057095 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5e8aa8bf-9491-45b8-8b8f-d9e2b55a340a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:42.120845 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 648/1303] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:24:42 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:24:42.144579 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eedf98-eecb-4383-a5a8-2822f477e1bd None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:42.235704 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:42.242833 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eedf98-eecb-4383-a5a8-2822f477e1bd None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:42.275116 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c2c47-f7f6-49b6-b376-30029abd8b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:42.275895 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c2c47-f7f6-49b6-b376-30029abd8b2b None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:42.276180 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c2c47-f7f6-49b6-b376-30029abd8b2b None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:42.276457 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c2c47-f7f6-49b6-b376-30029abd8b2b None admin] PATH_INFO: `/v3/services/placement` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:42.277128 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c2c47-f7f6-49b6-b376-30029abd8b2b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:42.278488 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c2c47-f7f6-49b6-b376-30029abd8b2b None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:42.290563 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-061c2c47-f7f6-49b6-b376-30029abd8b2b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 26 12:24:42.290563 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:42.290563 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:24:42.290563 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:24:42.290563 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:24:42.290563 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:24:42.290563 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:24:42.290563 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:24:42.290563 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 12:24:42.290563 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:24:42.290563 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:24:42.290563 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:24:42.290563 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:42.290563 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:42.290563 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:42.290563 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:42.290563 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:42.291735 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:42.291735 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:42.291735 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:42.291735 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:42.291735 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:42.291735 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:42.291735 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:24:42.291735 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:24:42.291735 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:24:42.291735 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:24:42.291735 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:42.291735 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:42.291735 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:42.291735 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:42.291735 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:42.291735 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:42.292956 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:42.292956 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( May 26 12:24:42.292956 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:42.292956 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:42.292956 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:42.292956 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:42.292956 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:42.292956 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:42.292956 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:42.292956 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:42.292956 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:24:42.292956 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:24:42.292956 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 12:24:42.292956 dv-cinder-815146-11-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application May 26 12:24:42.292956 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 656/1304] 10.222.0.16 () {56 vars in 1117 bytes} [Thu May 26 12:24:42 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:42.297764 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8aa8bf-9491-45b8-8b8f-d9e2b55a340a None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:42.371650 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:42.394131 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8aa8bf-9491-45b8-8b8f-d9e2b55a340a None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:42.427455 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1e0c6-8082-4374-ba10-c578f8e6b141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:42.428108 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1e0c6-8082-4374-ba10-c578f8e6b141 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:42.428387 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1e0c6-8082-4374-ba10-c578f8e6b141 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:42.428661 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1e0c6-8082-4374-ba10-c578f8e6b141 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:42.429393 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1e0c6-8082-4374-ba10-c578f8e6b141 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:42.429697 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1e0c6-8082-4374-ba10-c578f8e6b141 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:42.431060 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1e0c6-8082-4374-ba10-c578f8e6b141 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:42.436025 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 649/1305] 10.222.0.16 () {56 vars in 1116 bytes} [Thu May 26 12:24:42 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:42.441699 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c2c47-f7f6-49b6-b376-30029abd8b2b None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:42.538702 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c2c47-f7f6-49b6-b376-30029abd8b2b None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:42.573942 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e69b60-f894-45b5-a5b8-407209dd4bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:42.574520 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e69b60-f894-45b5-a5b8-407209dd4bbe None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:42.574800 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e69b60-f894-45b5-a5b8-407209dd4bbe None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:42.575071 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e69b60-f894-45b5-a5b8-407209dd4bbe None admin] PATH_INFO: `/v3/endpoints` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:42.575807 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e69b60-f894-45b5-a5b8-407209dd4bbe None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:42.577188 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e69b60-f894-45b5-a5b8-407209dd4bbe None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:42.594284 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 657/1306] 10.222.0.16 () {60 vars in 1144 bytes} [Thu May 26 12:24:42 2022] POST /identity/v3/endpoints => generated 331 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:24:52.433518 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=30 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:52.590495 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:48.060200 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82862d8-8bd7-460b-adcb-3b4a75dad4e6 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:48.060784 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82862d8-8bd7-460b-adcb-3b4a75dad4e6 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:48.060784 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82862d8-8bd7-460b-adcb-3b4a75dad4e6 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:48.062319 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 650/1307] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:25:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:48.068261 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb0a4d-9cb3-4c95-b48f-1f6672bb98c7 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:48.068728 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb0a4d-9cb3-4c95-b48f-1f6672bb98c7 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:48.068859 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb0a4d-9cb3-4c95-b48f-1f6672bb98c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:48.160298 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-9bcb0a4d-9cb3-4c95-b48f-1f6672bb98c7 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:48.162610 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-9bcb0a4d-9cb3-4c95-b48f-1f6672bb98c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:48.440864 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 658/1308] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:25:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:25:48.482550 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b69564-10c2-40c9-a1ef-4a71281cd1a8 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:48.483242 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b69564-10c2-40c9-a1ef-4a71281cd1a8 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:48.483743 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b69564-10c2-40c9-a1ef-4a71281cd1a8 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:48.485849 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 651/1309] 10.222.0.16 () {54 vars in 964 bytes} [Thu May 26 12:25:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:48.493373 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9a2a4-fe0f-47b2-a741-d807de491c1b None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:48.493665 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9a2a4-fe0f-47b2-a741-d807de491c1b None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:48.493944 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9a2a4-fe0f-47b2-a741-d807de491c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:48.597896 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-39a9a2a4-fe0f-47b2-a741-d807de491c1b None None] MFA Rules not processed for user `68033ffcafbc47bbadd008abd9e56c4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:48.599536 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-39a9a2a4-fe0f-47b2-a741-d807de491c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:48.622263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:48.688829 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 659/1310] 10.222.0.16 () {58 vars in 1061 bytes} [Thu May 26 12:25:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:25:48.697299 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b69564-10c2-40c9-a1ef-4a71281cd1a8 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:48.699072 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-14b69564-10c2-40c9-a1ef-4a71281cd1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:48.824901 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b69564-10c2-40c9-a1ef-4a71281cd1a8 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:48.902383 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed1ee7-3457-48be-a0ce-01471c78eb60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:48.902952 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed1ee7-3457-48be-a0ce-01471c78eb60 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:48.903234 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed1ee7-3457-48be-a0ce-01471c78eb60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:48.903505 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed1ee7-3457-48be-a0ce-01471c78eb60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:48.905188 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-43ed1ee7-3457-48be-a0ce-01471c78eb60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:48.964608 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:49.023685 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed1ee7-3457-48be-a0ce-01471c78eb60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:49.025157 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed1ee7-3457-48be-a0ce-01471c78eb60 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:49.044767 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 652/1311] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:25:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:25:51.559910 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa64180-5b24-4b82-bdc7-f8015535f5a8 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:51.560516 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa64180-5b24-4b82-bdc7-f8015535f5a8 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:51.560615 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa64180-5b24-4b82-bdc7-f8015535f5a8 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:51.562015 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 660/1312] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:25:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:51.567821 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed20a8-0f2b-4124-b193-bfc3994406cd None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:51.568278 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed20a8-0f2b-4124-b193-bfc3994406cd None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:51.568382 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed20a8-0f2b-4124-b193-bfc3994406cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:51.641087 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-85ed20a8-0f2b-4124-b193-bfc3994406cd None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:51.642303 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-85ed20a8-0f2b-4124-b193-bfc3994406cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:51.741473 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 653/1313] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:25:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:25:51.779611 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa64180-5b24-4b82-bdc7-f8015535f5a8 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:51.781203 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-dfa64180-5b24-4b82-bdc7-f8015535f5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:51.887232 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa64180-5b24-4b82-bdc7-f8015535f5a8 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:51.975170 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:51.979483 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e441a732-c9ce-432e-ae6b-a7865ae10daf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:51.981130 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441a732-c9ce-432e-ae6b-a7865ae10daf service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:51.981836 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441a732-c9ce-432e-ae6b-a7865ae10daf service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:51.982350 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441a732-c9ce-432e-ae6b-a7865ae10daf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:51.985570 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-e441a732-c9ce-432e-ae6b-a7865ae10daf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:52.103250 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e441a732-c9ce-432e-ae6b-a7865ae10daf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:52.104698 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e441a732-c9ce-432e-ae6b-a7865ae10daf service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:52.124663 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 661/1314] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:25:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:25:54.710136 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fbf891-1924-4ed9-9862-3354daeda60c None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:54.710738 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fbf891-1924-4ed9-9862-3354daeda60c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:54.710738 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fbf891-1924-4ed9-9862-3354daeda60c None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:54.712058 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 654/1315] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:25:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:54.717440 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ddfe22-4103-46ca-bd6f-d6147179ab0f None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:54.717930 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ddfe22-4103-46ca-bd6f-d6147179ab0f None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:54.718075 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ddfe22-4103-46ca-bd6f-d6147179ab0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:54.787700 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-93ddfe22-4103-46ca-bd6f-d6147179ab0f None None] MFA Rules not processed for user `4069b216ae0743869ac1161864e0b3ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:54.788932 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-93ddfe22-4103-46ca-bd6f-d6147179ab0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:54.842136 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:54.892676 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 662/1316] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:25:54 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:25:54.932100 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fbf891-1924-4ed9-9862-3354daeda60c None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:54.933668 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-53fbf891-1924-4ed9-9862-3354daeda60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:54.943999 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:55.047831 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fbf891-1924-4ed9-9862-3354daeda60c None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:55.124159 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e83521-5862-4a03-bc6c-81ce984ac904 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:55.124810 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e83521-5862-4a03-bc6c-81ce984ac904 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:55.125125 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e83521-5862-4a03-bc6c-81ce984ac904 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:55.125403 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e83521-5862-4a03-bc6c-81ce984ac904 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:55.127055 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d1e83521-5862-4a03-bc6c-81ce984ac904 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:55.194296 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:55.245293 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e83521-5862-4a03-bc6c-81ce984ac904 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:55.246749 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e83521-5862-4a03-bc6c-81ce984ac904 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:55.265879 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 655/1317] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:25:54 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:25:58.094592 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52638efc-d7a0-4327-a3b4-6bf83e57d9ed None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:58.095161 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52638efc-d7a0-4327-a3b4-6bf83e57d9ed None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:58.095161 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52638efc-d7a0-4327-a3b4-6bf83e57d9ed None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:58.096549 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 663/1318] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:25:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:25:58.102578 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496c71f-7993-46c5-a6b7-3d6d2ca5e616 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:58.102578 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496c71f-7993-46c5-a6b7-3d6d2ca5e616 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:58.103607 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496c71f-7993-46c5-a6b7-3d6d2ca5e616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:58.171139 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c496c71f-7993-46c5-a6b7-3d6d2ca5e616 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:58.172348 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c496c71f-7993-46c5-a6b7-3d6d2ca5e616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:58.271754 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 656/1319] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:25:58 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:25:58.310887 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52638efc-d7a0-4327-a3b4-6bf83e57d9ed None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:58.312419 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-52638efc-d7a0-4327-a3b4-6bf83e57d9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:58.420094 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52638efc-d7a0-4327-a3b4-6bf83e57d9ed None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:58.495862 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e75c6b-f5e3-4149-bc0f-04a1b0c1beb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:58.496530 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e75c6b-f5e3-4149-bc0f-04a1b0c1beb5 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:58.496811 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e75c6b-f5e3-4149-bc0f-04a1b0c1beb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:58.497134 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e75c6b-f5e3-4149-bc0f-04a1b0c1beb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:58.498859 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-85e75c6b-f5e3-4149-bc0f-04a1b0c1beb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:58.508442 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:58.612632 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e75c6b-f5e3-4149-bc0f-04a1b0c1beb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:58.614636 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e75c6b-f5e3-4149-bc0f-04a1b0c1beb5 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:58.635342 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 664/1320] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:25:58 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:26:01.564200 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72d584-bc10-4dcb-8090-536bddd13b19 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:01.564757 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72d584-bc10-4dcb-8090-536bddd13b19 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:01.564757 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72d584-bc10-4dcb-8090-536bddd13b19 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:01.566170 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 657/1321] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:26:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:01.572394 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a7416-49d6-452c-acda-aec9c295f886 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:01.572910 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a7416-49d6-452c-acda-aec9c295f886 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:01.573006 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a7416-49d6-452c-acda-aec9c295f886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:01.643672 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-425a7416-49d6-452c-acda-aec9c295f886 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:01.644961 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-425a7416-49d6-452c-acda-aec9c295f886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:01.713831 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:01.757255 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 665/1322] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:26:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:26:01.793470 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72d584-bc10-4dcb-8090-536bddd13b19 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:01.794997 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4c72d584-bc10-4dcb-8090-536bddd13b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:01.814839 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:01.910608 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72d584-bc10-4dcb-8090-536bddd13b19 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:01.988655 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7eee90-6f01-4ace-a551-96eefc0d63c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:01.989336 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7eee90-6f01-4ace-a551-96eefc0d63c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:01.989626 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7eee90-6f01-4ace-a551-96eefc0d63c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:01.989899 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7eee90-6f01-4ace-a551-96eefc0d63c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:01.991580 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0a7eee90-6f01-4ace-a551-96eefc0d63c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:02.065677 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:02.107704 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7eee90-6f01-4ace-a551-96eefc0d63c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:02.109178 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7eee90-6f01-4ace-a551-96eefc0d63c7 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:02.131021 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 658/1323] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:26:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:26:04.452442 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3db1f-ef3a-4acd-bce8-ca3fbe464e0d None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:04.453017 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3db1f-ef3a-4acd-bce8-ca3fbe464e0d None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:04.453017 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3db1f-ef3a-4acd-bce8-ca3fbe464e0d None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:04.454331 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 666/1324] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:26:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:04.459784 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e720ad-ba1c-476e-b837-37be8cd8e342 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:04.460251 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e720ad-ba1c-476e-b837-37be8cd8e342 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:04.460369 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e720ad-ba1c-476e-b837-37be8cd8e342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:04.528597 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-80e720ad-ba1c-476e-b837-37be8cd8e342 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:04.529875 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-80e720ad-ba1c-476e-b837-37be8cd8e342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:04.630965 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 659/1325] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:26:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:26:04.666259 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c3db1f-ef3a-4acd-bce8-ca3fbe464e0d None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:04.667877 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-c0c3db1f-ef3a-4acd-bce8-ca3fbe464e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:04.776144 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c3db1f-ef3a-4acd-bce8-ca3fbe464e0d None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:04.851231 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a86e91-f6a6-401c-8e43-cd3bbd82c2b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:04.851885 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a86e91-f6a6-401c-8e43-cd3bbd82c2b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:04.852172 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a86e91-f6a6-401c-8e43-cd3bbd82c2b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:04.852500 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a86e91-f6a6-401c-8e43-cd3bbd82c2b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:04.854272 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-b8a86e91-f6a6-401c-8e43-cd3bbd82c2b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:04.872933 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:04.967862 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a86e91-f6a6-401c-8e43-cd3bbd82c2b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:04.969350 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a86e91-f6a6-401c-8e43-cd3bbd82c2b4 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:04.988419 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 667/1326] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:26:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:26:07.269900 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29c0e0-a64b-432d-b0ac-b5ed044dd0b8 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:07.270439 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29c0e0-a64b-432d-b0ac-b5ed044dd0b8 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:07.270439 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29c0e0-a64b-432d-b0ac-b5ed044dd0b8 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:07.271841 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 660/1327] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:26:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:07.277298 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95abaa7c-59a3-49a0-b121-010fb072f2ee None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:07.277778 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95abaa7c-59a3-49a0-b121-010fb072f2ee None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:07.277873 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95abaa7c-59a3-49a0-b121-010fb072f2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:07.345301 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-95abaa7c-59a3-49a0-b121-010fb072f2ee None None] MFA Rules not processed for user `4069b216ae0743869ac1161864e0b3ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:07.346527 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-95abaa7c-59a3-49a0-b121-010fb072f2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:07.414649 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:07.448659 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 668/1328] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:26:07 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:26:07.486977 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb29c0e0-a64b-432d-b0ac-b5ed044dd0b8 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:07.488561 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-bb29c0e0-a64b-432d-b0ac-b5ed044dd0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:07.520012 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:07.594764 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb29c0e0-a64b-432d-b0ac-b5ed044dd0b8 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:07.671311 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efebac2-f764-40e3-a655-eb8b7fa37ca5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:07.671963 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efebac2-f764-40e3-a655-eb8b7fa37ca5 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:07.672251 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efebac2-f764-40e3-a655-eb8b7fa37ca5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:07.672526 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efebac2-f764-40e3-a655-eb8b7fa37ca5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:07.674201 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9efebac2-f764-40e3-a655-eb8b7fa37ca5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:07.757926 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:07.790559 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efebac2-f764-40e3-a655-eb8b7fa37ca5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:07.791931 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efebac2-f764-40e3-a655-eb8b7fa37ca5 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:07.810315 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 661/1329] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:26:07 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:26:10.314175 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac3221-b10f-4291-912a-77184bb5780a None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:10.314696 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac3221-b10f-4291-912a-77184bb5780a None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:10.314696 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac3221-b10f-4291-912a-77184bb5780a None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:10.316082 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 669/1330] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:26:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:10.321695 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625251dd-ea9c-46bf-b338-6125ef4dcf35 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:10.322198 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625251dd-ea9c-46bf-b338-6125ef4dcf35 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:10.322307 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625251dd-ea9c-46bf-b338-6125ef4dcf35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:10.389310 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-625251dd-ea9c-46bf-b338-6125ef4dcf35 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:10.390449 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-625251dd-ea9c-46bf-b338-6125ef4dcf35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:10.492645 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 662/1331] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:26:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:26:10.528773 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac3221-b10f-4291-912a-77184bb5780a None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:10.530600 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-35ac3221-b10f-4291-912a-77184bb5780a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:10.636108 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac3221-b10f-4291-912a-77184bb5780a None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:10.716127 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c447a476-626b-428c-b5ab-e67276c1a5c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:10.716780 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447a476-626b-428c-b5ab-e67276c1a5c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:10.717093 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447a476-626b-428c-b5ab-e67276c1a5c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:10.717370 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447a476-626b-428c-b5ab-e67276c1a5c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:10.719062 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-c447a476-626b-428c-b5ab-e67276c1a5c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:10.752461 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:10.839523 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c447a476-626b-428c-b5ab-e67276c1a5c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:10.841011 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c447a476-626b-428c-b5ab-e67276c1a5c8 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:10.870690 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 670/1332] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:26:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:26:13.158849 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e350ef-3082-4395-834a-5be056b657f7 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:13.159366 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e350ef-3082-4395-834a-5be056b657f7 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:13.159366 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e350ef-3082-4395-834a-5be056b657f7 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:13.160732 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 663/1333] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:26:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:13.166100 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630c3db-9584-4dd6-b933-9753519a2454 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:13.166602 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630c3db-9584-4dd6-b933-9753519a2454 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:13.166698 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630c3db-9584-4dd6-b933-9753519a2454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:13.233272 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-b630c3db-9584-4dd6-b933-9753519a2454 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:13.234479 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-b630c3db-9584-4dd6-b933-9753519a2454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:13.309178 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:13.333840 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 671/1334] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:26:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:26:13.386314 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72890625-10f5-4597-baf3-7d5f1b337d98 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:13.386599 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72890625-10f5-4597-baf3-7d5f1b337d98 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:13.386877 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72890625-10f5-4597-baf3-7d5f1b337d98 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:13.388278 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 664/1335] 10.222.0.16 () {54 vars in 964 bytes} [Thu May 26 12:26:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:13.394725 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76fc5c-b27b-4945-8dc5-cd82096ffea7 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:13.395015 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76fc5c-b27b-4945-8dc5-cd82096ffea7 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:13.395290 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76fc5c-b27b-4945-8dc5-cd82096ffea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:13.470856 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-bc76fc5c-b27b-4945-8dc5-cd82096ffea7 None None] MFA Rules not processed for user `68033ffcafbc47bbadd008abd9e56c4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:13.472085 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-bc76fc5c-b27b-4945-8dc5-cd82096ffea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:13.550550 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 672/1336] 10.222.0.16 () {58 vars in 1061 bytes} [Thu May 26 12:26:13 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:26:13.559766 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72890625-10f5-4597-baf3-7d5f1b337d98 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:13.561349 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-72890625-10f5-4597-baf3-7d5f1b337d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:13.605840 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:13.672282 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72890625-10f5-4597-baf3-7d5f1b337d98 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:13.752321 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b36e2-8c74-4464-83f0-ecd85d000ade service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:13.753863 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b36e2-8c74-4464-83f0-ecd85d000ade service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:13.754153 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b36e2-8c74-4464-83f0-ecd85d000ade service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:13.754432 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b36e2-8c74-4464-83f0-ecd85d000ade service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:13.756148 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0f1b36e2-8c74-4464-83f0-ecd85d000ade service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:13.850282 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:13.877117 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1b36e2-8c74-4464-83f0-ecd85d000ade service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:13.878637 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1b36e2-8c74-4464-83f0-ecd85d000ade service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:13.896575 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 665/1337] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:26:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:26:17.020011 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20aafaf-8701-4f8d-863c-2a2f6ccb6211 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:17.020559 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20aafaf-8701-4f8d-863c-2a2f6ccb6211 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:17.020559 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20aafaf-8701-4f8d-863c-2a2f6ccb6211 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:17.021890 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 673/1338] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:26:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:17.026997 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23ac1c-cd50-484f-8955-5e242fd6c0ff None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:17.027380 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23ac1c-cd50-484f-8955-5e242fd6c0ff None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:17.027551 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23ac1c-cd50-484f-8955-5e242fd6c0ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:17.091758 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-bb23ac1c-cd50-484f-8955-5e242fd6c0ff None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:17.093016 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-bb23ac1c-cd50-484f-8955-5e242fd6c0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:17.190983 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 666/1339] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:26:17 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:26:17.226281 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20aafaf-8701-4f8d-863c-2a2f6ccb6211 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:17.228879 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-c20aafaf-8701-4f8d-863c-2a2f6ccb6211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:17.311019 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:17.339241 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20aafaf-8701-4f8d-863c-2a2f6ccb6211 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:17.410719 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e298b-9cc2-4e04-8d10-6f93df8b32a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:17.411354 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e298b-9cc2-4e04-8d10-6f93df8b32a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:17.411629 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e298b-9cc2-4e04-8d10-6f93df8b32a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:17.411898 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e298b-9cc2-4e04-8d10-6f93df8b32a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:17.413539 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-4f2e298b-9cc2-4e04-8d10-6f93df8b32a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:17.525788 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e298b-9cc2-4e04-8d10-6f93df8b32a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:17.527218 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e298b-9cc2-4e04-8d10-6f93df8b32a6 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:17.546229 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 674/1340] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:26:17 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:26:21.921856 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294fc046-8dc0-489f-aa14-5297053f21d6 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:21.922412 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294fc046-8dc0-489f-aa14-5297053f21d6 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:21.922412 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294fc046-8dc0-489f-aa14-5297053f21d6 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:21.924228 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 667/1341] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:26:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:21.929548 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad6940-4414-469f-8aac-8f6a355a44d2 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:21.929976 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad6940-4414-469f-8aac-8f6a355a44d2 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:21.930096 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad6940-4414-469f-8aac-8f6a355a44d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:21.936237 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:22.007045 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-3aad6940-4414-469f-8aac-8f6a355a44d2 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:22.008345 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-3aad6940-4414-469f-8aac-8f6a355a44d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:22.126424 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 675/1342] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:26:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:26:22.166293 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294fc046-8dc0-489f-aa14-5297053f21d6 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:22.168605 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-294fc046-8dc0-489f-aa14-5297053f21d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:22.221544 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:22.268453 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294fc046-8dc0-489f-aa14-5297053f21d6 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:22.272037 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5691248a-1d32-4e91-b36d-d8abdb7d0229 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:22.272686 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5691248a-1d32-4e91-b36d-d8abdb7d0229 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:22.273002 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5691248a-1d32-4e91-b36d-d8abdb7d0229 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:22.273281 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5691248a-1d32-4e91-b36d-d8abdb7d0229 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:22.284085 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5691248a-1d32-4e91-b36d-d8abdb7d0229 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:22.285572 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5691248a-1d32-4e91-b36d-d8abdb7d0229 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:22.296781 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 668/1343] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:26:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:26:25.130939 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad72d20-7c08-4dda-a773-e1f77a60294e None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:25.131471 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad72d20-7c08-4dda-a773-e1f77a60294e None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:25.131471 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad72d20-7c08-4dda-a773-e1f77a60294e None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:25.132777 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 676/1344] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:26:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:25.138100 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafef4e8-ee01-4b72-bf5e-2b47bf1846eb None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:25.138541 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafef4e8-ee01-4b72-bf5e-2b47bf1846eb None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:25.138651 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafef4e8-ee01-4b72-bf5e-2b47bf1846eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:25.167269 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-aafef4e8-ee01-4b72-bf5e-2b47bf1846eb None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:25.168445 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-aafef4e8-ee01-4b72-bf5e-2b47bf1846eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:25.246925 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 669/1345] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:26:25 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:26:25.284440 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad72d20-7c08-4dda-a773-e1f77a60294e None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:25.286189 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-0ad72d20-7c08-4dda-a773-e1f77a60294e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:25.299879 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad72d20-7c08-4dda-a773-e1f77a60294e None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:25.303421 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264bf759-7e07-40fe-8af6-97637a6237da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:25.304094 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264bf759-7e07-40fe-8af6-97637a6237da service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:25.304375 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264bf759-7e07-40fe-8af6-97637a6237da service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:25.304673 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264bf759-7e07-40fe-8af6-97637a6237da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:25.314388 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264bf759-7e07-40fe-8af6-97637a6237da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:25.315824 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264bf759-7e07-40fe-8af6-97637a6237da service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:25.325761 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 677/1346] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:26:25 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:26:29.484151 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac38fa9-c58a-4300-9837-ee330db3d47d None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:29.484687 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac38fa9-c58a-4300-9837-ee330db3d47d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:29.484687 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac38fa9-c58a-4300-9837-ee330db3d47d None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:29.486155 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 670/1347] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:26:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:29.491579 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a20ef-243e-4545-b97a-3e81da6e70b8 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:29.492005 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a20ef-243e-4545-b97a-3e81da6e70b8 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:29.492106 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a20ef-243e-4545-b97a-3e81da6e70b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:29.512367 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-021a20ef-243e-4545-b97a-3e81da6e70b8 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:29.513630 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-021a20ef-243e-4545-b97a-3e81da6e70b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:29.522204 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 678/1348] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:26:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:26:29.566207 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac38fa9-c58a-4300-9837-ee330db3d47d None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:29.577223 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac38fa9-c58a-4300-9837-ee330db3d47d None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:29.581486 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbefd07c-da63-49d8-b594-6fcdf69d6ad2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:29.582143 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbefd07c-da63-49d8-b594-6fcdf69d6ad2 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:29.582428 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbefd07c-da63-49d8-b594-6fcdf69d6ad2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:29.582707 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbefd07c-da63-49d8-b594-6fcdf69d6ad2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:29.592299 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbefd07c-da63-49d8-b594-6fcdf69d6ad2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:29.593776 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbefd07c-da63-49d8-b594-6fcdf69d6ad2 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:29.604296 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 671/1349] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:26:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:26:34.975029 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fcc49c-7dec-445b-86f0-f70ef8563ada None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:34.975543 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fcc49c-7dec-445b-86f0-f70ef8563ada None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:34.975663 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fcc49c-7dec-445b-86f0-f70ef8563ada None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:34.976977 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 679/1350] 10.222.0.16 () {54 vars in 921 bytes} [Thu May 26 12:26:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:34.992298 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fddb04-1227-4744-bf18-97140a0431da None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:34.992728 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fddb04-1227-4744-bf18-97140a0431da None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:34.992888 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fddb04-1227-4744-bf18-97140a0431da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:35.076989 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-29fddb04-1227-4744-bf18-97140a0431da None None] MFA Rules not processed for user `4327435c97834afeb7e6806ef02349a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:35.078276 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-29fddb04-1227-4744-bf18-97140a0431da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:35.108444 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:35.161886 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 672/1351] 10.222.0.16 () {58 vars in 1018 bytes} [Thu May 26 12:26:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:26:39.504521 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=72 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:39.678419 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd992e9-8360-4ed6-b4e3-4e75d7eea17d None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:39.678861 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd992e9-8360-4ed6-b4e3-4e75d7eea17d None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:39.679249 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd992e9-8360-4ed6-b4e3-4e75d7eea17d None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:39.681481 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 680/1352] 10.222.0.16 () {54 vars in 921 bytes} [Thu May 26 12:26:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:39.686288 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d8280-b33c-4463-a485-a566978b08f4 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:39.686788 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d8280-b33c-4463-a485-a566978b08f4 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:39.687142 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d8280-b33c-4463-a485-a566978b08f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:39.706467 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-274d8280-b33c-4463-a485-a566978b08f4 None None] MFA Rules not processed for user `4327435c97834afeb7e6806ef02349a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:39.707825 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-274d8280-b33c-4463-a485-a566978b08f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:39.716717 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 673/1353] 10.222.0.16 () {58 vars in 1018 bytes} [Thu May 26 12:26:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:26:41.049261 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d911d6c-e3cf-4faa-93e0-53f8be48e84a None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:41.049757 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d911d6c-e3cf-4faa-93e0-53f8be48e84a None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:41.049757 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d911d6c-e3cf-4faa-93e0-53f8be48e84a None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:41.051084 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 681/1354] 10.222.0.16 () {54 vars in 921 bytes} [Thu May 26 12:26:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:41.056055 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c42a4a-cc74-49bb-b506-7beefbc18ff3 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:41.056462 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c42a4a-cc74-49bb-b506-7beefbc18ff3 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:41.056740 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c42a4a-cc74-49bb-b506-7beefbc18ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:41.075664 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-73c42a4a-cc74-49bb-b506-7beefbc18ff3 None None] MFA Rules not processed for user `4327435c97834afeb7e6806ef02349a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:41.077037 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-73c42a4a-cc74-49bb-b506-7beefbc18ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:41.086397 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 674/1355] 10.222.0.16 () {58 vars in 1018 bytes} [Thu May 26 12:26:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:26:45.109102 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf2ade-dedb-4de3-b2ea-84a2c73c5d62 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:45.110150 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf2ade-dedb-4de3-b2ea-84a2c73c5d62 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:45.110150 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf2ade-dedb-4de3-b2ea-84a2c73c5d62 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:45.111524 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 682/1356] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:26:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:45.116662 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a23f14-5d80-473c-a12e-f95edf88ffcc None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:45.117092 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a23f14-5d80-473c-a12e-f95edf88ffcc None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:45.117255 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a23f14-5d80-473c-a12e-f95edf88ffcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:45.135500 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-99a23f14-5d80-473c-a12e-f95edf88ffcc None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:45.136690 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-99a23f14-5d80-473c-a12e-f95edf88ffcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:45.144696 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 675/1357] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:26:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:26:45.198705 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25cd61-fa60-4289-9e9e-82e6691f8734 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:45.199123 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25cd61-fa60-4289-9e9e-82e6691f8734 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:45.199477 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25cd61-fa60-4289-9e9e-82e6691f8734 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:45.200928 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 683/1358] 10.222.0.16 () {54 vars in 961 bytes} [Thu May 26 12:26:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:45.209366 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0ccf7-9cbd-4bcf-8f44-aa9e4d93edad None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:45.209762 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0ccf7-9cbd-4bcf-8f44-aa9e4d93edad None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:45.210264 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0ccf7-9cbd-4bcf-8f44-aa9e4d93edad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:45.268819 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-96b0ccf7-9cbd-4bcf-8f44-aa9e4d93edad None None] MFA Rules not processed for user `536f68ff77794352adf41aaacdc0645c`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:45.270324 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-96b0ccf7-9cbd-4bcf-8f44-aa9e4d93edad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:45.378951 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 676/1359] 10.222.0.16 () {58 vars in 1058 bytes} [Thu May 26 12:26:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:26:45.386918 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c25cd61-fa60-4289-9e9e-82e6691f8734 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:45.404374 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c25cd61-fa60-4289-9e9e-82e6691f8734 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:45.410690 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317872d4-267f-43ef-8ed6-f9ff842e79d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536f68ff77794352adf41aaacdc0645c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:45.411330 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317872d4-267f-43ef-8ed6-f9ff842e79d9 service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:45.411613 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317872d4-267f-43ef-8ed6-f9ff842e79d9 service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:45.412068 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317872d4-267f-43ef-8ed6-f9ff842e79d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:45.421108 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317872d4-267f-43ef-8ed6-f9ff842e79d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:45.423472 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317872d4-267f-43ef-8ed6-f9ff842e79d9 service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:45.433814 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 684/1360] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:26:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:26:47.897175 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137460c-5696-4ed5-b21c-69f7baffac7b None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:47.897680 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137460c-5696-4ed5-b21c-69f7baffac7b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:47.897680 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137460c-5696-4ed5-b21c-69f7baffac7b None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:47.899476 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 677/1361] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:26:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:47.905182 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650e86e-3acb-4c8d-9c5c-c0f1040a10c5 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:47.906114 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650e86e-3acb-4c8d-9c5c-c0f1040a10c5 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:47.909190 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650e86e-3acb-4c8d-9c5c-c0f1040a10c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:47.932155 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-f650e86e-3acb-4c8d-9c5c-c0f1040a10c5 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:47.934909 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-f650e86e-3acb-4c8d-9c5c-c0f1040a10c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:47.946192 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 685/1362] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:26:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:26:47.992220 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137460c-5696-4ed5-b21c-69f7baffac7b None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:48.012114 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137460c-5696-4ed5-b21c-69f7baffac7b None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:48.018638 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816fbab8-a4af-47dc-b51e-ac78970e5525 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536f68ff77794352adf41aaacdc0645c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:48.019302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816fbab8-a4af-47dc-b51e-ac78970e5525 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:48.019578 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816fbab8-a4af-47dc-b51e-ac78970e5525 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:48.019846 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816fbab8-a4af-47dc-b51e-ac78970e5525 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:48.029253 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816fbab8-a4af-47dc-b51e-ac78970e5525 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:48.030864 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816fbab8-a4af-47dc-b51e-ac78970e5525 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:48.040564 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 678/1363] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:26:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:26:50.579093 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf51888-0ebf-4154-a9b5-be756bc32fb7 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:50.579603 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf51888-0ebf-4154-a9b5-be756bc32fb7 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:50.579700 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf51888-0ebf-4154-a9b5-be756bc32fb7 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:50.581062 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 686/1364] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:26:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:26:50.586385 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb8172-dfed-4577-8724-3db40d3d414b None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:50.586804 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb8172-dfed-4577-8724-3db40d3d414b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:50.586943 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb8172-dfed-4577-8724-3db40d3d414b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:50.605411 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-42cb8172-dfed-4577-8724-3db40d3d414b None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:50.606619 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-42cb8172-dfed-4577-8724-3db40d3d414b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:50.614868 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 679/1365] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:26:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:26:50.661563 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8b3d9-631c-495f-82ef-89a6f8e8c1c7 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:50.661947 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8b3d9-631c-495f-82ef-89a6f8e8c1c7 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:50.662237 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8b3d9-631c-495f-82ef-89a6f8e8c1c7 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:50.663785 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 687/1366] 10.222.0.16 () {54 vars in 961 bytes} [Thu May 26 12:26:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:50.670004 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5770e2-2755-4234-9e8a-c61cf9bfa7cc None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:50.670481 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5770e2-2755-4234-9e8a-c61cf9bfa7cc None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:50.670966 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5770e2-2755-4234-9e8a-c61cf9bfa7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:50.690744 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-6c5770e2-2755-4234-9e8a-c61cf9bfa7cc None None] MFA Rules not processed for user `536f68ff77794352adf41aaacdc0645c`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:50.693069 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6c5770e2-2755-4234-9e8a-c61cf9bfa7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:50.704850 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 680/1367] 10.222.0.16 () {58 vars in 1058 bytes} [Thu May 26 12:26:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:26:50.713064 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8b3d9-631c-495f-82ef-89a6f8e8c1c7 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:50.738074 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8b3d9-631c-495f-82ef-89a6f8e8c1c7 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:50.748041 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a36b6-a705-45e0-8e12-1ddfd1f6ae22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536f68ff77794352adf41aaacdc0645c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:50.749119 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a36b6-a705-45e0-8e12-1ddfd1f6ae22 service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:50.750123 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a36b6-a705-45e0-8e12-1ddfd1f6ae22 service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:50.750928 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a36b6-a705-45e0-8e12-1ddfd1f6ae22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:50.764498 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95a36b6-a705-45e0-8e12-1ddfd1f6ae22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:50.766836 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95a36b6-a705-45e0-8e12-1ddfd1f6ae22 service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:50.776984 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 688/1368] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:26:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:26:53.073087 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc1aab-bb01-4ee4-9f39-727353e82bf4 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:53.073971 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc1aab-bb01-4ee4-9f39-727353e82bf4 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:53.074403 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc1aab-bb01-4ee4-9f39-727353e82bf4 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:53.076239 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 681/1369] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:26:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:53.081721 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d4a1e-9c9b-42cb-b36d-66b28ddb65d0 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:53.082558 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d4a1e-9c9b-42cb-b36d-66b28ddb65d0 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:53.082840 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d4a1e-9c9b-42cb-b36d-66b28ddb65d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:53.102278 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-9e3d4a1e-9c9b-42cb-b36d-66b28ddb65d0 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:53.104044 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-9e3d4a1e-9c9b-42cb-b36d-66b28ddb65d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:53.113330 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 689/1370] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:26:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:26:53.158139 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbc1aab-bb01-4ee4-9f39-727353e82bf4 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:53.173744 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbc1aab-bb01-4ee4-9f39-727353e82bf4 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:53.179616 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e829644d-0524-4aef-a768-551ab5469d0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536f68ff77794352adf41aaacdc0645c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:53.180405 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829644d-0524-4aef-a768-551ab5469d0c service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:53.180780 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829644d-0524-4aef-a768-551ab5469d0c service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:53.181175 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829644d-0524-4aef-a768-551ab5469d0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:53.190531 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e829644d-0524-4aef-a768-551ab5469d0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:53.192358 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e829644d-0524-4aef-a768-551ab5469d0c service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:53.203710 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 682/1371] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:26:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:26:53.449533 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ada1c-df72-4a36-9ed8-85c17083450b None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:53.449906 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ada1c-df72-4a36-9ed8-85c17083450b None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:53.450342 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ada1c-df72-4a36-9ed8-85c17083450b None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:53.452182 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 690/1372] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:26:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:53.458807 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af371de-a9c4-4d61-9ca3-cbcfffec4d0e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:53.459103 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af371de-a9c4-4d61-9ca3-cbcfffec4d0e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:53.459386 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af371de-a9c4-4d61-9ca3-cbcfffec4d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:53.484380 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-3af371de-a9c4-4d61-9ca3-cbcfffec4d0e None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:53.486367 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3af371de-a9c4-4d61-9ca3-cbcfffec4d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:53.500998 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 683/1373] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:26:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:26:53.820104 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef5c45-53a6-4497-afe7-b984d074a648 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:53.820104 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef5c45-53a6-4497-afe7-b984d074a648 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:53.820104 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef5c45-53a6-4497-afe7-b984d074a648 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:53.822529 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 691/1374] 10.222.0.16 () {54 vars in 963 bytes} [Thu May 26 12:26:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:53.828694 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235d3bc-d44b-4eb5-a81b-ff7496305f8f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:53.829114 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235d3bc-d44b-4eb5-a81b-ff7496305f8f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:53.829427 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235d3bc-d44b-4eb5-a81b-ff7496305f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:53.837965 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:53.886954 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b235d3bc-d44b-4eb5-a81b-ff7496305f8f None None] MFA Rules not processed for user `736554efeba94a0b9547d18c3fc84fec`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:53.888221 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b235d3bc-d44b-4eb5-a81b-ff7496305f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:53.956532 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 684/1375] 10.222.0.16 () {58 vars in 1060 bytes} [Thu May 26 12:26:53 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:26:53.963042 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef5c45-53a6-4497-afe7-b984d074a648 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:53.974404 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef5c45-53a6-4497-afe7-b984d074a648 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:53.978609 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a29e46-61e7-4a57-9eab-c338c079ac55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:53.979390 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a29e46-61e7-4a57-9eab-c338c079ac55 service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:53.979787 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a29e46-61e7-4a57-9eab-c338c079ac55 service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:53.980155 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a29e46-61e7-4a57-9eab-c338c079ac55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:53.990965 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a29e46-61e7-4a57-9eab-c338c079ac55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:53.992530 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a29e46-61e7-4a57-9eab-c338c079ac55 service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:54.003980 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 692/1376] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:26:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:26:55.477800 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ea3cd-6c92-4079-8cdc-bdc471f32758 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:55.478418 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ea3cd-6c92-4079-8cdc-bdc471f32758 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:55.478418 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ea3cd-6c92-4079-8cdc-bdc471f32758 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:55.479569 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 685/1377] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:26:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:26:55.485460 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d24805-0d51-423d-82bc-f243ba14eeb0 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:55.485914 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d24805-0d51-423d-82bc-f243ba14eeb0 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:55.486070 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d24805-0d51-423d-82bc-f243ba14eeb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:55.505247 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-45d24805-0d51-423d-82bc-f243ba14eeb0 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:55.506527 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-45d24805-0d51-423d-82bc-f243ba14eeb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:55.515535 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 693/1378] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:26:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:26:55.562659 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91ea3cd-6c92-4079-8cdc-bdc471f32758 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:55.578176 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91ea3cd-6c92-4079-8cdc-bdc471f32758 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:55.583799 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ae7e2-42cd-4937-ae30-cef5281468f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536f68ff77794352adf41aaacdc0645c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:55.584473 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ae7e2-42cd-4937-ae30-cef5281468f7 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:55.584758 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ae7e2-42cd-4937-ae30-cef5281468f7 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:55.585065 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ae7e2-42cd-4937-ae30-cef5281468f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:55.594574 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7ae7e2-42cd-4937-ae30-cef5281468f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:55.596221 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7ae7e2-42cd-4937-ae30-cef5281468f7 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:55.607078 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 686/1379] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:26:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:26:57.879700 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ac4cf-a6af-4ded-ab86-b929d32ea594 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:57.880207 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ac4cf-a6af-4ded-ab86-b929d32ea594 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:57.880621 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ac4cf-a6af-4ded-ab86-b929d32ea594 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:57.882337 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 694/1380] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:26:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:57.887977 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a3859a-39bb-4236-bde7-b6df5751f50e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:57.888755 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a3859a-39bb-4236-bde7-b6df5751f50e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:57.889233 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a3859a-39bb-4236-bde7-b6df5751f50e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:57.908608 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-68a3859a-39bb-4236-bde7-b6df5751f50e None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:57.910097 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-68a3859a-39bb-4236-bde7-b6df5751f50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:57.924926 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 687/1381] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:26:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:26:57.963430 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ac4cf-a6af-4ded-ab86-b929d32ea594 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:57.980117 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ac4cf-a6af-4ded-ab86-b929d32ea594 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:57.986318 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe6036-9b94-4b3a-a654-fe3be390acc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536f68ff77794352adf41aaacdc0645c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:57.987244 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe6036-9b94-4b3a-a654-fe3be390acc7 service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:57.987694 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe6036-9b94-4b3a-a654-fe3be390acc7 service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:57.988135 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe6036-9b94-4b3a-a654-fe3be390acc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:57.997438 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fe6036-9b94-4b3a-a654-fe3be390acc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:57.999491 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fe6036-9b94-4b3a-a654-fe3be390acc7 service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:58.012643 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 695/1382] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:26:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:27:00.371079 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51f0dd-b266-46f0-91fe-4b85326f9ca0 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:00.371597 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51f0dd-b266-46f0-91fe-4b85326f9ca0 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:00.371713 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51f0dd-b266-46f0-91fe-4b85326f9ca0 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:00.373184 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 688/1383] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:27:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:27:00.379127 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbeecfa-8ac5-429a-b8a2-f5b041d39763 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:00.379566 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbeecfa-8ac5-429a-b8a2-f5b041d39763 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:00.379762 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbeecfa-8ac5-429a-b8a2-f5b041d39763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:00.400204 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-9bbeecfa-8ac5-429a-b8a2-f5b041d39763 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:27:00.401660 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-9bbeecfa-8ac5-429a-b8a2-f5b041d39763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:27:00.412350 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 696/1384] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:27:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:27:00.459791 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d51f0dd-b266-46f0-91fe-4b85326f9ca0 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:00.476260 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d51f0dd-b266-46f0-91fe-4b85326f9ca0 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:00.482414 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0254e-a94a-4bdc-ae25-44c3acae4b0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536f68ff77794352adf41aaacdc0645c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:00.483132 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0254e-a94a-4bdc-ae25-44c3acae4b0c service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:00.483132 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0254e-a94a-4bdc-ae25-44c3acae4b0c service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:00.483132 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0254e-a94a-4bdc-ae25-44c3acae4b0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:00.500826 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b0254e-a94a-4bdc-ae25-44c3acae4b0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:00.502448 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b0254e-a94a-4bdc-ae25-44c3acae4b0c service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:00.512762 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 689/1385] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:27:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:27:03.001169 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ca0dd-391e-49ce-a1ad-b9bda25264ab None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:03.001726 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ca0dd-391e-49ce-a1ad-b9bda25264ab None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:03.002245 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ca0dd-391e-49ce-a1ad-b9bda25264ab None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:03.004416 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 697/1386] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:27:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:27:03.009657 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ef5f1-2d92-4361-b08e-b31ad618e9f1 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:03.010167 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ef5f1-2d92-4361-b08e-b31ad618e9f1 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:03.010254 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ef5f1-2d92-4361-b08e-b31ad618e9f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:03.028595 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-db6ef5f1-2d92-4361-b08e-b31ad618e9f1 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:27:03.029879 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-db6ef5f1-2d92-4361-b08e-b31ad618e9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:27:03.038152 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 690/1387] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:27:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:27:03.085907 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6ca0dd-391e-49ce-a1ad-b9bda25264ab None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:03.101646 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6ca0dd-391e-49ce-a1ad-b9bda25264ab None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:03.107389 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff0a75-977c-4be2-99ba-6b666aef693f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536f68ff77794352adf41aaacdc0645c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:03.108107 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff0a75-977c-4be2-99ba-6b666aef693f service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:03.108386 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff0a75-977c-4be2-99ba-6b666aef693f service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:03.108659 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff0a75-977c-4be2-99ba-6b666aef693f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:03.117398 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfff0a75-977c-4be2-99ba-6b666aef693f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:03.118990 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfff0a75-977c-4be2-99ba-6b666aef693f service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:03.128781 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 698/1388] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:27:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:27:06.031001 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e102950-1317-4228-a742-a04747d3c088 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:06.031545 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e102950-1317-4228-a742-a04747d3c088 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:06.031545 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e102950-1317-4228-a742-a04747d3c088 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:06.032962 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 691/1389] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:27:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:27:06.038474 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2641eda-263f-49f5-9b08-1d3ee4dacb89 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:06.038955 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2641eda-263f-49f5-9b08-1d3ee4dacb89 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:06.039056 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2641eda-263f-49f5-9b08-1d3ee4dacb89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:06.057431 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-c2641eda-263f-49f5-9b08-1d3ee4dacb89 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:27:06.058666 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-c2641eda-263f-49f5-9b08-1d3ee4dacb89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:27:06.067370 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 699/1390] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:27:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:27:06.113656 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e102950-1317-4228-a742-a04747d3c088 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:06.132369 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e102950-1317-4228-a742-a04747d3c088 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:06.140459 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb6273-b647-4f16-88a6-de043d0f8911 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536f68ff77794352adf41aaacdc0645c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:06.141352 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb6273-b647-4f16-88a6-de043d0f8911 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:06.141732 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb6273-b647-4f16-88a6-de043d0f8911 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:06.142089 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb6273-b647-4f16-88a6-de043d0f8911 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:06.152728 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb6273-b647-4f16-88a6-de043d0f8911 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:06.155512 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb6273-b647-4f16-88a6-de043d0f8911 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:06.167856 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 692/1391] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:27:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:27:08.415792 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964130a-5451-44f0-a324-45bdf2978fbe None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:08.416466 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964130a-5451-44f0-a324-45bdf2978fbe None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:08.416466 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964130a-5451-44f0-a324-45bdf2978fbe None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:08.418045 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 700/1392] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:27:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:27:08.423329 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae3767-b91d-41e7-a8cc-54c6fd71999e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:08.423778 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae3767-b91d-41e7-a8cc-54c6fd71999e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:08.423889 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae3767-b91d-41e7-a8cc-54c6fd71999e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:08.441473 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-21ae3767-b91d-41e7-a8cc-54c6fd71999e None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:27:08.442658 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-21ae3767-b91d-41e7-a8cc-54c6fd71999e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:27:08.450426 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 693/1393] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:27:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:27:08.494542 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e964130a-5451-44f0-a324-45bdf2978fbe None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:08.508794 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e964130a-5451-44f0-a324-45bdf2978fbe None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:08.514748 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e8c78-c1d3-4460-bf27-078debd6c403 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536f68ff77794352adf41aaacdc0645c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:08.515378 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e8c78-c1d3-4460-bf27-078debd6c403 service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:08.515684 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e8c78-c1d3-4460-bf27-078debd6c403 service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:08.515944 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e8c78-c1d3-4460-bf27-078debd6c403 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:08.524384 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e8c78-c1d3-4460-bf27-078debd6c403 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:08.525985 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e8c78-c1d3-4460-bf27-078debd6c403 service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:08.535974 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 701/1394] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:27:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:27:10.116829 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59a779-64d1-47cc-9cef-1d05cf39e0e0 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:10.117444 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59a779-64d1-47cc-9cef-1d05cf39e0e0 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:10.117444 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59a779-64d1-47cc-9cef-1d05cf39e0e0 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:10.118760 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 694/1395] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:27:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:27:10.124517 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c1668-95de-467b-9892-f3c32dd7ed4b None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:10.124984 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c1668-95de-467b-9892-f3c32dd7ed4b None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:10.125116 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c1668-95de-467b-9892-f3c32dd7ed4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:10.131199 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=52 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:10.144722 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-df3c1668-95de-467b-9892-f3c32dd7ed4b None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:27:10.145944 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-df3c1668-95de-467b-9892-f3c32dd7ed4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:27:10.154027 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 702/1396] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:27:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:27:10.209925 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669b1eb-a4ae-477f-a97e-c84f29154bb4 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:10.210205 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669b1eb-a4ae-477f-a97e-c84f29154bb4 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:10.210479 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669b1eb-a4ae-477f-a97e-c84f29154bb4 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:10.211829 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 695/1397] 10.222.0.16 () {54 vars in 962 bytes} [Thu May 26 12:27:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:27:10.216778 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a0fd8-150c-4437-975a-473282e91e46 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:10.217108 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a0fd8-150c-4437-975a-473282e91e46 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:10.217391 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a0fd8-150c-4437-975a-473282e91e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:10.265764 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-ef2a0fd8-150c-4437-975a-473282e91e46 None None] MFA Rules not processed for user `ad8cfccd3a4d42d381ce62ea90849f19`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:27:10.266945 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-ef2a0fd8-150c-4437-975a-473282e91e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:27:10.326330 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 703/1398] 10.222.0.16 () {58 vars in 1059 bytes} [Thu May 26 12:27:10 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:27:10.333897 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7669b1eb-a4ae-477f-a97e-c84f29154bb4 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:10.344900 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7669b1eb-a4ae-477f-a97e-c84f29154bb4 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:10.348351 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63cd098-08eb-4a74-a484-a261fd18f780 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad8cfccd3a4d42d381ce62ea90849f19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:10.349015 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63cd098-08eb-4a74-a484-a261fd18f780 service glance] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:10.349296 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63cd098-08eb-4a74-a484-a261fd18f780 service glance] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:10.349569 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63cd098-08eb-4a74-a484-a261fd18f780 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:10.359508 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63cd098-08eb-4a74-a484-a261fd18f780 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:10.360959 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63cd098-08eb-4a74-a484-a261fd18f780 service glance] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:10.370557 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 696/1399] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:27:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:27:10.841745 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f326d37-cb02-4e93-a470-8f38bfe8ec2b None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:10.842078 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f326d37-cb02-4e93-a470-8f38bfe8ec2b None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:10.842311 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f326d37-cb02-4e93-a470-8f38bfe8ec2b None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:10.843674 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 704/1400] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:27:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:27:10.848967 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7561b37-4d56-4650-8068-2adf4e244324 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:10.849261 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7561b37-4d56-4650-8068-2adf4e244324 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:10.849546 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7561b37-4d56-4650-8068-2adf4e244324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:10.867293 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b7561b37-4d56-4650-8068-2adf4e244324 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:27:10.868501 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b7561b37-4d56-4650-8068-2adf4e244324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:27:10.877311 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 697/1401] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:27:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:27:10.916768 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f581f8-7683-487e-ad8e-9276e79955a6 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:10.917264 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f581f8-7683-487e-ad8e-9276e79955a6 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:10.917617 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f581f8-7683-487e-ad8e-9276e79955a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:10.926129 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7561b37-4d56-4650-8068-2adf4e244324 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:10.939005 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7561b37-4d56-4650-8068-2adf4e244324 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:10.944507 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b03b6a-fc2e-4b5c-9568-67e08b9ae8f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536f68ff77794352adf41aaacdc0645c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:10.945198 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b03b6a-fc2e-4b5c-9568-67e08b9ae8f8 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:10.945472 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b03b6a-fc2e-4b5c-9568-67e08b9ae8f8 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:10.945745 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b03b6a-fc2e-4b5c-9568-67e08b9ae8f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:10.953915 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b03b6a-fc2e-4b5c-9568-67e08b9ae8f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:10.955506 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b03b6a-fc2e-4b5c-9568-67e08b9ae8f8 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:10.965000 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 698/1402] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:27:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:27:10.967707 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-81f581f8-7683-487e-ad8e-9276e79955a6 None None] MFA Rules not processed for user `512b4337083145f9ae57948a63444ced`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:27:10.969015 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-81f581f8-7683-487e-ad8e-9276e79955a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:27:11.046927 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 705/1403] 10.222.0.16 () {58 vars in 1009 bytes} [Thu May 26 12:27:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:27:11.091182 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60acdf-825a-45aa-ad8b-63b58f56683c None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:11.091598 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60acdf-825a-45aa-ad8b-63b58f56683c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:11.092417 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60acdf-825a-45aa-ad8b-63b58f56683c None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:11.093879 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 699/1404] 10.222.0.16 () {54 vars in 942 bytes} [Thu May 26 12:27:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:27:11.101167 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372b902-9652-44d1-8aca-c4c6d9e73203 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:11.101460 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372b902-9652-44d1-8aca-c4c6d9e73203 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:11.101738 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372b902-9652-44d1-8aca-c4c6d9e73203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:11.155516 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-a372b902-9652-44d1-8aca-c4c6d9e73203 None None] MFA Rules not processed for user `02767dcbd1574e08a9e82a775ac2b289`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:27:11.156731 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-a372b902-9652-44d1-8aca-c4c6d9e73203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:27:11.172248 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:11.235683 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 706/1405] 10.222.0.16 () {58 vars in 1039 bytes} [Thu May 26 12:27:11 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:27:11.245415 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea60acdf-825a-45aa-ad8b-63b58f56683c None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:11.258685 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea60acdf-825a-45aa-ad8b-63b58f56683c None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:11.264021 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97a9c5d-dc77-4322-b3d8-c11f4099a3fd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02767dcbd1574e08a9e82a775ac2b289', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:11.264728 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a9c5d-dc77-4322-b3d8-c11f4099a3fd service swift] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:11.265185 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a9c5d-dc77-4322-b3d8-c11f4099a3fd service swift] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:11.265521 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a9c5d-dc77-4322-b3d8-c11f4099a3fd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:11.273575 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97a9c5d-dc77-4322-b3d8-c11f4099a3fd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:11.275221 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97a9c5d-dc77-4322-b3d8-c11f4099a3fd service swift] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:11.284068 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 700/1406] 10.222.0.16 () {60 vars in 1384 bytes} [Thu May 26 12:27:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:27:13.283238 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78bb4cd-f2d2-4007-b181-d97a70c609be None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:13.283801 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78bb4cd-f2d2-4007-b181-d97a70c609be None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:13.283801 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78bb4cd-f2d2-4007-b181-d97a70c609be None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:13.285666 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 707/1407] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:27:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:27:13.290674 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde127f3-998b-441e-a76b-8dca1c61c493 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:13.291074 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde127f3-998b-441e-a76b-8dca1c61c493 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:13.291268 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde127f3-998b-441e-a76b-8dca1c61c493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:13.311377 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-dde127f3-998b-441e-a76b-8dca1c61c493 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:27:13.313139 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-dde127f3-998b-441e-a76b-8dca1c61c493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:27:13.322289 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 701/1408] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:27:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:27:13.366672 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78bb4cd-f2d2-4007-b181-d97a70c609be None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:13.382045 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78bb4cd-f2d2-4007-b181-d97a70c609be None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:13.387649 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363b4e0-b808-4ac5-8f12-68e5842887f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536f68ff77794352adf41aaacdc0645c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:13.388395 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363b4e0-b808-4ac5-8f12-68e5842887f6 service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:13.389281 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363b4e0-b808-4ac5-8f12-68e5842887f6 service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:13.389665 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363b4e0-b808-4ac5-8f12-68e5842887f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:13.401226 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b363b4e0-b808-4ac5-8f12-68e5842887f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:13.402822 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b363b4e0-b808-4ac5-8f12-68e5842887f6 service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:13.412851 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 708/1409] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:27:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:27:23.304720 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=87 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:23.408190 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=30 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:34.960931 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c25c1-5705-4a86-8d84-258b615e4866 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:34.961551 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c25c1-5705-4a86-8d84-258b615e4866 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:34.961551 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c25c1-5705-4a86-8d84-258b615e4866 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:34.962838 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 702/1410] 10.222.0.16 () {54 vars in 918 bytes} [Thu May 26 12:27:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:27:34.968230 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585dc1b-2405-4529-8147-681a88426e53 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:34.968661 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585dc1b-2405-4529-8147-681a88426e53 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:34.968767 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585dc1b-2405-4529-8147-681a88426e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:34.986590 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-2585dc1b-2405-4529-8147-681a88426e53 None None] MFA Rules not processed for user `4327435c97834afeb7e6806ef02349a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:27:34.987817 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-2585dc1b-2405-4529-8147-681a88426e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:27:34.996787 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 709/1411] 10.222.0.16 () {58 vars in 1015 bytes} [Thu May 26 12:27:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:27:35.011042 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b0439-807b-4e1d-8f88-edc8859187a2 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:35.011329 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b0439-807b-4e1d-8f88-edc8859187a2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:35.011605 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b0439-807b-4e1d-8f88-edc8859187a2 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:35.013573 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 703/1412] 10.222.0.16 () {54 vars in 918 bytes} [Thu May 26 12:27:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:27:35.018170 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b5475-83e8-4b93-94da-5c8c5126112c None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:35.018460 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b5475-83e8-4b93-94da-5c8c5126112c None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:35.018736 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b5475-83e8-4b93-94da-5c8c5126112c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:35.036321 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-e97b5475-83e8-4b93-94da-5c8c5126112c None None] MFA Rules not processed for user `536f68ff77794352adf41aaacdc0645c`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:27:35.037550 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-e97b5475-83e8-4b93-94da-5c8c5126112c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:27:35.046578 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 710/1413] 10.222.0.16 () {58 vars in 1015 bytes} [Thu May 26 12:27:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:27:37.719775 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980e25a-95fb-4cce-a75a-b5b5cc0c5e0e None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:37.720305 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980e25a-95fb-4cce-a75a-b5b5cc0c5e0e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:37.720417 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980e25a-95fb-4cce-a75a-b5b5cc0c5e0e None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:37.721729 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 704/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:27:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:27:37.727265 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707e993-fdb1-4ced-b7a6-b8c77769f11e None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:37.727695 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707e993-fdb1-4ced-b7a6-b8c77769f11e None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:37.727804 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707e993-fdb1-4ced-b7a6-b8c77769f11e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:37.745095 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-8707e993-fdb1-4ced-b7a6-b8c77769f11e None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:27:37.746456 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-8707e993-fdb1-4ced-b7a6-b8c77769f11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:27:37.754214 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 711/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:27:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:27:37.797814 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9980e25a-95fb-4cce-a75a-b5b5cc0c5e0e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:37.812825 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9980e25a-95fb-4cce-a75a-b5b5cc0c5e0e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:37.818247 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742cb65-b310-40cf-9486-487db4706464 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536f68ff77794352adf41aaacdc0645c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:37.818883 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742cb65-b310-40cf-9486-487db4706464 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:37.819166 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742cb65-b310-40cf-9486-487db4706464 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:37.819443 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742cb65-b310-40cf-9486-487db4706464 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:37.827998 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f742cb65-b310-40cf-9486-487db4706464 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:37.829631 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f742cb65-b310-40cf-9486-487db4706464 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:37.838837 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 705/1416] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:27:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:27:38.798071 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852180c9-26c1-4d42-aed1-bbf2617be1d9 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:38.798545 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852180c9-26c1-4d42-aed1-bbf2617be1d9 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:38.798661 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852180c9-26c1-4d42-aed1-bbf2617be1d9 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:38.800010 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 712/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 12:27:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:27:38.805012 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8228688-c1f6-4a12-b6d4-ccc013b33bbb None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:38.805419 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8228688-c1f6-4a12-b6d4-ccc013b33bbb None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:38.805571 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8228688-c1f6-4a12-b6d4-ccc013b33bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:38.823081 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-f8228688-c1f6-4a12-b6d4-ccc013b33bbb None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:27:38.824301 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f8228688-c1f6-4a12-b6d4-ccc013b33bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:27:38.832046 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 706/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 12:27:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:27:38.998132 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852180c9-26c1-4d42-aed1-bbf2617be1d9 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:39.012731 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852180c9-26c1-4d42-aed1-bbf2617be1d9 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:39.018013 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea3b86-1d22-4443-a387-1c995a8f80fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536f68ff77794352adf41aaacdc0645c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:39.018640 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea3b86-1d22-4443-a387-1c995a8f80fb service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:39.018960 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea3b86-1d22-4443-a387-1c995a8f80fb service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:39.019238 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea3b86-1d22-4443-a387-1c995a8f80fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:39.028036 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea3b86-1d22-4443-a387-1c995a8f80fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:39.029672 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea3b86-1d22-4443-a387-1c995a8f80fb service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:39.038807 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 713/1419] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:27:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:27:39.954366 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f29890-ea86-4c08-a562-9e647b06be1d None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:39.954919 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f29890-ea86-4c08-a562-9e647b06be1d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:39.954919 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f29890-ea86-4c08-a562-9e647b06be1d None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:39.956212 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 707/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 12:27:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:27:39.961388 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2faba-7376-4f72-ac01-5d88a7baf8d4 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:39.961826 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2faba-7376-4f72-ac01-5d88a7baf8d4 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:39.961922 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2faba-7376-4f72-ac01-5d88a7baf8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:39.979709 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-f3c2faba-7376-4f72-ac01-5d88a7baf8d4 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:27:39.981437 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-f3c2faba-7376-4f72-ac01-5d88a7baf8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:27:39.989042 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 714/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 12:27:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:27:40.137453 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f29890-ea86-4c08-a562-9e647b06be1d None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:40.151638 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f29890-ea86-4c08-a562-9e647b06be1d None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:40.157573 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae336f9-02ec-4a67-8f94-c7e6fe129077 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536f68ff77794352adf41aaacdc0645c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:40.158204 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae336f9-02ec-4a67-8f94-c7e6fe129077 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:40.158491 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae336f9-02ec-4a67-8f94-c7e6fe129077 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:40.158763 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae336f9-02ec-4a67-8f94-c7e6fe129077 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:40.166921 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae336f9-02ec-4a67-8f94-c7e6fe129077 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:40.169168 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae336f9-02ec-4a67-8f94-c7e6fe129077 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:40.178477 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 708/1422] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:27:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:27:41.090176 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1cac96-9eb1-42b7-887a-ad39d4a7b10f None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:41.090711 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1cac96-9eb1-42b7-887a-ad39d4a7b10f None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:41.090711 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1cac96-9eb1-42b7-887a-ad39d4a7b10f None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:41.092036 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 715/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 12:27:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:27:41.096942 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e85ec-8ef3-42af-b5ee-3f92f6ea526d None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:41.097351 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e85ec-8ef3-42af-b5ee-3f92f6ea526d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:41.097494 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e85ec-8ef3-42af-b5ee-3f92f6ea526d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:41.115236 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-3d7e85ec-8ef3-42af-b5ee-3f92f6ea526d None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:27:41.116447 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3d7e85ec-8ef3-42af-b5ee-3f92f6ea526d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:27:41.124847 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 709/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 12:27:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:27:41.275701 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1cac96-9eb1-42b7-887a-ad39d4a7b10f None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:41.289639 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1cac96-9eb1-42b7-887a-ad39d4a7b10f None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:41.295389 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0528f87-e5bd-4434-bbab-6bfe09852682 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536f68ff77794352adf41aaacdc0645c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:41.296012 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0528f87-e5bd-4434-bbab-6bfe09852682 service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:41.296293 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0528f87-e5bd-4434-bbab-6bfe09852682 service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:41.296568 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0528f87-e5bd-4434-bbab-6bfe09852682 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:41.304448 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0528f87-e5bd-4434-bbab-6bfe09852682 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:41.306045 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0528f87-e5bd-4434-bbab-6bfe09852682 service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:41.316430 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 716/1425] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:27:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:27:42.233137 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170618dc-8c4d-4fc4-8c8e-ba3101409e5d None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:42.233705 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170618dc-8c4d-4fc4-8c8e-ba3101409e5d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:42.233705 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170618dc-8c4d-4fc4-8c8e-ba3101409e5d None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:42.235068 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 710/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 12:27:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:27:42.240155 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87211a-a67a-43fb-8019-b324cae260b0 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:42.240558 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87211a-a67a-43fb-8019-b324cae260b0 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:42.240714 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87211a-a67a-43fb-8019-b324cae260b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:42.259178 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-8c87211a-a67a-43fb-8019-b324cae260b0 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:27:42.260371 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-8c87211a-a67a-43fb-8019-b324cae260b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:27:42.269293 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 717/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 12:27:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:27:42.419681 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170618dc-8c4d-4fc4-8c8e-ba3101409e5d None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:42.433896 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170618dc-8c4d-4fc4-8c8e-ba3101409e5d None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:42.439322 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a561433-1479-4ed9-abeb-9e2aff8f60ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536f68ff77794352adf41aaacdc0645c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:42.439953 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a561433-1479-4ed9-abeb-9e2aff8f60ca service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:42.440239 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a561433-1479-4ed9-abeb-9e2aff8f60ca service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:42.440515 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a561433-1479-4ed9-abeb-9e2aff8f60ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:42.448560 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a561433-1479-4ed9-abeb-9e2aff8f60ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:42.450195 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a561433-1479-4ed9-abeb-9e2aff8f60ca service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:42.459467 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 711/1428] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:27:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:27:43.306375 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc533a-a7e8-402d-88d4-91ccca28bdd2 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:43.306911 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc533a-a7e8-402d-88d4-91ccca28bdd2 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:43.306911 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc533a-a7e8-402d-88d4-91ccca28bdd2 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:43.308327 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 718/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 12:27:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:27:43.313573 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b72990-a662-4c1f-a881-83be7ddd3086 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:43.314141 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b72990-a662-4c1f-a881-83be7ddd3086 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:43.314141 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b72990-a662-4c1f-a881-83be7ddd3086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:43.331507 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-51b72990-a662-4c1f-a881-83be7ddd3086 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:27:43.332684 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-51b72990-a662-4c1f-a881-83be7ddd3086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:27:43.340999 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 712/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 12:27:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:27:43.489426 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc533a-a7e8-402d-88d4-91ccca28bdd2 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:43.504257 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc533a-a7e8-402d-88d4-91ccca28bdd2 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:43.509667 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53348c7d-d736-4121-9afe-eb61c9507219 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536f68ff77794352adf41aaacdc0645c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:43.510299 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53348c7d-d736-4121-9afe-eb61c9507219 service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:43.510586 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53348c7d-d736-4121-9afe-eb61c9507219 service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:43.510863 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53348c7d-d736-4121-9afe-eb61c9507219 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:43.519462 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53348c7d-d736-4121-9afe-eb61c9507219 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:43.521064 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53348c7d-d736-4121-9afe-eb61c9507219 service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:43.531335 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 719/1431] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:27:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:27:44.376560 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ce0e7-6a44-40ee-b60c-89daa54d66c3 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:44.377128 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ce0e7-6a44-40ee-b60c-89daa54d66c3 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:44.377128 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ce0e7-6a44-40ee-b60c-89daa54d66c3 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:44.378498 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 713/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 12:27:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:27:44.383391 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd254e-db01-4f5b-9754-1a89a3476a1f None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:44.383835 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd254e-db01-4f5b-9754-1a89a3476a1f None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:44.383940 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd254e-db01-4f5b-9754-1a89a3476a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:44.403630 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-e2fd254e-db01-4f5b-9754-1a89a3476a1f None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:27:44.404826 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-e2fd254e-db01-4f5b-9754-1a89a3476a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:27:44.412736 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 720/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 12:27:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:27:44.566634 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ce0e7-6a44-40ee-b60c-89daa54d66c3 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:44.581481 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ce0e7-6a44-40ee-b60c-89daa54d66c3 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:44.587021 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702475c-f3b7-48e2-80eb-f6bb2841818d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536f68ff77794352adf41aaacdc0645c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:44.587652 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702475c-f3b7-48e2-80eb-f6bb2841818d service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:44.587935 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702475c-f3b7-48e2-80eb-f6bb2841818d service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:44.588211 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702475c-f3b7-48e2-80eb-f6bb2841818d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:44.597088 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1702475c-f3b7-48e2-80eb-f6bb2841818d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:44.598678 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1702475c-f3b7-48e2-80eb-f6bb2841818d service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:44.608702 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 714/1434] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:27:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:27:45.451414 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bacc420-57a9-4f28-a1b7-ffd06ff65834 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:45.451982 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bacc420-57a9-4f28-a1b7-ffd06ff65834 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:45.451982 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bacc420-57a9-4f28-a1b7-ffd06ff65834 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:45.453458 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 721/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 12:27:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:27:45.458275 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76648eb-2b70-422a-8e51-94c85ba04ed4 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:45.458708 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76648eb-2b70-422a-8e51-94c85ba04ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:45.458838 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76648eb-2b70-422a-8e51-94c85ba04ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:45.477416 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a76648eb-2b70-422a-8e51-94c85ba04ed4 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:27:45.478649 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a76648eb-2b70-422a-8e51-94c85ba04ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:27:45.487099 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 715/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 12:27:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:27:45.636910 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bacc420-57a9-4f28-a1b7-ffd06ff65834 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:45.650911 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bacc420-57a9-4f28-a1b7-ffd06ff65834 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:45.656772 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c02d86a-d884-40ac-82a7-34af41f92de4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536f68ff77794352adf41aaacdc0645c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:45.657445 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02d86a-d884-40ac-82a7-34af41f92de4 service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:45.657723 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02d86a-d884-40ac-82a7-34af41f92de4 service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:45.657994 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02d86a-d884-40ac-82a7-34af41f92de4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:45.665915 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c02d86a-d884-40ac-82a7-34af41f92de4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:45.667510 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c02d86a-d884-40ac-82a7-34af41f92de4 service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:45.676768 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 722/1437] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:27:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:27:46.529720 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10f73d-19e1-4a29-b612-785a8eedda16 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:46.530321 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10f73d-19e1-4a29-b612-785a8eedda16 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:46.530321 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10f73d-19e1-4a29-b612-785a8eedda16 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:46.531736 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 716/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 12:27:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:27:46.536797 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece1f28-f2c1-46aa-aeb5-ba63706be0d5 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:46.537278 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece1f28-f2c1-46aa-aeb5-ba63706be0d5 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:46.537397 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece1f28-f2c1-46aa-aeb5-ba63706be0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:46.556320 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-1ece1f28-f2c1-46aa-aeb5-ba63706be0d5 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:27:46.557539 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-1ece1f28-f2c1-46aa-aeb5-ba63706be0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:27:46.565264 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 723/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 12:27:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:27:46.716607 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be10f73d-19e1-4a29-b612-785a8eedda16 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:46.731028 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be10f73d-19e1-4a29-b612-785a8eedda16 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:46.736470 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df51275b-43d3-433a-aea4-8ac74e16f001 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536f68ff77794352adf41aaacdc0645c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:46.737124 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51275b-43d3-433a-aea4-8ac74e16f001 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:46.737410 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51275b-43d3-433a-aea4-8ac74e16f001 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:46.737685 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51275b-43d3-433a-aea4-8ac74e16f001 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:46.745905 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df51275b-43d3-433a-aea4-8ac74e16f001 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:46.747503 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df51275b-43d3-433a-aea4-8ac74e16f001 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:46.757434 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 717/1440] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:27:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:27:48.834472 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e89af-4a03-4fb0-bd03-bfb16ee61066 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:48.835037 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e89af-4a03-4fb0-bd03-bfb16ee61066 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:48.835037 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e89af-4a03-4fb0-bd03-bfb16ee61066 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:48.836451 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 724/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:27:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:27:48.842300 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4c4cc-c5b6-41cf-bf9a-90f7f60c2366 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:48.842713 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4c4cc-c5b6-41cf-bf9a-90f7f60c2366 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:48.842880 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4c4cc-c5b6-41cf-bf9a-90f7f60c2366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:48.861457 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-0bb4c4cc-c5b6-41cf-bf9a-90f7f60c2366 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:27:48.862641 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0bb4c4cc-c5b6-41cf-bf9a-90f7f60c2366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:27:48.870339 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 718/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:27:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:27:48.908125 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e89af-4a03-4fb0-bd03-bfb16ee61066 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:48.919268 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e89af-4a03-4fb0-bd03-bfb16ee61066 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:48.922778 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7704bf-05c1-48d3-a0da-78ba331f1c31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:48.923406 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7704bf-05c1-48d3-a0da-78ba331f1c31 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:48.923692 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7704bf-05c1-48d3-a0da-78ba331f1c31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:48.923966 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7704bf-05c1-48d3-a0da-78ba331f1c31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:48.932699 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7704bf-05c1-48d3-a0da-78ba331f1c31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:48.934793 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7704bf-05c1-48d3-a0da-78ba331f1c31 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:48.944274 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 725/1443] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:27:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:27:51.309334 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804f59a-b92a-4398-917f-47d5733e4113 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:51.309848 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804f59a-b92a-4398-917f-47d5733e4113 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:51.309848 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804f59a-b92a-4398-917f-47d5733e4113 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:51.311177 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 719/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:27:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:27:51.316717 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528e788-dd7d-4432-947d-72dbdbb6429c None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:51.317171 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528e788-dd7d-4432-947d-72dbdbb6429c None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:51.317337 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528e788-dd7d-4432-947d-72dbdbb6429c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:51.335709 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-9528e788-dd7d-4432-947d-72dbdbb6429c None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:27:51.336939 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-9528e788-dd7d-4432-947d-72dbdbb6429c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:27:51.344704 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 726/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:27:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:27:51.382241 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804f59a-b92a-4398-917f-47d5733e4113 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:51.393369 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804f59a-b92a-4398-917f-47d5733e4113 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:51.396897 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3add6767-6cca-45d3-b934-bbd37d7c96ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:51.397530 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add6767-6cca-45d3-b934-bbd37d7c96ac service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:51.397816 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add6767-6cca-45d3-b934-bbd37d7c96ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:51.398093 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add6767-6cca-45d3-b934-bbd37d7c96ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:51.406890 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3add6767-6cca-45d3-b934-bbd37d7c96ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:51.408327 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3add6767-6cca-45d3-b934-bbd37d7c96ac service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:51.417625 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 720/1446] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:27:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:27:53.916668 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e0482-11e0-4b04-a0ac-b339cb2e6ef0 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:53.917403 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e0482-11e0-4b04-a0ac-b339cb2e6ef0 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:53.917403 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e0482-11e0-4b04-a0ac-b339cb2e6ef0 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:53.918674 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 727/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:27:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:27:53.924045 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda59f2-12e1-4c14-9f8f-7e63d77dd9da None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:53.924419 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda59f2-12e1-4c14-9f8f-7e63d77dd9da None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:53.924607 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda59f2-12e1-4c14-9f8f-7e63d77dd9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:53.941900 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-6dda59f2-12e1-4c14-9f8f-7e63d77dd9da None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:27:53.943100 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6dda59f2-12e1-4c14-9f8f-7e63d77dd9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:27:53.951948 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 721/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:27:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:27:53.990301 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233e0482-11e0-4b04-a0ac-b339cb2e6ef0 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:54.000782 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233e0482-11e0-4b04-a0ac-b339cb2e6ef0 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:54.004268 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2db08b-c122-4294-b2ba-8943a508b4ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:54.004929 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2db08b-c122-4294-b2ba-8943a508b4ce service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:54.005216 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2db08b-c122-4294-b2ba-8943a508b4ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:54.005491 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2db08b-c122-4294-b2ba-8943a508b4ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:54.014791 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2db08b-c122-4294-b2ba-8943a508b4ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:54.016206 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2db08b-c122-4294-b2ba-8943a508b4ce service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:54.025438 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 728/1449] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:27:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:27:56.385932 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd962f-7f40-4c9d-b968-9c4f2b88e7a0 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:56.386585 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd962f-7f40-4c9d-b968-9c4f2b88e7a0 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:56.386585 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd962f-7f40-4c9d-b968-9c4f2b88e7a0 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:56.387902 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 722/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:27:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:27:56.393166 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88420986-d8e3-4e7f-9d7d-2aa558034b1d None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:56.393605 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88420986-d8e3-4e7f-9d7d-2aa558034b1d None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:56.393710 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88420986-d8e3-4e7f-9d7d-2aa558034b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:56.411144 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-88420986-d8e3-4e7f-9d7d-2aa558034b1d None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:27:56.412332 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-88420986-d8e3-4e7f-9d7d-2aa558034b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:27:56.420675 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 729/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:27:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:27:56.458703 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd962f-7f40-4c9d-b968-9c4f2b88e7a0 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:56.469287 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd962f-7f40-4c9d-b968-9c4f2b88e7a0 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:56.472754 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272dfed3-6ac8-48e4-88e8-af189709387c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:56.473409 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272dfed3-6ac8-48e4-88e8-af189709387c service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:56.473691 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272dfed3-6ac8-48e4-88e8-af189709387c service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:56.473967 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272dfed3-6ac8-48e4-88e8-af189709387c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:56.483381 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272dfed3-6ac8-48e4-88e8-af189709387c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:56.484812 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272dfed3-6ac8-48e4-88e8-af189709387c service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:56.494080 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 723/1452] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:27:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:27:58.769208 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8c875-c94d-426c-9583-08b7a0bcca29 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:58.769705 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8c875-c94d-426c-9583-08b7a0bcca29 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:58.769810 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8c875-c94d-426c-9583-08b7a0bcca29 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:58.771137 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 730/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:27:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:27:58.777192 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6de279-2426-46b3-9bd0-79ea817bad32 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:58.777631 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6de279-2426-46b3-9bd0-79ea817bad32 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:58.777815 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6de279-2426-46b3-9bd0-79ea817bad32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:58.795107 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-fa6de279-2426-46b3-9bd0-79ea817bad32 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:27:58.796341 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-fa6de279-2426-46b3-9bd0-79ea817bad32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:27:58.804122 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 724/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:27:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:27:58.841924 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a8c875-c94d-426c-9583-08b7a0bcca29 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:58.853073 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a8c875-c94d-426c-9583-08b7a0bcca29 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:58.856513 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eeda93-3472-40c4-b18d-bbf444c7fc8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:58.857172 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eeda93-3472-40c4-b18d-bbf444c7fc8b service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:58.857457 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eeda93-3472-40c4-b18d-bbf444c7fc8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:58.857802 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eeda93-3472-40c4-b18d-bbf444c7fc8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:58.866466 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eeda93-3472-40c4-b18d-bbf444c7fc8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:58.867876 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eeda93-3472-40c4-b18d-bbf444c7fc8b service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:58.877519 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 731/1455] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:27:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:28:01.107274 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8fa2a-ed43-4bbb-8268-c72256cbe1b0 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:01.107837 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8fa2a-ed43-4bbb-8268-c72256cbe1b0 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:01.107837 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8fa2a-ed43-4bbb-8268-c72256cbe1b0 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:01.109144 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 725/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:28:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:28:01.114676 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10314d0e-18ce-4354-800d-53a0d1e93a57 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:01.115133 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10314d0e-18ce-4354-800d-53a0d1e93a57 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:01.115263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10314d0e-18ce-4354-800d-53a0d1e93a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:01.133246 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-10314d0e-18ce-4354-800d-53a0d1e93a57 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:28:01.134560 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-10314d0e-18ce-4354-800d-53a0d1e93a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:28:01.143106 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 732/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:28:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:28:01.180200 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba8fa2a-ed43-4bbb-8268-c72256cbe1b0 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:28:01.191264 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba8fa2a-ed43-4bbb-8268-c72256cbe1b0 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:28:01.194740 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81120735-cc50-4b67-a0a3-feebfcfe85d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:28:01.195371 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81120735-cc50-4b67-a0a3-feebfcfe85d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:01.195654 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81120735-cc50-4b67-a0a3-feebfcfe85d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:01.195926 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81120735-cc50-4b67-a0a3-feebfcfe85d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:01.205279 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81120735-cc50-4b67-a0a3-feebfcfe85d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:28:01.206715 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81120735-cc50-4b67-a0a3-feebfcfe85d4 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:28:01.216028 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 726/1458] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:28:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:28:03.493071 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87d737-9f7a-4a9f-8e10-42f2fc159c68 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:03.493649 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87d737-9f7a-4a9f-8e10-42f2fc159c68 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:03.493649 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87d737-9f7a-4a9f-8e10-42f2fc159c68 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:03.494992 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 733/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:28:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:28:03.500352 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06047b63-689a-4abc-8f52-eb2469ebcea6 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:03.500742 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06047b63-689a-4abc-8f52-eb2469ebcea6 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:03.500925 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06047b63-689a-4abc-8f52-eb2469ebcea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:03.506831 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=70 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:28:03.519233 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-06047b63-689a-4abc-8f52-eb2469ebcea6 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:28:03.520414 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-06047b63-689a-4abc-8f52-eb2469ebcea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:28:03.529421 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 727/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:28:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:28:03.565599 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d87d737-9f7a-4a9f-8e10-42f2fc159c68 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:28:03.570924 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=73 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:28:03.577266 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d87d737-9f7a-4a9f-8e10-42f2fc159c68 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:28:03.580793 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f3f1c-e2b3-4377-980e-5d389f33fa39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:28:03.581457 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f3f1c-e2b3-4377-980e-5d389f33fa39 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:03.581741 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f3f1c-e2b3-4377-980e-5d389f33fa39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:03.582015 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f3f1c-e2b3-4377-980e-5d389f33fa39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:03.591406 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7f3f1c-e2b3-4377-980e-5d389f33fa39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:28:03.592853 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7f3f1c-e2b3-4377-980e-5d389f33fa39 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:28:03.602539 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 734/1461] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:28:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:28:05.857682 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87d4c4-92ab-4ff7-8b6c-83ab52f9bf3d None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:05.858246 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87d4c4-92ab-4ff7-8b6c-83ab52f9bf3d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:05.858246 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87d4c4-92ab-4ff7-8b6c-83ab52f9bf3d None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:05.859608 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 728/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:28:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:28:05.864792 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f344106-7836-43cf-abf8-b77bcaefd110 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:05.865231 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f344106-7836-43cf-abf8-b77bcaefd110 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:05.865385 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f344106-7836-43cf-abf8-b77bcaefd110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:05.883306 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-2f344106-7836-43cf-abf8-b77bcaefd110 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:28:05.884496 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-2f344106-7836-43cf-abf8-b77bcaefd110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:28:05.893177 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 735/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:28:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:28:05.930100 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87d4c4-92ab-4ff7-8b6c-83ab52f9bf3d None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:28:05.941359 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87d4c4-92ab-4ff7-8b6c-83ab52f9bf3d None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:28:05.944928 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9e5f1d-78b5-46d1-8265-87c7277466a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:28:05.945561 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e5f1d-78b5-46d1-8265-87c7277466a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:05.945847 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e5f1d-78b5-46d1-8265-87c7277466a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:05.946124 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e5f1d-78b5-46d1-8265-87c7277466a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:05.954950 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9e5f1d-78b5-46d1-8265-87c7277466a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:28:05.956383 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9e5f1d-78b5-46d1-8265-87c7277466a1 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:28:05.965879 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 729/1464] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:28:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:28:08.180132 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1235181-4015-41e4-b384-a9f5d9f2aede None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:08.180677 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1235181-4015-41e4-b384-a9f5d9f2aede None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:08.180677 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1235181-4015-41e4-b384-a9f5d9f2aede None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:08.182683 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 736/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:28:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:28:08.187898 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160591a-32d6-450e-9796-78c85ab6c6bc None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:08.188300 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160591a-32d6-450e-9796-78c85ab6c6bc None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:08.188477 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160591a-32d6-450e-9796-78c85ab6c6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:08.206151 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-3160591a-32d6-450e-9796-78c85ab6c6bc None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:28:08.207342 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3160591a-32d6-450e-9796-78c85ab6c6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:28:08.215110 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 730/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:28:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:28:08.251832 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1235181-4015-41e4-b384-a9f5d9f2aede None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:28:08.262405 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1235181-4015-41e4-b384-a9f5d9f2aede None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:28:08.265953 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d862a6-ba1b-4f22-b59f-36292bbe95d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:28:08.266577 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d862a6-ba1b-4f22-b59f-36292bbe95d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:08.266859 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d862a6-ba1b-4f22-b59f-36292bbe95d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:08.267134 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d862a6-ba1b-4f22-b59f-36292bbe95d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:08.275847 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d862a6-ba1b-4f22-b59f-36292bbe95d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:28:08.277305 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d862a6-ba1b-4f22-b59f-36292bbe95d4 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:28:08.286479 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 737/1467] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:28:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:28:10.528475 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a6362-22e3-4804-ba41-9d26a9864853 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:10.529077 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a6362-22e3-4804-ba41-9d26a9864853 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:10.529178 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a6362-22e3-4804-ba41-9d26a9864853 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:10.530742 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 731/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:28:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:28:10.536244 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80141f-01a5-4054-9815-0e26dccb2f3b None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:10.536661 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80141f-01a5-4054-9815-0e26dccb2f3b None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:10.536797 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80141f-01a5-4054-9815-0e26dccb2f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:10.554714 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-2d80141f-01a5-4054-9815-0e26dccb2f3b None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:28:10.555916 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-2d80141f-01a5-4054-9815-0e26dccb2f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:28:10.564296 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 738/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:28:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:28:10.601031 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a6362-22e3-4804-ba41-9d26a9864853 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:28:10.612956 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a6362-22e3-4804-ba41-9d26a9864853 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:28:10.616552 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c222e1a-6b42-4b29-a734-a1bab647d212 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:28:10.617272 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c222e1a-6b42-4b29-a734-a1bab647d212 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:10.617595 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c222e1a-6b42-4b29-a734-a1bab647d212 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:10.617989 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c222e1a-6b42-4b29-a734-a1bab647d212 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:10.627775 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c222e1a-6b42-4b29-a734-a1bab647d212 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:28:10.629259 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c222e1a-6b42-4b29-a734-a1bab647d212 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:28:10.639101 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 732/1470] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:28:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:28:20.549627 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=17 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:28:20.634458 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=17 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:28:43.547314 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b901d-4ba5-422f-8975-6b767cab0371 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:43.547914 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b901d-4ba5-422f-8975-6b767cab0371 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:43.547914 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b901d-4ba5-422f-8975-6b767cab0371 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:43.549265 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 739/1471] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:28:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:28:43.554362 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb64f8-2b03-4fa8-a0fd-daab755bea22 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:43.554790 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb64f8-2b03-4fa8-a0fd-daab755bea22 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:43.554929 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb64f8-2b03-4fa8-a0fd-daab755bea22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:43.573167 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-7efb64f8-2b03-4fa8-a0fd-daab755bea22 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:28:43.574369 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7efb64f8-2b03-4fa8-a0fd-daab755bea22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:28:43.582255 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 733/1472] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:28:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:28:43.629758 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f8009-02c3-460b-9352-f59798f6a037 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:43.630069 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f8009-02c3-460b-9352-f59798f6a037 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:43.630345 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f8009-02c3-460b-9352-f59798f6a037 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:43.631693 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 740/1473] 10.222.0.16 () {54 vars in 962 bytes} [Thu May 26 12:28:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:28:43.636488 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7f00e-4ab4-4914-826f-45ff5f106439 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:43.636782 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7f00e-4ab4-4914-826f-45ff5f106439 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:43.637094 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7f00e-4ab4-4914-826f-45ff5f106439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:43.654721 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-06a7f00e-4ab4-4914-826f-45ff5f106439 None None] MFA Rules not processed for user `ad8cfccd3a4d42d381ce62ea90849f19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:28:43.655956 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-06a7f00e-4ab4-4914-826f-45ff5f106439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:28:43.662456 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 734/1474] 10.222.0.16 () {58 vars in 1059 bytes} [Thu May 26 12:28:43 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:28:43.670272 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f8009-02c3-460b-9352-f59798f6a037 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:28:43.680817 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f8009-02c3-460b-9352-f59798f6a037 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:28:43.684814 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0a694-b3bd-4d20-bb0e-29d6fdefb88c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad8cfccd3a4d42d381ce62ea90849f19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:28:43.685463 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0a694-b3bd-4d20-bb0e-29d6fdefb88c service glance] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:43.685748 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0a694-b3bd-4d20-bb0e-29d6fdefb88c service glance] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:43.686028 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0a694-b3bd-4d20-bb0e-29d6fdefb88c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:43.694769 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde0a694-b3bd-4d20-bb0e-29d6fdefb88c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:28:43.696183 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde0a694-b3bd-4d20-bb0e-29d6fdefb88c service glance] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:28:43.705411 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 741/1475] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:28:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:28:45.990873 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78502a-0501-4eb2-ae4c-f24f16b57762 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:45.991497 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78502a-0501-4eb2-ae4c-f24f16b57762 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:45.991497 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78502a-0501-4eb2-ae4c-f24f16b57762 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:45.992703 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 735/1476] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:28:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:28:45.997828 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f3525-2b70-410a-b1e3-b2ef83e2b8c1 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:45.998271 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f3525-2b70-410a-b1e3-b2ef83e2b8c1 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:45.998384 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f3525-2b70-410a-b1e3-b2ef83e2b8c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:46.016257 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-a41f3525-2b70-410a-b1e3-b2ef83e2b8c1 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:28:46.017545 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-a41f3525-2b70-410a-b1e3-b2ef83e2b8c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:28:46.025872 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 742/1477] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:28:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:28:46.048576 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78502a-0501-4eb2-ae4c-f24f16b57762 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:28:46.061321 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78502a-0501-4eb2-ae4c-f24f16b57762 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:28:46.065683 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da8015-fe52-4974-896a-865dc02e5ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:28:46.066313 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da8015-fe52-4974-896a-865dc02e5ccd admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:46.066591 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da8015-fe52-4974-896a-865dc02e5ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:46.066861 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da8015-fe52-4974-896a-865dc02e5ccd admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:46.067584 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da8015-fe52-4974-896a-865dc02e5ccd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:28:46.069386 dv-cinder-815146-11-smb devstack@keystone.service[80181]: WARNING py.warnings [None req-53da8015-fe52-4974-896a-865dc02e5ccd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 12:28:46.069386 dv-cinder-815146-11-smb devstack@keystone.service[80181]: warnings.warn(msg) May 26 12:28:46.069386 dv-cinder-815146-11-smb devstack@keystone.service[80181]: May 26 12:28:46.070581 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da8015-fe52-4974-896a-865dc02e5ccd admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:28:46.090983 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 736/1478] 10.222.0.16 () {56 vars in 1108 bytes} [Thu May 26 12:28:46 2022] GET /identity/v3/projects => generated 2553 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:28:48.318189 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c6329-7ae5-4de5-bb1e-8864e8854964 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:48.318785 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c6329-7ae5-4de5-bb1e-8864e8854964 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:48.318785 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c6329-7ae5-4de5-bb1e-8864e8854964 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:48.320124 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 743/1479] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:28:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:28:48.326024 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3942fbc-321e-4a3a-ac6b-4e1421d83d5d None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:48.326681 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3942fbc-321e-4a3a-ac6b-4e1421d83d5d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:48.327476 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3942fbc-321e-4a3a-ac6b-4e1421d83d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:48.344956 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c3942fbc-321e-4a3a-ac6b-4e1421d83d5d None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:28:48.346155 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c3942fbc-321e-4a3a-ac6b-4e1421d83d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:28:48.354205 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 737/1480] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:28:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:28:48.398331 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8c6329-7ae5-4de5-bb1e-8864e8854964 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:28:48.412758 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8c6329-7ae5-4de5-bb1e-8864e8854964 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:28:48.418242 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e2ca2-68e1-4d75-b933-da6a5e7a705c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536f68ff77794352adf41aaacdc0645c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:28:48.418864 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e2ca2-68e1-4d75-b933-da6a5e7a705c service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:48.419238 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e2ca2-68e1-4d75-b933-da6a5e7a705c service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:48.419517 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e2ca2-68e1-4d75-b933-da6a5e7a705c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:48.428341 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945e2ca2-68e1-4d75-b933-da6a5e7a705c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:28:48.430823 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945e2ca2-68e1-4d75-b933-da6a5e7a705c service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:28:48.441491 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 744/1481] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:28:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:28:50.816915 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b725b-1d10-4cf4-8796-2a6f27b6420f None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:50.817474 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b725b-1d10-4cf4-8796-2a6f27b6420f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:50.817474 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b725b-1d10-4cf4-8796-2a6f27b6420f None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:50.818878 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 738/1482] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:28:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:28:50.824721 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0eaff9-3d97-4c37-a110-d63120ee91f6 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:50.825153 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0eaff9-3d97-4c37-a110-d63120ee91f6 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:50.825310 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0eaff9-3d97-4c37-a110-d63120ee91f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:50.842802 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-7d0eaff9-3d97-4c37-a110-d63120ee91f6 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:28:50.843979 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-7d0eaff9-3d97-4c37-a110-d63120ee91f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:28:50.851925 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 745/1483] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:28:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:28:50.888505 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b725b-1d10-4cf4-8796-2a6f27b6420f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:28:50.899164 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b725b-1d10-4cf4-8796-2a6f27b6420f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:28:50.902742 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029cbb91-8700-4ccc-b3ab-b095cbfaa9f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:28:50.903373 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029cbb91-8700-4ccc-b3ab-b095cbfaa9f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:50.903655 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029cbb91-8700-4ccc-b3ab-b095cbfaa9f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:50.903928 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029cbb91-8700-4ccc-b3ab-b095cbfaa9f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:50.912861 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029cbb91-8700-4ccc-b3ab-b095cbfaa9f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:28:50.914850 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029cbb91-8700-4ccc-b3ab-b095cbfaa9f0 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:28:50.924257 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 739/1484] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:28:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:28:53.171054 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f0acf-0e8b-4f47-9019-756e18943cc9 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:53.171564 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f0acf-0e8b-4f47-9019-756e18943cc9 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:53.171663 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f0acf-0e8b-4f47-9019-756e18943cc9 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:53.173133 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 746/1485] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:28:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:28:53.178263 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7b2bd-1219-4713-9dcd-49937f19fb2a None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:53.178706 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7b2bd-1219-4713-9dcd-49937f19fb2a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:53.178811 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7b2bd-1219-4713-9dcd-49937f19fb2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:53.196921 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-10c7b2bd-1219-4713-9dcd-49937f19fb2a None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:28:53.198118 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-10c7b2bd-1219-4713-9dcd-49937f19fb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:28:53.205929 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 740/1486] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:28:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:28:53.244044 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19f0acf-0e8b-4f47-9019-756e18943cc9 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:28:53.254627 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19f0acf-0e8b-4f47-9019-756e18943cc9 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:28:53.258125 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b27be-c67d-490e-a0e6-4151101cbd0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:28:53.258755 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b27be-c67d-490e-a0e6-4151101cbd0b service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:53.259038 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b27be-c67d-490e-a0e6-4151101cbd0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:53.259315 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b27be-c67d-490e-a0e6-4151101cbd0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:53.268015 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199b27be-c67d-490e-a0e6-4151101cbd0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:28:53.269493 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199b27be-c67d-490e-a0e6-4151101cbd0b service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:28:53.278725 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 747/1487] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:28:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:28:55.565890 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0495483b-63e9-4a47-82fc-e950c969e606 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:55.566450 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0495483b-63e9-4a47-82fc-e950c969e606 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:55.566450 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0495483b-63e9-4a47-82fc-e950c969e606 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:55.567881 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 741/1488] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:28:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:28:55.573782 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81dd659-9c32-4b1b-bc27-d590d6c3f743 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:55.574209 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81dd659-9c32-4b1b-bc27-d590d6c3f743 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:55.574348 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81dd659-9c32-4b1b-bc27-d590d6c3f743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:55.592431 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-c81dd659-9c32-4b1b-bc27-d590d6c3f743 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:28:55.593653 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-c81dd659-9c32-4b1b-bc27-d590d6c3f743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:28:55.601750 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 748/1489] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:28:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:28:55.641808 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0495483b-63e9-4a47-82fc-e950c969e606 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:28:55.653413 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0495483b-63e9-4a47-82fc-e950c969e606 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:28:55.656973 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68369589-f0b4-4104-a56e-c611fb1b6ac2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:28:55.657608 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68369589-f0b4-4104-a56e-c611fb1b6ac2 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:55.657905 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68369589-f0b4-4104-a56e-c611fb1b6ac2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:55.658161 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68369589-f0b4-4104-a56e-c611fb1b6ac2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:55.667165 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68369589-f0b4-4104-a56e-c611fb1b6ac2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:28:55.668592 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68369589-f0b4-4104-a56e-c611fb1b6ac2 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:28:55.678217 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 742/1490] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:28:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:28:58.104719 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf809b-dc48-42fd-bae3-ee180c97a980 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:58.105328 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf809b-dc48-42fd-bae3-ee180c97a980 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:58.105328 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf809b-dc48-42fd-bae3-ee180c97a980 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:58.106627 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 749/1491] 10.222.0.16 () {54 vars in 926 bytes} [Thu May 26 12:28:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:28:58.111938 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5abc8-34d2-41a2-a178-2bea06c6358c None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:58.112372 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5abc8-34d2-41a2-a178-2bea06c6358c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:58.112479 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5abc8-34d2-41a2-a178-2bea06c6358c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:58.130460 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-17e5abc8-34d2-41a2-a178-2bea06c6358c None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:28:58.131648 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-17e5abc8-34d2-41a2-a178-2bea06c6358c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:28:58.140262 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 743/1492] 10.222.0.16 () {58 vars in 1023 bytes} [Thu May 26 12:28:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:28:58.181817 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf809b-dc48-42fd-bae3-ee180c97a980 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:28:58.192497 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf809b-dc48-42fd-bae3-ee180c97a980 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:28:58.196656 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97e2c2c-c3cd-4286-86de-d984ce0591f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:28:58.197316 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e2c2c-c3cd-4286-86de-d984ce0591f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:58.197603 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e2c2c-c3cd-4286-86de-d984ce0591f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:58.197879 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e2c2c-c3cd-4286-86de-d984ce0591f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:58.206678 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97e2c2c-c3cd-4286-86de-d984ce0591f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:28:58.208106 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97e2c2c-c3cd-4286-86de-d984ce0591f2 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:28:58.217500 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 750/1493] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:28:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:29:08.125376 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=33 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:08.213260 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=33 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:30:37.243940 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b6987-1672-49ff-9eaa-8f3c5e332b4a None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:37.244519 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b6987-1672-49ff-9eaa-8f3c5e332b4a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:37.244519 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b6987-1672-49ff-9eaa-8f3c5e332b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:37.261978 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-881b6987-1672-49ff-9eaa-8f3c5e332b4a None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:30:37.263154 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-881b6987-1672-49ff-9eaa-8f3c5e332b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:30:37.270783 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 744/1494] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:30:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:30:37.280008 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ebc78-3a65-421d-8a49-f0ab651ab068 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:37.280511 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ebc78-3a65-421d-8a49-f0ab651ab068 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:37.280625 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ebc78-3a65-421d-8a49-f0ab651ab068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:37.301281 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-e81ebc78-3a65-421d-8a49-f0ab651ab068 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:30:37.303142 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-e81ebc78-3a65-421d-8a49-f0ab651ab068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:30:37.310875 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 751/1495] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:30:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:30:37.315371 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b6987-1672-49ff-9eaa-8f3c5e332b4a None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:30:37.324847 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b6987-1672-49ff-9eaa-8f3c5e332b4a None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:30:37.329469 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49334e9d-b005-4b42-9903-a0ce6cd89f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:30:37.330153 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49334e9d-b005-4b42-9903-a0ce6cd89f71 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:37.330434 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49334e9d-b005-4b42-9903-a0ce6cd89f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:37.330708 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49334e9d-b005-4b42-9903-a0ce6cd89f71 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:37.331436 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49334e9d-b005-4b42-9903-a0ce6cd89f71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:30:37.331742 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49334e9d-b005-4b42-9903-a0ce6cd89f71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:30:37.332775 dv-cinder-815146-11-smb devstack@keystone.service[80181]: WARNING py.warnings [None req-49334e9d-b005-4b42-9903-a0ce6cd89f71 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 12:30:37.332775 dv-cinder-815146-11-smb devstack@keystone.service[80181]: warnings.warn(msg) May 26 12:30:37.332775 dv-cinder-815146-11-smb devstack@keystone.service[80181]: May 26 12:30:37.333749 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49334e9d-b005-4b42-9903-a0ce6cd89f71 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:30:37.345168 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 745/1496] 10.222.0.16 () {58 vars in 1152 bytes} [Thu May 26 12:30:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:30:37.354177 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ebc78-3a65-421d-8a49-f0ab651ab068 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:30:37.363196 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ebc78-3a65-421d-8a49-f0ab651ab068 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:30:37.368282 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a95e82-936a-4537-be55-11c1fd8b1ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:30:37.368951 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a95e82-936a-4537-be55-11c1fd8b1ce8 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:37.369232 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a95e82-936a-4537-be55-11c1fd8b1ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:37.369504 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a95e82-936a-4537-be55-11c1fd8b1ce8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:37.370190 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a95e82-936a-4537-be55-11c1fd8b1ce8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:30:37.371948 dv-cinder-815146-11-smb devstack@keystone.service[80180]: WARNING py.warnings [None req-f6a95e82-936a-4537-be55-11c1fd8b1ce8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 12:30:37.371948 dv-cinder-815146-11-smb devstack@keystone.service[80180]: warnings.warn(msg) May 26 12:30:37.371948 dv-cinder-815146-11-smb devstack@keystone.service[80180]: May 26 12:30:37.373161 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a95e82-936a-4537-be55-11c1fd8b1ce8 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:30:37.409726 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 752/1497] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:30:37 2022] POST /identity/v3/projects => generated 379 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:30:37.414656 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49334e9d-b005-4b42-9903-a0ce6cd89f71 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:30:37.424528 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49334e9d-b005-4b42-9903-a0ce6cd89f71 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:30:37.479245 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b115973-d829-49e7-90f0-0d605d08f1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:30:37.479912 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b115973-d829-49e7-90f0-0d605d08f1c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:37.480223 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b115973-d829-49e7-90f0-0d605d08f1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:37.480503 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b115973-d829-49e7-90f0-0d605d08f1c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:37.481246 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b115973-d829-49e7-90f0-0d605d08f1c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:30:37.482267 dv-cinder-815146-11-smb devstack@keystone.service[80181]: WARNING py.warnings [None req-3b115973-d829-49e7-90f0-0d605d08f1c0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 12:30:37.482267 dv-cinder-815146-11-smb devstack@keystone.service[80181]: warnings.warn(msg) May 26 12:30:37.482267 dv-cinder-815146-11-smb devstack@keystone.service[80181]: May 26 12:30:37.483522 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b115973-d829-49e7-90f0-0d605d08f1c0 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:30:37.502786 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 746/1498] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:30:37 2022] POST /identity/v3/users => generated 290 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:30:37.506928 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a95e82-936a-4537-be55-11c1fd8b1ce8 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:30:37.517203 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a95e82-936a-4537-be55-11c1fd8b1ce8 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:30:37.522253 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec0de1-a175-4831-a411-b990017ebe1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:30:37.523409 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec0de1-a175-4831-a411-b990017ebe1d admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:37.523697 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec0de1-a175-4831-a411-b990017ebe1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:37.523979 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec0de1-a175-4831-a411-b990017ebe1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:37.524709 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ec0de1-a175-4831-a411-b990017ebe1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:30:37.525768 dv-cinder-815146-11-smb devstack@keystone.service[80180]: WARNING py.warnings [None req-89ec0de1-a175-4831-a411-b990017ebe1d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 12:30:37.525768 dv-cinder-815146-11-smb devstack@keystone.service[80180]: warnings.warn(msg) May 26 12:30:37.525768 dv-cinder-815146-11-smb devstack@keystone.service[80180]: May 26 12:30:37.526650 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ec0de1-a175-4831-a411-b990017ebe1d admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:30:37.540904 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 753/1499] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:30:37.544880 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b115973-d829-49e7-90f0-0d605d08f1c0 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:30:37.554759 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b115973-d829-49e7-90f0-0d605d08f1c0 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:30:37.559256 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cfbb67-5edb-4d1c-a14e-ebaeb645b2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:30:37.559905 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cfbb67-5edb-4d1c-a14e-ebaeb645b2d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:37.560187 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cfbb67-5edb-4d1c-a14e-ebaeb645b2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:37.560459 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cfbb67-5edb-4d1c-a14e-ebaeb645b2d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:37.561222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cfbb67-5edb-4d1c-a14e-ebaeb645b2d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:30:37.562236 dv-cinder-815146-11-smb devstack@keystone.service[80181]: WARNING py.warnings [None req-d1cfbb67-5edb-4d1c-a14e-ebaeb645b2d2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 12:30:37.562236 dv-cinder-815146-11-smb devstack@keystone.service[80181]: warnings.warn(msg) May 26 12:30:37.562236 dv-cinder-815146-11-smb devstack@keystone.service[80181]: May 26 12:30:37.563123 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cfbb67-5edb-4d1c-a14e-ebaeb645b2d2 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:30:37.576181 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 747/1500] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:30:37.580097 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec0de1-a175-4831-a411-b990017ebe1d admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:30:37.590905 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec0de1-a175-4831-a411-b990017ebe1d admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:30:37.595524 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566f903b-a26c-4e61-8da6-9bac1b8d2cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:30:37.596417 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f903b-a26c-4e61-8da6-9bac1b8d2cc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:37.596681 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f903b-a26c-4e61-8da6-9bac1b8d2cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:37.597005 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f903b-a26c-4e61-8da6-9bac1b8d2cc1 admin admin] PATH_INFO: `/v3/projects/40eb9c42e5ea4181bf76d77dd75a1107/users/988f4e83fc504d6d9feb0eb5caba2807/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:37.613377 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566f903b-a26c-4e61-8da6-9bac1b8d2cc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40eb9c42e5ea4181bf76d77dd75a1107, user_id=988f4e83fc504d6d9feb0eb5caba2807, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:30:37.614409 dv-cinder-815146-11-smb devstack@keystone.service[80180]: WARNING py.warnings [None req-566f903b-a26c-4e61-8da6-9bac1b8d2cc1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 12:30:37.614409 dv-cinder-815146-11-smb devstack@keystone.service[80180]: warnings.warn(msg) May 26 12:30:37.614409 dv-cinder-815146-11-smb devstack@keystone.service[80180]: May 26 12:30:37.616934 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566f903b-a26c-4e61-8da6-9bac1b8d2cc1 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:30:37.629749 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 754/1501] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:30:37 2022] PUT /identity/v3/projects/40eb9c42e5ea4181bf76d77dd75a1107/users/988f4e83fc504d6d9feb0eb5caba2807/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:30:37.641725 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b316ec9-af2d-4dfb-92a7-743e1177e125 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:37.642018 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b316ec9-af2d-4dfb-92a7-743e1177e125 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:37.642298 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b316ec9-af2d-4dfb-92a7-743e1177e125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:37.667415 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-0b316ec9-af2d-4dfb-92a7-743e1177e125 None None] MFA Rules not processed for user `988f4e83fc504d6d9feb0eb5caba2807`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:30:37.668612 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0b316ec9-af2d-4dfb-92a7-743e1177e125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:30:37.731831 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 748/1502] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:30:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:30:37.745708 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60afcb6a-665e-4a1a-900a-715e817eceb2 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:37.746019 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60afcb6a-665e-4a1a-900a-715e817eceb2 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:37.746301 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60afcb6a-665e-4a1a-900a-715e817eceb2 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:37.747712 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 755/1503] 10.222.0.16 () {54 vars in 963 bytes} [Thu May 26 12:30:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:30:37.752870 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cbb938-cd04-4f4b-be49-1ade761dafce None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:37.753122 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cbb938-cd04-4f4b-be49-1ade761dafce None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:37.753412 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cbb938-cd04-4f4b-be49-1ade761dafce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:37.771713 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c2cbb938-cd04-4f4b-be49-1ade761dafce None None] MFA Rules not processed for user `736554efeba94a0b9547d18c3fc84fec`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:30:37.772925 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c2cbb938-cd04-4f4b-be49-1ade761dafce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:30:37.816573 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:30:37.825178 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 749/1504] 10.222.0.16 () {58 vars in 1060 bytes} [Thu May 26 12:30:37 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:30:37.833016 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60afcb6a-665e-4a1a-900a-715e817eceb2 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:30:37.843454 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60afcb6a-665e-4a1a-900a-715e817eceb2 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:30:37.847166 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37393f-944a-4dc2-aa34-6461aa037aa7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:30:37.847797 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37393f-944a-4dc2-aa34-6461aa037aa7 service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:37.848084 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37393f-944a-4dc2-aa34-6461aa037aa7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:37.848358 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37393f-944a-4dc2-aa34-6461aa037aa7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:37.857727 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b37393f-944a-4dc2-aa34-6461aa037aa7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:30:37.859142 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b37393f-944a-4dc2-aa34-6461aa037aa7 service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:30:37.868451 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 756/1505] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:30:37 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:30:37.909125 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d0631-3ef9-4f04-97ad-03d41e0b88e4 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:37.909418 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d0631-3ef9-4f04-97ad-03d41e0b88e4 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:37.909700 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d0631-3ef9-4f04-97ad-03d41e0b88e4 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:37.911008 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 750/1506] 10.222.0.16 () {52 vars in 829 bytes} [Thu May 26 12:30:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:30:37.915022 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37393f-944a-4dc2-aa34-6461aa037aa7 service cinder] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:30:37.976260 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37393f-944a-4dc2-aa34-6461aa037aa7 service cinder] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:30:37.980783 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e75957-5608-4bee-9823-d5a1c0e3b8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:30:37.981680 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e75957-5608-4bee-9823-d5a1c0e3b8f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:37.981964 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e75957-5608-4bee-9823-d5a1c0e3b8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:37.982241 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e75957-5608-4bee-9823-d5a1c0e3b8f4 admin admin] PATH_INFO: `/v3/users/988f4e83fc504d6d9feb0eb5caba2807` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:37.983422 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e75957-5608-4bee-9823-d5a1c0e3b8f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=988f4e83fc504d6d9feb0eb5caba2807)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:30:37.984430 dv-cinder-815146-11-smb devstack@keystone.service[80180]: WARNING py.warnings [None req-42e75957-5608-4bee-9823-d5a1c0e3b8f4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 12:30:37.984430 dv-cinder-815146-11-smb devstack@keystone.service[80180]: warnings.warn(msg) May 26 12:30:37.984430 dv-cinder-815146-11-smb devstack@keystone.service[80180]: May 26 12:30:37.985737 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e75957-5608-4bee-9823-d5a1c0e3b8f4 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:30:38.049396 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-42e75957-5608-4bee-9823-d5a1c0e3b8f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '988f4e83fc504d6d9feb0eb5caba2807'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:30:38.050631 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-42e75957-5608-4bee-9823-d5a1c0e3b8f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '988f4e83fc504d6d9feb0eb5caba2807'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:30:38.051345 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-42e75957-5608-4bee-9823-d5a1c0e3b8f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '988f4e83fc504d6d9feb0eb5caba2807'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:30:38.061669 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-42e75957-5608-4bee-9823-d5a1c0e3b8f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '988f4e83fc504d6d9feb0eb5caba2807'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:30:38.079211 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-42e75957-5608-4bee-9823-d5a1c0e3b8f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '988f4e83fc504d6d9feb0eb5caba2807'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:30:38.087882 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:30:38.100147 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 757/1507] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:30:37 2022] DELETE /identity/v3/users/988f4e83fc504d6d9feb0eb5caba2807 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:30:38.104888 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc1739-1482-4dd6-aebb-5a3fa81b3208 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:38.105209 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc1739-1482-4dd6-aebb-5a3fa81b3208 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:38.105490 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc1739-1482-4dd6-aebb-5a3fa81b3208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:38.122660 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-0adc1739-1482-4dd6-aebb-5a3fa81b3208 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:30:38.123852 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0adc1739-1482-4dd6-aebb-5a3fa81b3208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:30:38.184664 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 751/1508] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:30:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:30:38.199461 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e75957-5608-4bee-9823-d5a1c0e3b8f4 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:30:38.200919 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-42e75957-5608-4bee-9823-d5a1c0e3b8f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:30:38.265188 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e75957-5608-4bee-9823-d5a1c0e3b8f4 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:30:38.269155 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a2752f-bf41-420b-b412-bde1a0d362a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:30:38.269810 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2752f-bf41-420b-b412-bde1a0d362a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:38.270097 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2752f-bf41-420b-b412-bde1a0d362a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:38.270376 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2752f-bf41-420b-b412-bde1a0d362a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:38.280335 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a2752f-bf41-420b-b412-bde1a0d362a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:30:38.281809 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a2752f-bf41-420b-b412-bde1a0d362a4 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:30:38.294419 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 758/1509] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:30:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:30:38.633105 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adc1739-1482-4dd6-aebb-5a3fa81b3208 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:30:38.634663 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0adc1739-1482-4dd6-aebb-5a3fa81b3208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:30:38.647255 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adc1739-1482-4dd6-aebb-5a3fa81b3208 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:30:38.651817 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd29483a-598f-4651-ba74-c4caee4d543e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:30:38.652710 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29483a-598f-4651-ba74-c4caee4d543e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:38.653038 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29483a-598f-4651-ba74-c4caee4d543e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:38.653313 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29483a-598f-4651-ba74-c4caee4d543e admin admin] PATH_INFO: `/v3/projects/40eb9c42e5ea4181bf76d77dd75a1107` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:38.654485 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd29483a-598f-4651-ba74-c4caee4d543e admin admin] RBAC: Authorizing `identity:delete_project(project_id=40eb9c42e5ea4181bf76d77dd75a1107)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:30:38.655541 dv-cinder-815146-11-smb devstack@keystone.service[80181]: WARNING py.warnings [None req-fd29483a-598f-4651-ba74-c4caee4d543e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 12:30:38.655541 dv-cinder-815146-11-smb devstack@keystone.service[80181]: warnings.warn(msg) May 26 12:30:38.655541 dv-cinder-815146-11-smb devstack@keystone.service[80181]: May 26 12:30:38.656735 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd29483a-598f-4651-ba74-c4caee4d543e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:30:38.716582 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fd29483a-598f-4651-ba74-c4caee4d543e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40eb9c42e5ea4181bf76d77dd75a1107', 'request_id': 'req-fd29483a-598f-4651-ba74-c4caee4d543e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:30:38.722440 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fd29483a-598f-4651-ba74-c4caee4d543e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40eb9c42e5ea4181bf76d77dd75a1107', 'request_id': 'req-fd29483a-598f-4651-ba74-c4caee4d543e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:30:38.736119 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fd29483a-598f-4651-ba74-c4caee4d543e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40eb9c42e5ea4181bf76d77dd75a1107', 'request_id': 'req-fd29483a-598f-4651-ba74-c4caee4d543e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:30:38.751754 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fd29483a-598f-4651-ba74-c4caee4d543e admin admin] The token cache is being invalidate because project 40eb9c42e5ea4181bf76d77dd75a1107 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:30:38.752043 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fd29483a-598f-4651-ba74-c4caee4d543e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:30:38.752689 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fd29483a-598f-4651-ba74-c4caee4d543e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:30:38.754457 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 752/1510] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:30:38 2022] DELETE /identity/v3/projects/40eb9c42e5ea4181bf76d77dd75a1107 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:30:48.287387 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=29 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:30:48.748829 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:29.341525 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f54242-7123-4878-92a2-8c1962a2dfd3 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:29.342120 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f54242-7123-4878-92a2-8c1962a2dfd3 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:29.342120 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f54242-7123-4878-92a2-8c1962a2dfd3 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:29.343476 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 759/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 12:32:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:32:29.348363 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f63d1e-7dee-4485-8ac1-22bd66b6be98 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:29.348793 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f63d1e-7dee-4485-8ac1-22bd66b6be98 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:29.348967 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f63d1e-7dee-4485-8ac1-22bd66b6be98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:29.367828 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d1f63d1e-7dee-4485-8ac1-22bd66b6be98 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:29.369077 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d1f63d1e-7dee-4485-8ac1-22bd66b6be98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:29.426679 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 753/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 12:32:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:29.595824 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f54242-7123-4878-92a2-8c1962a2dfd3 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:29.597487 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-47f54242-7123-4878-92a2-8c1962a2dfd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:29.670207 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f54242-7123-4878-92a2-8c1962a2dfd3 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:29.675454 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6535489-9262-4b72-9c88-a2c19e413de2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536f68ff77794352adf41aaacdc0645c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:29.676079 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6535489-9262-4b72-9c88-a2c19e413de2 service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:29.676358 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6535489-9262-4b72-9c88-a2c19e413de2 service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:29.676660 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6535489-9262-4b72-9c88-a2c19e413de2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:29.685173 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6535489-9262-4b72-9c88-a2c19e413de2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:29.686752 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6535489-9262-4b72-9c88-a2c19e413de2 service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:29.695903 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 760/1513] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:32:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:32:30.371908 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608b0d8-3472-4945-8aa6-a74c84df3c2e None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:30.372476 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608b0d8-3472-4945-8aa6-a74c84df3c2e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:30.372476 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608b0d8-3472-4945-8aa6-a74c84df3c2e None None] PATH_INFO: `/v3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:30.373799 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 754/1514] 10.222.0.73 () {54 vars in 925 bytes} [Thu May 26 12:32:30 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:32:30.380312 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265462e3-30c2-4598-af28-70de22353e24 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:30.380784 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265462e3-30c2-4598-af28-70de22353e24 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:30.380908 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265462e3-30c2-4598-af28-70de22353e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:30.398981 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-265462e3-30c2-4598-af28-70de22353e24 None None] MFA Rules not processed for user `4327435c97834afeb7e6806ef02349a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:30.400195 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-265462e3-30c2-4598-af28-70de22353e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:30.462613 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 761/1515] 10.222.0.73 () {58 vars in 1015 bytes} [Thu May 26 12:32:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:32:30.582141 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61dd00b-1c3d-453a-944e-b6cedaa2d8f8 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:30.582454 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61dd00b-1c3d-453a-944e-b6cedaa2d8f8 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:30.582734 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61dd00b-1c3d-453a-944e-b6cedaa2d8f8 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:30.584117 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 755/1516] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 12:32:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:32:30.589566 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91254a60-5e6a-40aa-9ae6-afabf456c7a0 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:30.589855 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91254a60-5e6a-40aa-9ae6-afabf456c7a0 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:30.590132 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91254a60-5e6a-40aa-9ae6-afabf456c7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:30.608489 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-91254a60-5e6a-40aa-9ae6-afabf456c7a0 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:30.609734 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-91254a60-5e6a-40aa-9ae6-afabf456c7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:30.617568 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 762/1517] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 12:32:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:30.774573 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61dd00b-1c3d-453a-944e-b6cedaa2d8f8 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:30.789429 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61dd00b-1c3d-453a-944e-b6cedaa2d8f8 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:30.794965 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e13708f-c477-412b-b350-895bae7c58b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536f68ff77794352adf41aaacdc0645c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:30.795598 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e13708f-c477-412b-b350-895bae7c58b5 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:30.795881 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e13708f-c477-412b-b350-895bae7c58b5 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:30.796157 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e13708f-c477-412b-b350-895bae7c58b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:30.804547 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e13708f-c477-412b-b350-895bae7c58b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:30.806253 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e13708f-c477-412b-b350-895bae7c58b5 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:30.815784 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 756/1518] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:32:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:32:39.441041 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ac12e-8cf9-4c21-8a60-61e6a2088784 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:39.441587 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ac12e-8cf9-4c21-8a60-61e6a2088784 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:39.441587 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ac12e-8cf9-4c21-8a60-61e6a2088784 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:39.442891 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 763/1519] 10.222.0.16 () {54 vars in 960 bytes} [Thu May 26 12:32:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:32:39.447815 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c03a80-37b1-4afc-b4fb-19db9c1134cf None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:39.448216 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c03a80-37b1-4afc-b4fb-19db9c1134cf None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:39.448371 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c03a80-37b1-4afc-b4fb-19db9c1134cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:39.466587 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d4c03a80-37b1-4afc-b4fb-19db9c1134cf None None] MFA Rules not processed for user `4327435c97834afeb7e6806ef02349a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:39.467786 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d4c03a80-37b1-4afc-b4fb-19db9c1134cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:39.476175 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 757/1520] 10.222.0.16 () {58 vars in 1057 bytes} [Thu May 26 12:32:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:39.484313 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01ac12e-8cf9-4c21-8a60-61e6a2088784 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:39.497947 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01ac12e-8cf9-4c21-8a60-61e6a2088784 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:39.503420 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e27af-a365-4bcb-bbd1-bc35e262d50f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4327435c97834afeb7e6806ef02349a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:39.504039 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e27af-a365-4bcb-bbd1-bc35e262d50f service placement] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:39.504326 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e27af-a365-4bcb-bbd1-bc35e262d50f service placement] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:39.504599 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e27af-a365-4bcb-bbd1-bc35e262d50f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:39.512859 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8e27af-a365-4bcb-bbd1-bc35e262d50f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:39.514450 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8e27af-a365-4bcb-bbd1-bc35e262d50f service placement] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:39.523833 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 764/1521] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:32:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:32:42.050176 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be955115-f76c-43f3-b86a-192c1da37220 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:42.050691 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be955115-f76c-43f3-b86a-192c1da37220 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:42.050691 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be955115-f76c-43f3-b86a-192c1da37220 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:42.052011 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 758/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 12:32:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:32:42.056925 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61522e74-09ef-4c77-97c8-857ef9872188 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:42.057349 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61522e74-09ef-4c77-97c8-857ef9872188 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:42.057491 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61522e74-09ef-4c77-97c8-857ef9872188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:42.078393 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-61522e74-09ef-4c77-97c8-857ef9872188 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:42.079620 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-61522e74-09ef-4c77-97c8-857ef9872188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:42.087416 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 765/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 12:32:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:42.243669 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be955115-f76c-43f3-b86a-192c1da37220 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:42.258421 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be955115-f76c-43f3-b86a-192c1da37220 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:42.263756 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f8e95c-efe5-4e21-b810-29f4067dcc81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536f68ff77794352adf41aaacdc0645c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:42.265008 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8e95c-efe5-4e21-b810-29f4067dcc81 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:42.265293 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8e95c-efe5-4e21-b810-29f4067dcc81 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:42.265565 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8e95c-efe5-4e21-b810-29f4067dcc81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:42.273548 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f8e95c-efe5-4e21-b810-29f4067dcc81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:42.275151 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f8e95c-efe5-4e21-b810-29f4067dcc81 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:42.284431 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 759/1524] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:32:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:32:43.157745 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab7beb-459e-4abd-82e3-bc37f981f2a1 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:43.158301 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab7beb-459e-4abd-82e3-bc37f981f2a1 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:43.158301 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab7beb-459e-4abd-82e3-bc37f981f2a1 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:43.159699 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 766/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 12:32:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:32:43.164433 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e2513-3af4-4d02-9037-05a1104b53ef None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:43.164874 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e2513-3af4-4d02-9037-05a1104b53ef None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:43.165034 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e2513-3af4-4d02-9037-05a1104b53ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:43.183203 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-f32e2513-3af4-4d02-9037-05a1104b53ef None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:43.184391 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f32e2513-3af4-4d02-9037-05a1104b53ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:43.192223 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 760/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 12:32:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:43.344003 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab7beb-459e-4abd-82e3-bc37f981f2a1 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:43.358606 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab7beb-459e-4abd-82e3-bc37f981f2a1 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:43.364033 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b7a94-4c57-4625-a458-57fa286f240b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536f68ff77794352adf41aaacdc0645c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:43.364668 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b7a94-4c57-4625-a458-57fa286f240b service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:43.364996 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b7a94-4c57-4625-a458-57fa286f240b service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:43.365279 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b7a94-4c57-4625-a458-57fa286f240b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:43.373431 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5b7a94-4c57-4625-a458-57fa286f240b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:43.375039 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5b7a94-4c57-4625-a458-57fa286f240b service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:43.384335 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 767/1527] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:32:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:32:47.426190 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2ad19-3b86-4133-bcee-3dd45ab57b89 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:47.426752 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2ad19-3b86-4133-bcee-3dd45ab57b89 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:47.426752 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2ad19-3b86-4133-bcee-3dd45ab57b89 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:47.428101 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 761/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:32:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:32:47.433489 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a7c8d-1925-448b-b798-6fbe5c9fc32f None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:47.433919 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a7c8d-1925-448b-b798-6fbe5c9fc32f None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:47.434049 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a7c8d-1925-448b-b798-6fbe5c9fc32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:47.451760 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-967a7c8d-1925-448b-b798-6fbe5c9fc32f None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:47.452978 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-967a7c8d-1925-448b-b798-6fbe5c9fc32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:47.461645 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 768/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:32:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:47.498365 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc2ad19-3b86-4133-bcee-3dd45ab57b89 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:47.500027 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-fbc2ad19-3b86-4133-bcee-3dd45ab57b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:47.555927 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc2ad19-3b86-4133-bcee-3dd45ab57b89 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:47.559611 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1eacca-efb6-4906-9833-bb5993c93fbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:47.560232 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1eacca-efb6-4906-9833-bb5993c93fbf service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:47.560510 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1eacca-efb6-4906-9833-bb5993c93fbf service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:47.560811 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1eacca-efb6-4906-9833-bb5993c93fbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:47.570113 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1eacca-efb6-4906-9833-bb5993c93fbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:47.571567 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1eacca-efb6-4906-9833-bb5993c93fbf service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:47.580972 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 762/1530] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:32:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:32:49.779803 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a9a4a-f148-4920-aeb2-cb1b55c8470f None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:49.780392 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a9a4a-f148-4920-aeb2-cb1b55c8470f None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:49.780392 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a9a4a-f148-4920-aeb2-cb1b55c8470f None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:49.781778 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 769/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:32:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:32:49.787037 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dbbe54-5f82-4360-b525-87d4b769713f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:49.787453 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dbbe54-5f82-4360-b525-87d4b769713f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:49.787634 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dbbe54-5f82-4360-b525-87d4b769713f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:49.805664 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c6dbbe54-5f82-4360-b525-87d4b769713f None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:49.806874 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c6dbbe54-5f82-4360-b525-87d4b769713f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:49.815218 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 763/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:32:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:49.850946 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a9a4a-f148-4920-aeb2-cb1b55c8470f None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:49.862376 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a9a4a-f148-4920-aeb2-cb1b55c8470f None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:49.865958 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee312eab-da5d-499b-81b0-6c80a781a2ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:49.866590 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee312eab-da5d-499b-81b0-6c80a781a2ab service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:49.866872 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee312eab-da5d-499b-81b0-6c80a781a2ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:49.867147 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee312eab-da5d-499b-81b0-6c80a781a2ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:49.876635 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee312eab-da5d-499b-81b0-6c80a781a2ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:49.878082 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee312eab-da5d-499b-81b0-6c80a781a2ab service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:49.887447 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 770/1533] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:32:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:32:53.831175 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3946f05-8147-4cbe-9905-9651e7ae01a6 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:53.831731 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3946f05-8147-4cbe-9905-9651e7ae01a6 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:53.831850 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3946f05-8147-4cbe-9905-9651e7ae01a6 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:53.833329 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 764/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:32:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:32:53.838544 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0902b2ed-c7bd-4888-8556-d7743cd5255c None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:53.838938 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0902b2ed-c7bd-4888-8556-d7743cd5255c None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:53.839103 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0902b2ed-c7bd-4888-8556-d7743cd5255c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:53.857280 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-0902b2ed-c7bd-4888-8556-d7743cd5255c None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:53.859029 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-0902b2ed-c7bd-4888-8556-d7743cd5255c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:53.867515 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 771/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:32:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:54.144739 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3946f05-8147-4cbe-9905-9651e7ae01a6 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:54.146492 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d3946f05-8147-4cbe-9905-9651e7ae01a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:54.203968 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3946f05-8147-4cbe-9905-9651e7ae01a6 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:54.207542 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40225824-d989-4f29-91df-607a2b447ed3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:54.208189 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40225824-d989-4f29-91df-607a2b447ed3 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:54.208473 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40225824-d989-4f29-91df-607a2b447ed3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:54.208752 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40225824-d989-4f29-91df-607a2b447ed3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:54.218391 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40225824-d989-4f29-91df-607a2b447ed3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:54.219847 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40225824-d989-4f29-91df-607a2b447ed3 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:54.224913 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:54.230982 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 765/1536] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:32:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:32:56.498536 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99b68e-8245-4928-91db-8faba92f29fc None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:56.499146 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99b68e-8245-4928-91db-8faba92f29fc None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:56.499146 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99b68e-8245-4928-91db-8faba92f29fc None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:56.500571 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 772/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:32:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:32:56.506884 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2187ffc-c6fa-4fc7-912f-a7c10687e1ea None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:56.507319 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2187ffc-c6fa-4fc7-912f-a7c10687e1ea None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:56.507778 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2187ffc-c6fa-4fc7-912f-a7c10687e1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:56.530723 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a2187ffc-c6fa-4fc7-912f-a7c10687e1ea None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:56.532313 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a2187ffc-c6fa-4fc7-912f-a7c10687e1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:56.543447 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 766/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:32:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:56.825794 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae99b68e-8245-4928-91db-8faba92f29fc None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:56.828017 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-ae99b68e-8245-4928-91db-8faba92f29fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:56.841432 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae99b68e-8245-4928-91db-8faba92f29fc None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:56.845555 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4b5170-1554-45a9-8cc3-26c31d8d6515 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:56.846195 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b5170-1554-45a9-8cc3-26c31d8d6515 service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:56.846478 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b5170-1554-45a9-8cc3-26c31d8d6515 service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:56.846786 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b5170-1554-45a9-8cc3-26c31d8d6515 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:56.856405 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4b5170-1554-45a9-8cc3-26c31d8d6515 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:56.858069 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4b5170-1554-45a9-8cc3-26c31d8d6515 service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:56.869513 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 773/1539] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:32:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:33:06.525092 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:33:06.865271 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:37.664769 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df3958-ea0e-483f-8e66-44f770301770 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:37.665480 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df3958-ea0e-483f-8e66-44f770301770 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:37.665480 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df3958-ea0e-483f-8e66-44f770301770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:37.698880 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-52df3958-ea0e-483f-8e66-44f770301770 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:37.700502 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-52df3958-ea0e-483f-8e66-44f770301770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:37.716166 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 767/1540] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:34:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:37.726481 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8853ad-aee1-4abe-8f56-21fd9b0a7062 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:37.727073 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8853ad-aee1-4abe-8f56-21fd9b0a7062 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:37.727073 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8853ad-aee1-4abe-8f56-21fd9b0a7062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:37.760196 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-0d8853ad-aee1-4abe-8f56-21fd9b0a7062 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:37.764393 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-0d8853ad-aee1-4abe-8f56-21fd9b0a7062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:37.778571 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 774/1541] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:34:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:34:37.783387 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df3958-ea0e-483f-8e66-44f770301770 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:37.785979 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdca564-a52c-44f1-9209-b46b7b7a141a None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:37.786270 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdca564-a52c-44f1-9209-b46b7b7a141a None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:37.786553 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdca564-a52c-44f1-9209-b46b7b7a141a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:37.795329 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df3958-ea0e-483f-8e66-44f770301770 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:37.814218 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-4cdca564-a52c-44f1-9209-b46b7b7a141a None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:37.815447 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-4cdca564-a52c-44f1-9209-b46b7b7a141a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:37.819028 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8c2d0f-de65-472c-a6e5-aee0d3ebb683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:37.819707 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c2d0f-de65-472c-a6e5-aee0d3ebb683 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:37.819985 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c2d0f-de65-472c-a6e5-aee0d3ebb683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:37.820258 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c2d0f-de65-472c-a6e5-aee0d3ebb683 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:37.821021 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8c2d0f-de65-472c-a6e5-aee0d3ebb683 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:34:37.821328 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8c2d0f-de65-472c-a6e5-aee0d3ebb683 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:37.822977 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8c2d0f-de65-472c-a6e5-aee0d3ebb683 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:37.843407 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 775/1542] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:34:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:34:37.852589 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 768/1543] 10.222.0.16 () {58 vars in 1152 bytes} [Thu May 26 12:34:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:34:37.861738 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdca564-a52c-44f1-9209-b46b7b7a141a None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:37.878231 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdca564-a52c-44f1-9209-b46b7b7a141a None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:37.884075 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e72902-d792-438f-afba-0a5ccdd96723 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:37.884428 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e72902-d792-438f-afba-0a5ccdd96723 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:37.884651 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e72902-d792-438f-afba-0a5ccdd96723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:37.896189 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ac13d-d2b6-4872-a8c4-2396729b92ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:37.898070 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ac13d-d2b6-4872-a8c4-2396729b92ff admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:37.898356 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ac13d-d2b6-4872-a8c4-2396729b92ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:37.898633 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ac13d-d2b6-4872-a8c4-2396729b92ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:37.899370 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74ac13d-d2b6-4872-a8c4-2396729b92ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:37.901355 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74ac13d-d2b6-4872-a8c4-2396729b92ff admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:37.921910 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-26e72902-d792-438f-afba-0a5ccdd96723 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:37.923128 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-26e72902-d792-438f-afba-0a5ccdd96723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:37.946789 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 769/1544] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:34:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:34:37.952404 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e72902-d792-438f-afba-0a5ccdd96723 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:37.971956 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 776/1545] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:34:37 2022] POST /identity/v3/projects => generated 379 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:34:37.974917 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e72902-d792-438f-afba-0a5ccdd96723 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:37.976232 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ac13d-d2b6-4872-a8c4-2396729b92ff admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:38.088180 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ac13d-d2b6-4872-a8c4-2396729b92ff admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:38.098241 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f093b7d1-1198-42ba-9ebd-dc67a4865a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:38.100477 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f093b7d1-1198-42ba-9ebd-dc67a4865a4c admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:38.101571 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f093b7d1-1198-42ba-9ebd-dc67a4865a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:38.102532 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f093b7d1-1198-42ba-9ebd-dc67a4865a4c admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:38.103927 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f093b7d1-1198-42ba-9ebd-dc67a4865a4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:38.108352 dv-cinder-815146-11-smb devstack@keystone.service[80180]: WARNING py.warnings [None req-f093b7d1-1198-42ba-9ebd-dc67a4865a4c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 12:34:38.108352 dv-cinder-815146-11-smb devstack@keystone.service[80180]: warnings.warn(msg) May 26 12:34:38.108352 dv-cinder-815146-11-smb devstack@keystone.service[80180]: May 26 12:34:38.110635 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d4ed95-633a-4d7d-a539-5e54698b6e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:38.112339 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f093b7d1-1198-42ba-9ebd-dc67a4865a4c admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:38.113409 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4ed95-633a-4d7d-a539-5e54698b6e6d admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:38.115202 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4ed95-633a-4d7d-a539-5e54698b6e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:38.115708 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4ed95-633a-4d7d-a539-5e54698b6e6d admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:38.116692 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d4ed95-633a-4d7d-a539-5e54698b6e6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:34:38.120035 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d4ed95-633a-4d7d-a539-5e54698b6e6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:38.122790 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d4ed95-633a-4d7d-a539-5e54698b6e6d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:38.151973 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 770/1546] 10.222.0.16 () {58 vars in 1152 bytes} [Thu May 26 12:34:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:34:38.165659 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b1eaa-1bed-4ce8-bee0-3370e18e6050 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:38.166497 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b1eaa-1bed-4ce8-bee0-3370e18e6050 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:38.168567 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b1eaa-1bed-4ce8-bee0-3370e18e6050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:38.173578 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 777/1547] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:34:37 2022] POST /identity/v3/users => generated 290 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:34:38.175376 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f093b7d1-1198-42ba-9ebd-dc67a4865a4c admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:38.205890 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f093b7d1-1198-42ba-9ebd-dc67a4865a4c admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:38.222793 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-e84b1eaa-1bed-4ce8-bee0-3370e18e6050 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:38.223811 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4d6c2-1447-4da4-afd3-734531233058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:38.224812 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4d6c2-1447-4da4-afd3-734531233058 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:38.225331 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4d6c2-1447-4da4-afd3-734531233058 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:38.225853 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4d6c2-1447-4da4-afd3-734531233058 admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:38.227968 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f4d6c2-1447-4da4-afd3-734531233058 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:38.229998 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e84b1eaa-1bed-4ce8-bee0-3370e18e6050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:38.237442 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f4d6c2-1447-4da4-afd3-734531233058 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:38.263201 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 771/1548] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:34:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:38.265096 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3cbf58-13b9-48c3-a6e4-ac7e12dcb156 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:38.265621 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3cbf58-13b9-48c3-a6e4-ac7e12dcb156 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:38.266147 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3cbf58-13b9-48c3-a6e4-ac7e12dcb156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:38.293909 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-ec3cbf58-13b9-48c3-a6e4-ac7e12dcb156 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:38.296091 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ec3cbf58-13b9-48c3-a6e4-ac7e12dcb156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:38.303972 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 778/1549] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:34:38 2022] POST /identity/v3/projects => generated 387 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:34:38.305127 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 772/1550] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:34:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:38.305364 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4d6c2-1447-4da4-afd3-734531233058 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:38.310355 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625bf1c3-c192-4891-9fa6-a265bdcda3ea None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:38.310355 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625bf1c3-c192-4891-9fa6-a265bdcda3ea None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:38.310355 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625bf1c3-c192-4891-9fa6-a265bdcda3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:38.326751 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-625bf1c3-c192-4891-9fa6-a265bdcda3ea None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:38.327958 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-625bf1c3-c192-4891-9fa6-a265bdcda3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:38.373197 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4d6c2-1447-4da4-afd3-734531233058 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:38.378017 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b620fdee-1867-438c-adbc-34cc2b90898c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:38.378684 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b620fdee-1867-438c-adbc-34cc2b90898c admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:38.378977 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b620fdee-1867-438c-adbc-34cc2b90898c admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:38.379257 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b620fdee-1867-438c-adbc-34cc2b90898c admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:38.379989 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b620fdee-1867-438c-adbc-34cc2b90898c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:38.381649 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b620fdee-1867-438c-adbc-34cc2b90898c admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:38.387412 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 773/1551] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:34:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:38.388735 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a33e7-687e-4023-b01d-4c53a0a313ac None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:38.389062 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a33e7-687e-4023-b01d-4c53a0a313ac None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:38.389339 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a33e7-687e-4023-b01d-4c53a0a313ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:38.398304 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 779/1552] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:34:38.398304 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed57782-a037-4144-a9b7-80f7387d4ed5 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:38.398304 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed57782-a037-4144-a9b7-80f7387d4ed5 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:38.398304 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed57782-a037-4144-a9b7-80f7387d4ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:38.407537 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-007a33e7-687e-4023-b01d-4c53a0a313ac None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:38.408732 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-007a33e7-687e-4023-b01d-4c53a0a313ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:38.416093 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-eed57782-a037-4144-a9b7-80f7387d4ed5 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:38.416620 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 774/1553] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:34:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:38.417898 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a0f7e-b07d-4343-a1ce-7aacf8c7dd7b None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:38.418182 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a0f7e-b07d-4343-a1ce-7aacf8c7dd7b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:38.418458 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a0f7e-b07d-4343-a1ce-7aacf8c7dd7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:38.421532 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-eed57782-a037-4144-a9b7-80f7387d4ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:38.431847 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 780/1554] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:34:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:38.433623 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed57782-a037-4144-a9b7-80f7387d4ed5 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:38.436793 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a33a0f7e-b07d-4343-a1ce-7aacf8c7dd7b None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:38.438029 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a33a0f7e-b07d-4343-a1ce-7aacf8c7dd7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:38.443994 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed57782-a037-4144-a9b7-80f7387d4ed5 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:38.446624 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 775/1555] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:34:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:38.447943 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f111dc-0623-493d-b528-117ae74a53fe None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:38.448273 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f111dc-0623-493d-b528-117ae74a53fe None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:38.448500 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f111dc-0623-493d-b528-117ae74a53fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:38.448954 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f9321-9803-438b-8cb1-425c67cf2f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:38.449681 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f9321-9803-438b-8cb1-425c67cf2f48 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:38.450028 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f9321-9803-438b-8cb1-425c67cf2f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:38.450368 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f9321-9803-438b-8cb1-425c67cf2f48 admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:38.451068 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366f9321-9803-438b-8cb1-425c67cf2f48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:38.453029 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366f9321-9803-438b-8cb1-425c67cf2f48 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:38.472105 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-92f111dc-0623-493d-b528-117ae74a53fe None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:38.473326 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-92f111dc-0623-493d-b528-117ae74a53fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:38.474033 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 781/1556] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:34:38 2022] POST /identity/v3/users => generated 294 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:34:38.475303 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2036c-5186-48eb-9731-adf51d8a0f55 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:38.475586 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2036c-5186-48eb-9731-adf51d8a0f55 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:38.475869 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2036c-5186-48eb-9731-adf51d8a0f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:38.484299 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:38.486315 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 776/1557] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:34:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:38.487254 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f111dc-0623-493d-b528-117ae74a53fe None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:38.495759 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-c8d2036c-5186-48eb-9731-adf51d8a0f55 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:38.497433 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f111dc-0623-493d-b528-117ae74a53fe None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:38.497788 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-c8d2036c-5186-48eb-9731-adf51d8a0f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:38.502644 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a408ad-b42b-4516-a31a-762f9185a959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:38.503352 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a408ad-b42b-4516-a31a-762f9185a959 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:38.503636 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a408ad-b42b-4516-a31a-762f9185a959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:38.503910 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a408ad-b42b-4516-a31a-762f9185a959 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:38.504629 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a408ad-b42b-4516-a31a-762f9185a959 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:34:38.504966 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a408ad-b42b-4516-a31a-762f9185a959 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:38.506508 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 782/1558] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:34:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:38.510274 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a408ad-b42b-4516-a31a-762f9185a959 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:38.510396 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2036c-5186-48eb-9731-adf51d8a0f55 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:38.516731 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2036c-5186-48eb-9731-adf51d8a0f55 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:38.519089 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 777/1559] 10.222.0.16 () {58 vars in 1152 bytes} [Thu May 26 12:34:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:34:38.520404 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5bf87-ac57-4db7-a255-d9b64b98fe39 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:38.520713 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5bf87-ac57-4db7-a255-d9b64b98fe39 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:38.521002 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5bf87-ac57-4db7-a255-d9b64b98fe39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:38.521468 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64ba7b-ee4a-48ad-a674-ebe768236d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:38.522120 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64ba7b-ee4a-48ad-a674-ebe768236d12 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:38.522405 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64ba7b-ee4a-48ad-a674-ebe768236d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:38.522679 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64ba7b-ee4a-48ad-a674-ebe768236d12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:38.523403 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64ba7b-ee4a-48ad-a674-ebe768236d12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:38.525044 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64ba7b-ee4a-48ad-a674-ebe768236d12 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:38.539231 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 783/1560] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:34:38.539231 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c3ea9-8147-4249-b047-9c5a9f0d2c11 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:38.539231 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c3ea9-8147-4249-b047-9c5a9f0d2c11 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:38.539231 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c3ea9-8147-4249-b047-9c5a9f0d2c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:38.543254 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-71d5bf87-ac57-4db7-a255-d9b64b98fe39 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:38.544458 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-71d5bf87-ac57-4db7-a255-d9b64b98fe39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:38.556335 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 778/1561] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:34:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:38.556335 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cde2b6-8aa6-4a68-a50d-23793abc7b2f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:38.556335 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cde2b6-8aa6-4a68-a50d-23793abc7b2f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:38.556335 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cde2b6-8aa6-4a68-a50d-23793abc7b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:38.556796 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-f34c3ea9-8147-4249-b047-9c5a9f0d2c11 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:38.557769 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-f34c3ea9-8147-4249-b047-9c5a9f0d2c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:38.565797 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 784/1562] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:34:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:38.566581 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34c3ea9-8147-4249-b047-9c5a9f0d2c11 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:38.576198 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34c3ea9-8147-4249-b047-9c5a9f0d2c11 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:38.576727 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-e4cde2b6-8aa6-4a68-a50d-23793abc7b2f None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:38.577972 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e4cde2b6-8aa6-4a68-a50d-23793abc7b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:38.580713 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d2d55-4a9b-4106-b824-a8b1d16b0db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:38.581404 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d2d55-4a9b-4106-b824-a8b1d16b0db4 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:38.581687 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d2d55-4a9b-4106-b824-a8b1d16b0db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:38.581962 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d2d55-4a9b-4106-b824-a8b1d16b0db4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:38.582686 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624d2d55-4a9b-4106-b824-a8b1d16b0db4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:38.584262 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624d2d55-4a9b-4106-b824-a8b1d16b0db4 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:38.585962 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 779/1563] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:34:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:38.587247 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a31ba-70c4-437e-9db2-b87efdd20851 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:38.587540 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a31ba-70c4-437e-9db2-b87efdd20851 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:38.587820 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a31ba-70c4-437e-9db2-b87efdd20851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:38.595139 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 785/1564] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:34:38.595815 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d2d55-4a9b-4106-b824-a8b1d16b0db4 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:38.605303 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d2d55-4a9b-4106-b824-a8b1d16b0db4 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:38.610789 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-ba2a31ba-70c4-437e-9db2-b87efdd20851 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:38.610934 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70b65f7-2c27-4159-ab26-64cb0736b64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:38.611561 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b65f7-2c27-4159-ab26-64cb0736b64f admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:38.611979 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ba2a31ba-70c4-437e-9db2-b87efdd20851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:38.612219 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b65f7-2c27-4159-ab26-64cb0736b64f admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:38.612505 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b65f7-2c27-4159-ab26-64cb0736b64f admin admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:38.613258 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70b65f7-2c27-4159-ab26-64cb0736b64f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:34:38.613568 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70b65f7-2c27-4159-ab26-64cb0736b64f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:38.614607 dv-cinder-815146-11-smb devstack@keystone.service[80180]: WARNING py.warnings [None req-d70b65f7-2c27-4159-ab26-64cb0736b64f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 12:34:38.614607 dv-cinder-815146-11-smb devstack@keystone.service[80180]: warnings.warn(msg) May 26 12:34:38.614607 dv-cinder-815146-11-smb devstack@keystone.service[80180]: May 26 12:34:38.615508 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70b65f7-2c27-4159-ab26-64cb0736b64f admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:38.619866 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 780/1565] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:34:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:38.620694 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a31ba-70c4-437e-9db2-b87efdd20851 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:38.625502 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:38.630016 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 786/1566] 10.222.0.16 () {58 vars in 1152 bytes} [Thu May 26 12:34:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:34:38.630817 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70b65f7-2c27-4159-ab26-64cb0736b64f admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:38.631585 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a31ba-70c4-437e-9db2-b87efdd20851 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:38.638943 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea2973-f027-4235-82cb-d8edacbf8a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:38.639607 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea2973-f027-4235-82cb-d8edacbf8a17 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:38.639890 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea2973-f027-4235-82cb-d8edacbf8a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:38.640165 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea2973-f027-4235-82cb-d8edacbf8a17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:38.640890 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aea2973-f027-4235-82cb-d8edacbf8a17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:38.641928 dv-cinder-815146-11-smb devstack@keystone.service[80181]: WARNING py.warnings [None req-3aea2973-f027-4235-82cb-d8edacbf8a17 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 12:34:38.641928 dv-cinder-815146-11-smb devstack@keystone.service[80181]: warnings.warn(msg) May 26 12:34:38.641928 dv-cinder-815146-11-smb devstack@keystone.service[80181]: May 26 12:34:38.643142 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aea2973-f027-4235-82cb-d8edacbf8a17 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:38.644444 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70b65f7-2c27-4159-ab26-64cb0736b64f admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:38.649307 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde44a9-62e3-4377-a389-ac23b5bcd75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:38.650191 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde44a9-62e3-4377-a389-ac23b5bcd75c admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:38.650478 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde44a9-62e3-4377-a389-ac23b5bcd75c admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:38.650757 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde44a9-62e3-4377-a389-ac23b5bcd75c admin admin] PATH_INFO: `/v3/projects/d2884d300c214cf5b73eecf63296373e/users/5c584ad0964543cd87c4a0b06bda428f/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:38.667350 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fde44a9-62e3-4377-a389-ac23b5bcd75c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2884d300c214cf5b73eecf63296373e, user_id=5c584ad0964543cd87c4a0b06bda428f, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:38.669559 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 781/1567] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:34:38 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:34:38.670941 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea2973-f027-4235-82cb-d8edacbf8a17 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:38.673662 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fde44a9-62e3-4377-a389-ac23b5bcd75c admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:38.687814 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 787/1568] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:34:38 2022] PUT /identity/v3/projects/d2884d300c214cf5b73eecf63296373e/users/5c584ad0964543cd87c4a0b06bda428f/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:38.688571 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde44a9-62e3-4377-a389-ac23b5bcd75c admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:38.735664 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea2973-f027-4235-82cb-d8edacbf8a17 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:38.754036 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde44a9-62e3-4377-a389-ac23b5bcd75c admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:38.758973 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea557445-6ac1-42c5-b6bb-bd480a958f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:38.759643 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea557445-6ac1-42c5-b6bb-bd480a958f57 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:38.760047 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea557445-6ac1-42c5-b6bb-bd480a958f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:38.760363 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea557445-6ac1-42c5-b6bb-bd480a958f57 admin admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:38.761165 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea557445-6ac1-42c5-b6bb-bd480a958f57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:34:38.761483 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea557445-6ac1-42c5-b6bb-bd480a958f57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:38.763129 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea557445-6ac1-42c5-b6bb-bd480a958f57 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:38.774893 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 788/1569] 10.222.0.16 () {58 vars in 1152 bytes} [Thu May 26 12:34:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:34:38.775782 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea557445-6ac1-42c5-b6bb-bd480a958f57 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:38.786263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea557445-6ac1-42c5-b6bb-bd480a958f57 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:38.790908 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d4331-2a75-4de4-be1c-83da5159a859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:38.791548 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d4331-2a75-4de4-be1c-83da5159a859 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:38.791834 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d4331-2a75-4de4-be1c-83da5159a859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:38.792110 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d4331-2a75-4de4-be1c-83da5159a859 admin admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:38.792824 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858d4331-2a75-4de4-be1c-83da5159a859 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:34:38.793160 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858d4331-2a75-4de4-be1c-83da5159a859 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:38.794738 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858d4331-2a75-4de4-be1c-83da5159a859 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:38.799976 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f6dda-6482-4c09-b178-4926923321dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:38.800638 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f6dda-6482-4c09-b178-4926923321dc admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:38.800947 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f6dda-6482-4c09-b178-4926923321dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:38.801227 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f6dda-6482-4c09-b178-4926923321dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:38.801952 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399f6dda-6482-4c09-b178-4926923321dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:34:38.802253 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399f6dda-6482-4c09-b178-4926923321dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:38.803851 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399f6dda-6482-4c09-b178-4926923321dc admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:38.807650 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 789/1570] 10.222.0.16 () {58 vars in 1152 bytes} [Thu May 26 12:34:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:34:38.808468 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d4331-2a75-4de4-be1c-83da5159a859 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:38.820064 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d4331-2a75-4de4-be1c-83da5159a859 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:38.820231 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 782/1571] 10.222.0.16 () {58 vars in 1152 bytes} [Thu May 26 12:34:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:34:38.820985 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f6dda-6482-4c09-b178-4926923321dc admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:38.824869 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178fe46-298a-4787-9103-2be8c73a999a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:38.825534 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178fe46-298a-4787-9103-2be8c73a999a admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:38.825819 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178fe46-298a-4787-9103-2be8c73a999a admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:38.826198 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178fe46-298a-4787-9103-2be8c73a999a admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:38.826950 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b178fe46-298a-4787-9103-2be8c73a999a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:38.828605 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b178fe46-298a-4787-9103-2be8c73a999a admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:38.831210 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f6dda-6482-4c09-b178-4926923321dc admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:38.836213 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f884765-a9fc-4f2f-9206-b451dc405e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:38.836882 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f884765-a9fc-4f2f-9206-b451dc405e22 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:38.837170 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f884765-a9fc-4f2f-9206-b451dc405e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:38.837443 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f884765-a9fc-4f2f-9206-b451dc405e22 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:38.838157 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f884765-a9fc-4f2f-9206-b451dc405e22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:34:38.838462 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f884765-a9fc-4f2f-9206-b451dc405e22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:38.842733 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 790/1572] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:34:38.842733 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178fe46-298a-4787-9103-2be8c73a999a admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:38.842938 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f884765-a9fc-4f2f-9206-b451dc405e22 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:38.851893 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178fe46-298a-4787-9103-2be8c73a999a admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:38.853283 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 783/1573] 10.222.0.16 () {58 vars in 1152 bytes} [Thu May 26 12:34:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:34:38.856950 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f6dc5-d368-4055-ae0a-bbff9380079e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:38.858189 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f6dc5-d368-4055-ae0a-bbff9380079e admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:38.858300 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f884765-a9fc-4f2f-9206-b451dc405e22 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:38.858503 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f6dc5-d368-4055-ae0a-bbff9380079e admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:38.858742 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f6dc5-d368-4055-ae0a-bbff9380079e admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:38.859421 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5f6dc5-d368-4055-ae0a-bbff9380079e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:38.861354 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5f6dc5-d368-4055-ae0a-bbff9380079e admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:38.868400 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f884765-a9fc-4f2f-9206-b451dc405e22 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:38.873484 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e7345-a916-4fdf-9eb6-67d8fd8e3380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:38.874145 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e7345-a916-4fdf-9eb6-67d8fd8e3380 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:38.874428 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e7345-a916-4fdf-9eb6-67d8fd8e3380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:38.874701 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e7345-a916-4fdf-9eb6-67d8fd8e3380 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:38.875391 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132e7345-a916-4fdf-9eb6-67d8fd8e3380 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:38.877411 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132e7345-a916-4fdf-9eb6-67d8fd8e3380 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:38.890811 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 791/1574] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:34:38 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:34:38.890811 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8b696-6e9a-4a17-9e5b-e08f2956a0d1 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:38.890811 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8b696-6e9a-4a17-9e5b-e08f2956a0d1 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:38.890811 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8b696-6e9a-4a17-9e5b-e08f2956a0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:38.900582 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 784/1575] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:34:38 2022] POST /identity/v3/users => generated 286 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:34:38.900582 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e7345-a916-4fdf-9eb6-67d8fd8e3380 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:38.908046 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-aee8b696-6e9a-4a17-9e5b-e08f2956a0d1 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:38.908679 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e7345-a916-4fdf-9eb6-67d8fd8e3380 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:38.909361 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-aee8b696-6e9a-4a17-9e5b-e08f2956a0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:38.945329 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:38.956855 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:38.968140 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7a25e7-aa3b-4aa3-b152-06f79a3de360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:38.968852 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a25e7-aa3b-4aa3-b152-06f79a3de360 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:38.969216 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a25e7-aa3b-4aa3-b152-06f79a3de360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:38.969425 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a25e7-aa3b-4aa3-b152-06f79a3de360 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:38.970113 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7a25e7-aa3b-4aa3-b152-06f79a3de360 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:38.972572 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7a25e7-aa3b-4aa3-b152-06f79a3de360 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:38.972857 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 792/1576] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:34:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:38.973787 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee8b696-6e9a-4a17-9e5b-e08f2956a0d1 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:38.985654 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee8b696-6e9a-4a17-9e5b-e08f2956a0d1 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:38.990677 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4910f31a-8ea0-4989-a3b0-8e8853a31e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:38.991445 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4910f31a-8ea0-4989-a3b0-8e8853a31e76 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:38.991729 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4910f31a-8ea0-4989-a3b0-8e8853a31e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:38.992006 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4910f31a-8ea0-4989-a3b0-8e8853a31e76 admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:38.992821 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4910f31a-8ea0-4989-a3b0-8e8853a31e76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:38.994930 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4910f31a-8ea0-4989-a3b0-8e8853a31e76 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:39.003719 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 785/1577] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:34:38 2022] POST /identity/v3/projects => generated 367 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:34:39.003719 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7a25e7-aa3b-4aa3-b152-06f79a3de360 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:39.023559 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 793/1578] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:34:38 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:34:39.024230 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4910f31a-8ea0-4989-a3b0-8e8853a31e76 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:39.068334 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7a25e7-aa3b-4aa3-b152-06f79a3de360 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:39.088032 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4910f31a-8ea0-4989-a3b0-8e8853a31e76 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:39.092703 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a548482-9c40-4ce3-af74-fdaaa344e98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:39.093619 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a548482-9c40-4ce3-af74-fdaaa344e98e admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:39.093903 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a548482-9c40-4ce3-af74-fdaaa344e98e admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:39.094177 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a548482-9c40-4ce3-af74-fdaaa344e98e admin admin] PATH_INFO: `/v3/projects/5463c05f534944d1bca996652c4fcadb/users/bd25ae73d8f943839c9682cc4503909d/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:39.109553 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a548482-9c40-4ce3-af74-fdaaa344e98e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5463c05f534944d1bca996652c4fcadb, user_id=bd25ae73d8f943839c9682cc4503909d, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:39.112245 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a548482-9c40-4ce3-af74-fdaaa344e98e admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:39.127868 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 794/1579] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:34:39 2022] PUT /identity/v3/projects/5463c05f534944d1bca996652c4fcadb/users/bd25ae73d8f943839c9682cc4503909d/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:39.128734 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a548482-9c40-4ce3-af74-fdaaa344e98e admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:39.130023 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34033cc-5092-4fe2-81ae-21bc14ef0c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:39.130730 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34033cc-5092-4fe2-81ae-21bc14ef0c54 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:39.131048 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34033cc-5092-4fe2-81ae-21bc14ef0c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:39.131349 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34033cc-5092-4fe2-81ae-21bc14ef0c54 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:39.132126 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34033cc-5092-4fe2-81ae-21bc14ef0c54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:39.134186 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34033cc-5092-4fe2-81ae-21bc14ef0c54 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:39.159391 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 786/1580] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:34:39 2022] POST /identity/v3/projects => generated 387 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:34:39.160222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34033cc-5092-4fe2-81ae-21bc14ef0c54 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:39.197167 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a548482-9c40-4ce3-af74-fdaaa344e98e admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:39.222695 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34033cc-5092-4fe2-81ae-21bc14ef0c54 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:39.227853 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e57e4d1-bc83-442f-9bef-c0d1167547ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:39.228524 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57e4d1-bc83-442f-9bef-c0d1167547ac admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:39.228891 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57e4d1-bc83-442f-9bef-c0d1167547ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:39.229139 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57e4d1-bc83-442f-9bef-c0d1167547ac admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:39.230191 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e57e4d1-bc83-442f-9bef-c0d1167547ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:39.232976 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e57e4d1-bc83-442f-9bef-c0d1167547ac admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:39.244272 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:39.247646 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:39.255374 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 787/1581] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:34:39 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:34:39.256577 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e57e4d1-bc83-442f-9bef-c0d1167547ac admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:39.259781 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee4e01-3cbd-48af-a3b1-429d47f2348f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:39.260646 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee4e01-3cbd-48af-a3b1-429d47f2348f admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:39.261068 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee4e01-3cbd-48af-a3b1-429d47f2348f admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:39.261445 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee4e01-3cbd-48af-a3b1-429d47f2348f admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:39.262146 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ee4e01-3cbd-48af-a3b1-429d47f2348f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:39.264090 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ee4e01-3cbd-48af-a3b1-429d47f2348f admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:39.266559 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e57e4d1-bc83-442f-9bef-c0d1167547ac admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:39.271362 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1c18c-2c18-49f7-9289-8617ab4bc767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:39.272016 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1c18c-2c18-49f7-9289-8617ab4bc767 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:39.272303 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1c18c-2c18-49f7-9289-8617ab4bc767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:39.272586 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1c18c-2c18-49f7-9289-8617ab4bc767 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:39.273366 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1c18c-2c18-49f7-9289-8617ab4bc767 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:39.275025 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1c18c-2c18-49f7-9289-8617ab4bc767 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:39.286821 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 788/1582] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:34:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:34:39.287791 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1c18c-2c18-49f7-9289-8617ab4bc767 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:39.293782 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 795/1583] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:34:39 2022] POST /identity/v3/projects => generated 399 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:34:39.293782 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee4e01-3cbd-48af-a3b1-429d47f2348f admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:39.344066 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1c18c-2c18-49f7-9289-8617ab4bc767 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:39.355697 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee4e01-3cbd-48af-a3b1-429d47f2348f admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:39.361917 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70843656-170d-4090-9b62-7c39d85980e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:39.362586 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70843656-170d-4090-9b62-7c39d85980e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:39.362875 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70843656-170d-4090-9b62-7c39d85980e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:39.363163 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70843656-170d-4090-9b62-7c39d85980e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:39.363853 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70843656-170d-4090-9b62-7c39d85980e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:39.365837 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70843656-170d-4090-9b62-7c39d85980e4 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:39.387947 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 796/1584] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:34:39 2022] POST /identity/v3/users => generated 284 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:34:39.391923 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70843656-170d-4090-9b62-7c39d85980e4 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:39.401185 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b5a94-b6c5-488a-b5bf-d221aa3c93c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:39.401419 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70843656-170d-4090-9b62-7c39d85980e4 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:39.402126 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b5a94-b6c5-488a-b5bf-d221aa3c93c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:39.402404 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b5a94-b6c5-488a-b5bf-d221aa3c93c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:39.402669 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b5a94-b6c5-488a-b5bf-d221aa3c93c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:39.406016 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcfd6aa-1646-408a-88aa-239babcb37b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:39.406661 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcfd6aa-1646-408a-88aa-239babcb37b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:39.406949 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcfd6aa-1646-408a-88aa-239babcb37b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:39.407226 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcfd6aa-1646-408a-88aa-239babcb37b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:39.407909 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcfd6aa-1646-408a-88aa-239babcb37b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:39.409865 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcfd6aa-1646-408a-88aa-239babcb37b5 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:39.412513 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4b5a94-b6c5-488a-b5bf-d221aa3c93c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:39.413996 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4b5a94-b6c5-488a-b5bf-d221aa3c93c8 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:39.424634 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 789/1585] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:34:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:34:39.425957 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c86504-df71-497b-a76c-455a03c5251f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:39.426254 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c86504-df71-497b-a76c-455a03c5251f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:39.426542 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c86504-df71-497b-a76c-455a03c5251f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:39.431281 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 797/1586] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:34:39 2022] POST /identity/v3/users => generated 289 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:34:39.432166 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcfd6aa-1646-408a-88aa-239babcb37b5 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:39.442682 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcfd6aa-1646-408a-88aa-239babcb37b5 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:39.447432 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed52b8-12cd-4c5b-81d8-305fe6e9f73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:39.447963 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b5c86504-df71-497b-a76c-455a03c5251f None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:39.448162 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed52b8-12cd-4c5b-81d8-305fe6e9f73e admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:39.448416 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed52b8-12cd-4c5b-81d8-305fe6e9f73e admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:39.448864 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed52b8-12cd-4c5b-81d8-305fe6e9f73e admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:39.449149 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b5c86504-df71-497b-a76c-455a03c5251f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:39.449701 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ed52b8-12cd-4c5b-81d8-305fe6e9f73e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:39.451745 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ed52b8-12cd-4c5b-81d8-305fe6e9f73e admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:39.458012 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 790/1587] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:34:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:39.458676 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c86504-df71-497b-a76c-455a03c5251f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:39.471560 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c86504-df71-497b-a76c-455a03c5251f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:39.477076 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3887c2e-467b-4016-9704-ff65e4d2c237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:39.477785 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3887c2e-467b-4016-9704-ff65e4d2c237 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:39.478073 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3887c2e-467b-4016-9704-ff65e4d2c237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:39.478348 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3887c2e-467b-4016-9704-ff65e4d2c237 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:39.479080 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3887c2e-467b-4016-9704-ff65e4d2c237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:39.480766 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3887c2e-467b-4016-9704-ff65e4d2c237 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:39.485481 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 798/1588] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:34:39 2022] POST /identity/v3/users => generated 294 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:34:39.486550 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed52b8-12cd-4c5b-81d8-305fe6e9f73e admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:39.495241 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 791/1589] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:34:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:34:39.496508 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3887c2e-467b-4016-9704-ff65e4d2c237 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:39.500250 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed52b8-12cd-4c5b-81d8-305fe6e9f73e admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:39.505365 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb620fe9-1a39-4e28-9b2b-25ca98015fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:39.506104 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb620fe9-1a39-4e28-9b2b-25ca98015fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:39.506395 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb620fe9-1a39-4e28-9b2b-25ca98015fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:39.506676 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb620fe9-1a39-4e28-9b2b-25ca98015fd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:39.507522 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb620fe9-1a39-4e28-9b2b-25ca98015fd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:39.507891 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3887c2e-467b-4016-9704-ff65e4d2c237 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:39.509225 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb620fe9-1a39-4e28-9b2b-25ca98015fd7 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:39.513634 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfbfc87-0494-41bd-b969-30487c2ea319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:39.514373 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbfc87-0494-41bd-b969-30487c2ea319 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:39.514843 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbfc87-0494-41bd-b969-30487c2ea319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:39.515184 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbfc87-0494-41bd-b969-30487c2ea319 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:39.516490 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfbfc87-0494-41bd-b969-30487c2ea319 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:39.518517 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfbfc87-0494-41bd-b969-30487c2ea319 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:39.524438 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 799/1590] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:34:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:34:39.524438 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb620fe9-1a39-4e28-9b2b-25ca98015fd7 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:39.538347 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb620fe9-1a39-4e28-9b2b-25ca98015fd7 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:39.543789 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 792/1591] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:34:39 2022] POST /identity/v3/users => generated 300 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:34:39.543789 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfbfc87-0494-41bd-b969-30487c2ea319 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:39.547260 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0258366-183c-4bb1-a542-cc65196dac1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:39.548008 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0258366-183c-4bb1-a542-cc65196dac1a admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:39.548652 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0258366-183c-4bb1-a542-cc65196dac1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:39.548652 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0258366-183c-4bb1-a542-cc65196dac1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:39.549550 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0258366-183c-4bb1-a542-cc65196dac1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:39.551477 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0258366-183c-4bb1-a542-cc65196dac1a admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:39.555101 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfbfc87-0494-41bd-b969-30487c2ea319 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:39.562041 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9451e5c3-2c8d-426c-97d6-9e711354ee38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:39.562523 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451e5c3-2c8d-426c-97d6-9e711354ee38 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:39.562814 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451e5c3-2c8d-426c-97d6-9e711354ee38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:39.563176 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451e5c3-2c8d-426c-97d6-9e711354ee38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:39.564085 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9451e5c3-2c8d-426c-97d6-9e711354ee38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:39.564808 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 800/1592] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:34:39 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:34:39.566243 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9451e5c3-2c8d-426c-97d6-9e711354ee38 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:39.568781 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0258366-183c-4bb1-a542-cc65196dac1a admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:39.570864 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-e0258366-183c-4bb1-a542-cc65196dac1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:39.578957 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 793/1593] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:34:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:34:39.579749 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9451e5c3-2c8d-426c-97d6-9e711354ee38 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:39.584045 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0258366-183c-4bb1-a542-cc65196dac1a admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:39.588829 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcdfcb1-6607-45d4-87cf-c3196bf61de6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:39.589505 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcdfcb1-6607-45d4-87cf-c3196bf61de6 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:39.589792 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcdfcb1-6607-45d4-87cf-c3196bf61de6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:39.590018 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9451e5c3-2c8d-426c-97d6-9e711354ee38 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:39.590125 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcdfcb1-6607-45d4-87cf-c3196bf61de6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:39.595453 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c36026-eadc-49aa-90f6-4fe8ad4ae430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:39.596163 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c36026-eadc-49aa-90f6-4fe8ad4ae430 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:39.596658 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c36026-eadc-49aa-90f6-4fe8ad4ae430 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:39.597011 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c36026-eadc-49aa-90f6-4fe8ad4ae430 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:39.597826 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c36026-eadc-49aa-90f6-4fe8ad4ae430 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:39.599483 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c36026-eadc-49aa-90f6-4fe8ad4ae430 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:39.601441 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcdfcb1-6607-45d4-87cf-c3196bf61de6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:39.603244 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcdfcb1-6607-45d4-87cf-c3196bf61de6 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:39.617226 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 794/1594] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:34:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:34:39.619021 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c36026-eadc-49aa-90f6-4fe8ad4ae430 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:39.622266 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 801/1595] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:34:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:34:39.623366 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcdfcb1-6607-45d4-87cf-c3196bf61de6 service neutron] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:39.635976 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcdfcb1-6607-45d4-87cf-c3196bf61de6 service neutron] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:39.638657 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c36026-eadc-49aa-90f6-4fe8ad4ae430 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:39.642724 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2a5d6c-9b96-4986-b646-c4d7e748dedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:39.643675 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a5d6c-9b96-4986-b646-c4d7e748dedb admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:39.644096 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a5d6c-9b96-4986-b646-c4d7e748dedb admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:39.644387 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a5d6c-9b96-4986-b646-c4d7e748dedb admin admin] PATH_INFO: `/v3/projects/459a6488cea344dcb7a646c82a8ff7ea/users/7b0d8d7ebe6643749650e7a00fc3a1c8/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:39.649725 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f9208-0eca-4fb2-be52-e4dd910bf9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:39.651259 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f9208-0eca-4fb2-be52-e4dd910bf9a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:39.652041 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f9208-0eca-4fb2-be52-e4dd910bf9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:39.652717 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f9208-0eca-4fb2-be52-e4dd910bf9a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:39.655212 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f9208-0eca-4fb2-be52-e4dd910bf9a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:39.660333 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f9208-0eca-4fb2-be52-e4dd910bf9a0 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:39.674381 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2a5d6c-9b96-4986-b646-c4d7e748dedb admin admin] RBAC: Authorizing `identity:create_grant(project_id=459a6488cea344dcb7a646c82a8ff7ea, user_id=7b0d8d7ebe6643749650e7a00fc3a1c8, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:39.678186 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2a5d6c-9b96-4986-b646-c4d7e748dedb admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:39.686554 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 795/1596] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:34:39 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:34:39.688789 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f9208-0eca-4fb2-be52-e4dd910bf9a0 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:39.695604 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 802/1597] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:34:39 2022] PUT /identity/v3/projects/459a6488cea344dcb7a646c82a8ff7ea/users/7b0d8d7ebe6643749650e7a00fc3a1c8/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:39.696613 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2a5d6c-9b96-4986-b646-c4d7e748dedb admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:39.715514 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f9208-0eca-4fb2-be52-e4dd910bf9a0 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:39.772866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:39.797665 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:39.849539 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543cf9c-f3c5-4eaf-882a-54982e6c40fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:39.850513 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543cf9c-f3c5-4eaf-882a-54982e6c40fe admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:39.850950 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543cf9c-f3c5-4eaf-882a-54982e6c40fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:39.851331 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543cf9c-f3c5-4eaf-882a-54982e6c40fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:39.852188 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c543cf9c-f3c5-4eaf-882a-54982e6c40fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:39.854146 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c543cf9c-f3c5-4eaf-882a-54982e6c40fe admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:39.867829 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 796/1598] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:34:39 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:34:39.869621 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543cf9c-f3c5-4eaf-882a-54982e6c40fe admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:39.871598 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2a5d6c-9b96-4986-b646-c4d7e748dedb admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:39.881537 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543cf9c-f3c5-4eaf-882a-54982e6c40fe admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:39.882111 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2638e7-301f-44d4-873e-fd11c7f89529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:39.883451 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2638e7-301f-44d4-873e-fd11c7f89529 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:39.884117 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2638e7-301f-44d4-873e-fd11c7f89529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:39.884877 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2638e7-301f-44d4-873e-fd11c7f89529 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:39.886456 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2638e7-301f-44d4-873e-fd11c7f89529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:39.887216 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99e2f2-9a52-42f5-9fa7-830a20b1ac1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:39.888008 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99e2f2-9a52-42f5-9fa7-830a20b1ac1d admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:39.888396 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99e2f2-9a52-42f5-9fa7-830a20b1ac1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:39.889483 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99e2f2-9a52-42f5-9fa7-830a20b1ac1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:39.890311 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc99e2f2-9a52-42f5-9fa7-830a20b1ac1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:39.890504 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2638e7-301f-44d4-873e-fd11c7f89529 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:39.892385 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc99e2f2-9a52-42f5-9fa7-830a20b1ac1d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:39.905642 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 797/1599] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:34:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:34:39.906667 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99e2f2-9a52-42f5-9fa7-830a20b1ac1d admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:39.919407 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99e2f2-9a52-42f5-9fa7-830a20b1ac1d admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:39.923354 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 803/1600] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:34:39 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:34:39.924989 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2638e7-301f-44d4-873e-fd11c7f89529 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:39.927621 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5114722-5c9a-429f-a027-eb287396a5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:39.928394 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5114722-5c9a-429f-a027-eb287396a5b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:39.928828 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5114722-5c9a-429f-a027-eb287396a5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:39.929265 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5114722-5c9a-429f-a027-eb287396a5b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:39.930088 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5114722-5c9a-429f-a027-eb287396a5b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:39.932247 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5114722-5c9a-429f-a027-eb287396a5b4 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:39.946518 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 798/1601] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:34:39 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:34:39.947897 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bed447-fec2-43be-8d15-f3881d263cfc None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:39.948303 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bed447-fec2-43be-8d15-f3881d263cfc None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:39.948678 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bed447-fec2-43be-8d15-f3881d263cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:39.952394 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2638e7-301f-44d4-873e-fd11c7f89529 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:39.961838 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c2ef6-252a-4448-b4cd-2f59b8a718ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:39.963330 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c2ef6-252a-4448-b4cd-2f59b8a718ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:39.964188 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c2ef6-252a-4448-b4cd-2f59b8a718ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:39.964782 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c2ef6-252a-4448-b4cd-2f59b8a718ef admin admin] PATH_INFO: `/v3/projects/f71720f020284ee1af909f3338f93c50/users/9243ab99a1fd412499cb31518fa7fc91/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:39.986647 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d8bed447-fec2-43be-8d15-f3881d263cfc None None] MFA Rules not processed for user `7b0d8d7ebe6643749650e7a00fc3a1c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:39.987860 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d8bed447-fec2-43be-8d15-f3881d263cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:39.995888 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c2ef6-252a-4448-b4cd-2f59b8a718ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=f71720f020284ee1af909f3338f93c50, user_id=9243ab99a1fd412499cb31518fa7fc91, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:39.999983 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c2ef6-252a-4448-b4cd-2f59b8a718ef admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:40.020913 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 804/1602] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:34:39 2022] PUT /identity/v3/projects/f71720f020284ee1af909f3338f93c50/users/9243ab99a1fd412499cb31518fa7fc91/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:40.022294 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c2ef6-252a-4448-b4cd-2f59b8a718ef admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:40.065077 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 799/1603] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:34:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:40.066166 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bed447-fec2-43be-8d15-f3881d263cfc None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:40.078155 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bed447-fec2-43be-8d15-f3881d263cfc None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:40.132125 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c2ef6-252a-4448-b4cd-2f59b8a718ef admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:40.139324 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d51ee-0b40-47dd-8db9-971179385e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:40.139987 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d51ee-0b40-47dd-8db9-971179385e07 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:40.140370 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d51ee-0b40-47dd-8db9-971179385e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:40.140528 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d51ee-0b40-47dd-8db9-971179385e07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:40.141341 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d51ee-0b40-47dd-8db9-971179385e07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:40.143305 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d51ee-0b40-47dd-8db9-971179385e07 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:40.155278 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 805/1604] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:34:40 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:34:40.155965 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d51ee-0b40-47dd-8db9-971179385e07 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:40.181128 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d51ee-0b40-47dd-8db9-971179385e07 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:40.184113 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1080286-50f9-4338-99d0-58825cdb2043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:40.185121 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1080286-50f9-4338-99d0-58825cdb2043 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:40.185451 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1080286-50f9-4338-99d0-58825cdb2043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:40.187002 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1080286-50f9-4338-99d0-58825cdb2043 admin admin] PATH_INFO: `/v3/projects/d73ca88003e44889b870613430f4d51e/users/ae9585c4fe0c4d0eb1a820c9dc096a89/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:40.187142 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da81800-c2d8-4596-a1c1-25d62ae79fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:40.188256 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da81800-c2d8-4596-a1c1-25d62ae79fe3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:40.188611 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da81800-c2d8-4596-a1c1-25d62ae79fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:40.189860 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da81800-c2d8-4596-a1c1-25d62ae79fe3 admin admin] PATH_INFO: `/v3/projects/1157a970544e4c5099c98009bdcdfc6e/users/699beef896a74de98e314db78b2aa689/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:40.206552 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1080286-50f9-4338-99d0-58825cdb2043 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d73ca88003e44889b870613430f4d51e, user_id=ae9585c4fe0c4d0eb1a820c9dc096a89, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:40.208266 dv-cinder-815146-11-smb devstack@keystone.service[80181]: WARNING py.warnings [None req-d1080286-50f9-4338-99d0-58825cdb2043 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 12:34:40.208266 dv-cinder-815146-11-smb devstack@keystone.service[80181]: warnings.warn(msg) May 26 12:34:40.208266 dv-cinder-815146-11-smb devstack@keystone.service[80181]: May 26 12:34:40.210536 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1080286-50f9-4338-99d0-58825cdb2043 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:40.222713 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da81800-c2d8-4596-a1c1-25d62ae79fe3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1157a970544e4c5099c98009bdcdfc6e, user_id=699beef896a74de98e314db78b2aa689, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:40.225447 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da81800-c2d8-4596-a1c1-25d62ae79fe3 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:40.233190 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 800/1605] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:34:40 2022] PUT /identity/v3/projects/d73ca88003e44889b870613430f4d51e/users/ae9585c4fe0c4d0eb1a820c9dc096a89/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:40.234149 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1080286-50f9-4338-99d0-58825cdb2043 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:40.242415 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 806/1606] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:34:40 2022] PUT /identity/v3/projects/1157a970544e4c5099c98009bdcdfc6e/users/699beef896a74de98e314db78b2aa689/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:40.243934 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7586f-ab88-4a84-8f89-f92a238f27cc None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:40.244431 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7586f-ab88-4a84-8f89-f92a238f27cc None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:40.244602 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7586f-ab88-4a84-8f89-f92a238f27cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:40.281250 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:40.291033 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-85d7586f-ab88-4a84-8f89-f92a238f27cc None None] MFA Rules not processed for user `9243ab99a1fd412499cb31518fa7fc91`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:40.292464 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-85d7586f-ab88-4a84-8f89-f92a238f27cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:40.329884 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1080286-50f9-4338-99d0-58825cdb2043 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:40.390068 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 807/1607] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:34:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:40.392546 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33654b2a-59c9-4015-ac04-b5eaee8df5ba None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:40.392854 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33654b2a-59c9-4015-ac04-b5eaee8df5ba None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:40.394774 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33654b2a-59c9-4015-ac04-b5eaee8df5ba None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:40.396213 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 808/1608] 10.222.0.16 () {54 vars in 961 bytes} [Thu May 26 12:34:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:34:40.398846 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33654b2a-59c9-4015-ac04-b5eaee8df5ba None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:40.405822 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:40.414507 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b006343-2574-4bfb-8aea-6026e39cda2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:40.416243 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b006343-2574-4bfb-8aea-6026e39cda2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:40.416398 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b006343-2574-4bfb-8aea-6026e39cda2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:40.416567 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b006343-2574-4bfb-8aea-6026e39cda2c admin admin] PATH_INFO: `/v3/projects/e6c4fdad2c744b218d5a6706d90db4aa/users/62ff83542a7c4c7982affdc3b882cdd2/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:40.439235 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b006343-2574-4bfb-8aea-6026e39cda2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6c4fdad2c744b218d5a6706d90db4aa, user_id=62ff83542a7c4c7982affdc3b882cdd2, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:40.442483 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b006343-2574-4bfb-8aea-6026e39cda2c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:40.459391 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 801/1609] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:34:40 2022] PUT /identity/v3/projects/e6c4fdad2c744b218d5a6706d90db4aa/users/62ff83542a7c4c7982affdc3b882cdd2/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:40.465847 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445a935-2bb1-4c9e-93ed-cae1007996d9 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:40.466424 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445a935-2bb1-4c9e-93ed-cae1007996d9 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:40.467446 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445a935-2bb1-4c9e-93ed-cae1007996d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:40.485224 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33654b2a-59c9-4015-ac04-b5eaee8df5ba None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:40.489174 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b445a935-2bb1-4c9e-93ed-cae1007996d9 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:40.490735 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b445a935-2bb1-4c9e-93ed-cae1007996d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:40.566444 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296e041-0c88-4df2-b4dd-136c36e8137f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:40.567539 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296e041-0c88-4df2-b4dd-136c36e8137f admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:40.567916 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296e041-0c88-4df2-b4dd-136c36e8137f admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:40.568402 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296e041-0c88-4df2-b4dd-136c36e8137f admin admin] PATH_INFO: `/v3/projects/a1d95e2f8d034f28ae53f6495a592548/users/aee5f29e143942d9bb117aafa685144e/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:40.581290 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 802/1610] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:34:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:40.585813 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ec9de-b18d-426b-a3ae-fd2edf54abc8 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:40.586346 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ec9de-b18d-426b-a3ae-fd2edf54abc8 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:40.586843 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ec9de-b18d-426b-a3ae-fd2edf54abc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:40.592358 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0296e041-0c88-4df2-b4dd-136c36e8137f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1d95e2f8d034f28ae53f6495a592548, user_id=aee5f29e143942d9bb117aafa685144e, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:40.596558 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0296e041-0c88-4df2-b4dd-136c36e8137f admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:40.616895 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 809/1611] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:34:40 2022] PUT /identity/v3/projects/a1d95e2f8d034f28ae53f6495a592548/users/aee5f29e143942d9bb117aafa685144e/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:40.616895 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa03a1-6c9b-4a28-9624-63b137b9dfd4 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:40.616895 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa03a1-6c9b-4a28-9624-63b137b9dfd4 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:40.616895 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa03a1-6c9b-4a28-9624-63b137b9dfd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:40.630754 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-f58ec9de-b18d-426b-a3ae-fd2edf54abc8 None None] MFA Rules not processed for user `699beef896a74de98e314db78b2aa689`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:40.632022 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f58ec9de-b18d-426b-a3ae-fd2edf54abc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:40.655806 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-c6aa03a1-6c9b-4a28-9624-63b137b9dfd4 None None] MFA Rules not processed for user `5c584ad0964543cd87c4a0b06bda428f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:40.657061 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-c6aa03a1-6c9b-4a28-9624-63b137b9dfd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:40.685123 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:40.721058 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 803/1612] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:34:40 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:40.721058 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ec9de-b18d-426b-a3ae-fd2edf54abc8 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:40.736034 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 810/1613] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:34:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:40.737473 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35a434-a803-4b3a-acd2-eff5e23d772e None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:40.737861 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35a434-a803-4b3a-acd2-eff5e23d772e None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:40.738206 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35a434-a803-4b3a-acd2-eff5e23d772e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:40.761487 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-2f35a434-a803-4b3a-acd2-eff5e23d772e None None] MFA Rules not processed for user `536f68ff77794352adf41aaacdc0645c`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:40.763105 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-2f35a434-a803-4b3a-acd2-eff5e23d772e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:40.789415 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:40.796346 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ec9de-b18d-426b-a3ae-fd2edf54abc8 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:40.801528 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2f33f8-f1d0-415d-a678-a3f93375f423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:40.802195 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f33f8-f1d0-415d-a678-a3f93375f423 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:40.802464 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f33f8-f1d0-415d-a678-a3f93375f423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:40.802735 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f33f8-f1d0-415d-a678-a3f93375f423 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:40.803426 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2f33f8-f1d0-415d-a678-a3f93375f423 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:40.805425 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2f33f8-f1d0-415d-a678-a3f93375f423 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:40.840904 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 804/1614] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:34:40 2022] POST /identity/v3/projects => generated 381 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:34:40.843040 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7890cc-b350-4452-a184-5858587123e0 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:40.843325 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7890cc-b350-4452-a184-5858587123e0 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:40.843598 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7890cc-b350-4452-a184-5858587123e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:40.862666 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-2e7890cc-b350-4452-a184-5858587123e0 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:40.863876 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2e7890cc-b350-4452-a184-5858587123e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:40.874299 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 811/1615] 10.222.0.16 () {58 vars in 1058 bytes} [Thu May 26 12:34:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:40.875310 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35a434-a803-4b3a-acd2-eff5e23d772e None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:40.949355 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35a434-a803-4b3a-acd2-eff5e23d772e None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:40.970341 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 805/1616] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:34:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:40.972205 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631824e6-015d-4397-93dd-bb988ffedaad None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:40.972963 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631824e6-015d-4397-93dd-bb988ffedaad None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:40.973859 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631824e6-015d-4397-93dd-bb988ffedaad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:41.015959 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-631824e6-015d-4397-93dd-bb988ffedaad None None] MFA Rules not processed for user `aee5f29e143942d9bb117aafa685144e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:41.018126 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-631824e6-015d-4397-93dd-bb988ffedaad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:41.028656 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc30615-7b62-4cb3-9d3b-d2353a79cb04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:41.029935 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc30615-7b62-4cb3-9d3b-d2353a79cb04 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:41.030060 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc30615-7b62-4cb3-9d3b-d2353a79cb04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:41.030618 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc30615-7b62-4cb3-9d3b-d2353a79cb04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:41.041722 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc30615-7b62-4cb3-9d3b-d2353a79cb04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:41.043871 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc30615-7b62-4cb3-9d3b-d2353a79cb04 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:41.054447 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 812/1617] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:34:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:34:41.066797 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc30615-7b62-4cb3-9d3b-d2353a79cb04 service neutron] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:41.093651 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:41.102327 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 806/1618] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:34:40 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:41.104420 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b907756-57b2-47e9-9657-b1e0bf9e19f4 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:41.105117 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b907756-57b2-47e9-9657-b1e0bf9e19f4 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:41.106988 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b907756-57b2-47e9-9657-b1e0bf9e19f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:41.131965 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-8b907756-57b2-47e9-9657-b1e0bf9e19f4 None None] MFA Rules not processed for user `5c584ad0964543cd87c4a0b06bda428f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:41.133641 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8b907756-57b2-47e9-9657-b1e0bf9e19f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:41.183788 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc30615-7b62-4cb3-9d3b-d2353a79cb04 service neutron] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:41.191834 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbef4f1-5d18-4c13-9139-d6f3b2e57cd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:41.192744 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbef4f1-5d18-4c13-9139-d6f3b2e57cd9 service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:41.193140 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbef4f1-5d18-4c13-9139-d6f3b2e57cd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:41.193674 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbef4f1-5d18-4c13-9139-d6f3b2e57cd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:41.245949 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:41.263064 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 807/1619] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:34:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:41.264342 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b907756-57b2-47e9-9657-b1e0bf9e19f4 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:41.288194 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b907756-57b2-47e9-9657-b1e0bf9e19f4 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:41.301128 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95608c4-abe6-438f-afcc-109dcdfdd150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:41.301774 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95608c4-abe6-438f-afcc-109dcdfdd150 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:41.302232 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95608c4-abe6-438f-afcc-109dcdfdd150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:41.302630 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95608c4-abe6-438f-afcc-109dcdfdd150 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:41.303211 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95608c4-abe6-438f-afcc-109dcdfdd150 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:41.307345 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbef4f1-5d18-4c13-9139-d6f3b2e57cd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:41.309607 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbef4f1-5d18-4c13-9139-d6f3b2e57cd9 service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:41.310236 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95608c4-abe6-438f-afcc-109dcdfdd150 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:41.323681 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 813/1620] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:34:41 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:34:41.324691 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbef4f1-5d18-4c13-9139-d6f3b2e57cd9 service cinder] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:41.362838 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 808/1621] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:34:41 2022] POST /identity/v3/users => generated 297 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:34:41.363813 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95608c4-abe6-438f-afcc-109dcdfdd150 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:41.381033 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95608c4-abe6-438f-afcc-109dcdfdd150 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:41.387447 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d53f70-d9bf-4840-a090-95fb457f8129 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:41.388331 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d53f70-d9bf-4840-a090-95fb457f8129 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:41.389440 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d53f70-d9bf-4840-a090-95fb457f8129 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:41.389724 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d53f70-d9bf-4840-a090-95fb457f8129 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:41.402446 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d53f70-d9bf-4840-a090-95fb457f8129 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:41.403984 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d53f70-d9bf-4840-a090-95fb457f8129 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:41.415836 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 809/1622] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:34:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:34:41.416663 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d53f70-d9bf-4840-a090-95fb457f8129 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:41.429619 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d53f70-d9bf-4840-a090-95fb457f8129 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:41.439378 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e3e19d-4995-4945-959b-218f017c5dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:41.440028 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3e19d-4995-4945-959b-218f017c5dd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:41.440316 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3e19d-4995-4945-959b-218f017c5dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:41.440590 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3e19d-4995-4945-959b-218f017c5dd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:41.442330 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e3e19d-4995-4945-959b-218f017c5dd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:41.445114 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e3e19d-4995-4945-959b-218f017c5dd6 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:41.473801 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbef4f1-5d18-4c13-9139-d6f3b2e57cd9 service cinder] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:41.487300 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 810/1623] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:34:41 2022] POST /identity/v3/projects => generated 399 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:34:41.489059 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285ef38-323f-4eeb-8245-1bb0f7ccbc3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536f68ff77794352adf41aaacdc0645c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:41.490007 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e36947-bca9-421d-a6bd-db77de126fd8 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:41.490701 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e36947-bca9-421d-a6bd-db77de126fd8 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:41.491218 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e36947-bca9-421d-a6bd-db77de126fd8 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:41.492422 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285ef38-323f-4eeb-8245-1bb0f7ccbc3c service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:41.492724 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285ef38-323f-4eeb-8245-1bb0f7ccbc3c service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:41.494217 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 811/1624] 10.222.0.16 () {54 vars in 961 bytes} [Thu May 26 12:34:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:34:41.495337 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e36947-bca9-421d-a6bd-db77de126fd8 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:41.501856 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285ef38-323f-4eeb-8245-1bb0f7ccbc3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:41.605225 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b285ef38-323f-4eeb-8245-1bb0f7ccbc3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:41.611291 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b285ef38-323f-4eeb-8245-1bb0f7ccbc3c service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:41.612110 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e36947-bca9-421d-a6bd-db77de126fd8 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:41.618595 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80a5cf-427a-4143-a183-9f8a4243a081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:41.619472 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80a5cf-427a-4143-a183-9f8a4243a081 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:41.619964 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80a5cf-427a-4143-a183-9f8a4243a081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:41.620388 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80a5cf-427a-4143-a183-9f8a4243a081 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:41.621389 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c80a5cf-427a-4143-a183-9f8a4243a081 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:41.623302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c80a5cf-427a-4143-a183-9f8a4243a081 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:41.634092 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 814/1625] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:34:41 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:34:41.641764 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 812/1626] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:34:41 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:34:41.649949 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285ef38-323f-4eeb-8245-1bb0f7ccbc3c service nova] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:41.650747 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4229ee-5876-4006-ab3b-d221aa8843a2 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:41.651136 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4229ee-5876-4006-ab3b-d221aa8843a2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:41.651522 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4229ee-5876-4006-ab3b-d221aa8843a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:41.676974 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285ef38-323f-4eeb-8245-1bb0f7ccbc3c service nova] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:41.687874 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b26be3-0c8d-4cc0-8ad8-2ecb52a6caac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:41.688895 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b26be3-0c8d-4cc0-8ad8-2ecb52a6caac admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:41.689187 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b26be3-0c8d-4cc0-8ad8-2ecb52a6caac admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:41.689475 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b26be3-0c8d-4cc0-8ad8-2ecb52a6caac admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:41.690182 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b26be3-0c8d-4cc0-8ad8-2ecb52a6caac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:41.692394 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b26be3-0c8d-4cc0-8ad8-2ecb52a6caac admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:41.696582 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-3e4229ee-5876-4006-ab3b-d221aa8843a2 None None] MFA Rules not processed for user `536f68ff77794352adf41aaacdc0645c`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:41.697983 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3e4229ee-5876-4006-ab3b-d221aa8843a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:41.743778 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 815/1627] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:34:41 2022] POST /identity/v3/users => generated 306 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:34:41.744958 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b26be3-0c8d-4cc0-8ad8-2ecb52a6caac admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:41.764949 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b26be3-0c8d-4cc0-8ad8-2ecb52a6caac admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:41.777623 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252d889-673e-4222-8dda-48522e5b6146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:41.778787 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252d889-673e-4222-8dda-48522e5b6146 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:41.779101 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252d889-673e-4222-8dda-48522e5b6146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:41.780399 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252d889-673e-4222-8dda-48522e5b6146 admin admin] PATH_INFO: `/v3/projects/fdadae8bc3034eaa8e4dad8bd88b8325/users/05dcb7349cc34d298d4b6a41799c612f/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:41.806629 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:41.825733 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c252d889-673e-4222-8dda-48522e5b6146 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdadae8bc3034eaa8e4dad8bd88b8325, user_id=05dcb7349cc34d298d4b6a41799c612f, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:41.835804 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c252d889-673e-4222-8dda-48522e5b6146 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:41.850214 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 813/1628] 10.222.0.16 () {58 vars in 1058 bytes} [Thu May 26 12:34:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:41.851214 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4229ee-5876-4006-ab3b-d221aa8843a2 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:41.876851 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4229ee-5876-4006-ab3b-d221aa8843a2 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:41.882926 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 816/1629] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:34:41 2022] PUT /identity/v3/projects/fdadae8bc3034eaa8e4dad8bd88b8325/users/05dcb7349cc34d298d4b6a41799c612f/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:41.883900 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252d889-673e-4222-8dda-48522e5b6146 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:41.946435 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:42.002821 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ff803-2434-4e3b-970b-7e0a810c3c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:42.003672 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ff803-2434-4e3b-970b-7e0a810c3c7a admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:42.004087 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ff803-2434-4e3b-970b-7e0a810c3c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:42.004782 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ff803-2434-4e3b-970b-7e0a810c3c7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:42.005677 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41ff803-2434-4e3b-970b-7e0a810c3c7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:42.007784 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41ff803-2434-4e3b-970b-7e0a810c3c7a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:42.045661 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 814/1630] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:34:41 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:34:42.046760 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ff803-2434-4e3b-970b-7e0a810c3c7a admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:42.071979 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ff803-2434-4e3b-970b-7e0a810c3c7a admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:42.074428 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252d889-673e-4222-8dda-48522e5b6146 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:42.086028 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d194a06-9654-4664-9ff1-c661e31a6929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:42.087084 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d194a06-9654-4664-9ff1-c661e31a6929 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:42.090909 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d194a06-9654-4664-9ff1-c661e31a6929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:42.090909 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d194a06-9654-4664-9ff1-c661e31a6929 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:42.090909 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d194a06-9654-4664-9ff1-c661e31a6929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:42.090909 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d194a06-9654-4664-9ff1-c661e31a6929 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:42.092769 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc8003d-21aa-4778-a285-c3fa60379131 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536f68ff77794352adf41aaacdc0645c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:42.093048 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8003d-21aa-4778-a285-c3fa60379131 service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:42.093340 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8003d-21aa-4778-a285-c3fa60379131 service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:42.093763 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8003d-21aa-4778-a285-c3fa60379131 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:42.114271 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 815/1631] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:34:42 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:34:42.115215 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d194a06-9654-4664-9ff1-c661e31a6929 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:42.138868 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d194a06-9654-4664-9ff1-c661e31a6929 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:42.149523 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db62d90-1709-4d37-ad31-1602e48749b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:42.150960 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db62d90-1709-4d37-ad31-1602e48749b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:42.151442 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db62d90-1709-4d37-ad31-1602e48749b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:42.151822 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db62d90-1709-4d37-ad31-1602e48749b1 admin admin] PATH_INFO: `/v3/projects/cf79d37c22144908b61ac9e66b442108/users/9abf6aae951a4900bed13b1076499c2b/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:42.176353 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db62d90-1709-4d37-ad31-1602e48749b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf79d37c22144908b61ac9e66b442108, user_id=9abf6aae951a4900bed13b1076499c2b, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:42.180490 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db62d90-1709-4d37-ad31-1602e48749b1 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:42.203415 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 816/1632] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:34:42 2022] PUT /identity/v3/projects/cf79d37c22144908b61ac9e66b442108/users/9abf6aae951a4900bed13b1076499c2b/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:42.205003 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db62d90-1709-4d37-ad31-1602e48749b1 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:42.247089 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc8003d-21aa-4778-a285-c3fa60379131 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:42.249351 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc8003d-21aa-4778-a285-c3fa60379131 service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:42.277268 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 817/1633] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:34:41 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:34:42.278255 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc8003d-21aa-4778-a285-c3fa60379131 service nova] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:42.298231 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db62d90-1709-4d37-ad31-1602e48749b1 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:42.302651 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc8003d-21aa-4778-a285-c3fa60379131 service nova] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:42.309449 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fcf39f-d458-421b-83af-ec4fb9eb042e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:42.310547 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fcf39f-d458-421b-83af-ec4fb9eb042e admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:42.311105 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fcf39f-d458-421b-83af-ec4fb9eb042e admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:42.311617 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fcf39f-d458-421b-83af-ec4fb9eb042e admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:42.312685 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fcf39f-d458-421b-83af-ec4fb9eb042e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:42.316196 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fcf39f-d458-421b-83af-ec4fb9eb042e admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:42.319143 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8152f53-25c1-4e63-b5db-231ee54aabd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:42.320202 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8152f53-25c1-4e63-b5db-231ee54aabd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:42.320813 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8152f53-25c1-4e63-b5db-231ee54aabd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:42.322073 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8152f53-25c1-4e63-b5db-231ee54aabd4 admin admin] PATH_INFO: `/v3/projects/fdadae8bc3034eaa8e4dad8bd88b8325/users/05dcb7349cc34d298d4b6a41799c612f/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:42.328984 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8152f53-25c1-4e63-b5db-231ee54aabd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdadae8bc3034eaa8e4dad8bd88b8325, user_id=05dcb7349cc34d298d4b6a41799c612f, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:42.334818 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8152f53-25c1-4e63-b5db-231ee54aabd4 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:42.340788 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 818/1634] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:34:42 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:34:42.348919 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00397016-55e0-4fa7-9e3d-3998cf8057ae None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:42.351297 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00397016-55e0-4fa7-9e3d-3998cf8057ae None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:42.352569 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00397016-55e0-4fa7-9e3d-3998cf8057ae None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:42.364113 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 819/1635] 10.222.0.16 () {54 vars in 912 bytes} [Thu May 26 12:34:42 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:34:42.368078 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00397016-55e0-4fa7-9e3d-3998cf8057ae None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:42.385625 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 817/1636] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:34:42 2022] PUT /identity/v3/projects/fdadae8bc3034eaa8e4dad8bd88b8325/users/05dcb7349cc34d298d4b6a41799c612f/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:42.390310 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad786f-8fb6-47ce-8118-586471d8d53f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:42.392152 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad786f-8fb6-47ce-8118-586471d8d53f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:42.392152 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad786f-8fb6-47ce-8118-586471d8d53f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:42.432993 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-6cad786f-8fb6-47ce-8118-586471d8d53f None None] MFA Rules not processed for user `536f68ff77794352adf41aaacdc0645c`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:42.434267 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6cad786f-8fb6-47ce-8118-586471d8d53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:42.505822 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:42.567139 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00397016-55e0-4fa7-9e3d-3998cf8057ae None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:42.580859 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2439cde-f334-4dd3-a3fc-57f219cd0062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:42.583460 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2439cde-f334-4dd3-a3fc-57f219cd0062 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:42.585151 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2439cde-f334-4dd3-a3fc-57f219cd0062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:42.585469 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2439cde-f334-4dd3-a3fc-57f219cd0062 admin admin] PATH_INFO: `/v3/projects/cf79d37c22144908b61ac9e66b442108/users/9abf6aae951a4900bed13b1076499c2b/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:42.593580 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2439cde-f334-4dd3-a3fc-57f219cd0062 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf79d37c22144908b61ac9e66b442108, user_id=9abf6aae951a4900bed13b1076499c2b, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:42.601529 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2439cde-f334-4dd3-a3fc-57f219cd0062 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:42.614497 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 818/1637] 10.222.0.16 () {58 vars in 1009 bytes} [Thu May 26 12:34:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:42.614972 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fb5f2-3447-4ce0-8377-bba5ea6c6460 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:42.615387 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fb5f2-3447-4ce0-8377-bba5ea6c6460 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:42.615772 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fb5f2-3447-4ce0-8377-bba5ea6c6460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:42.638685 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 820/1638] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:34:42 2022] PUT /identity/v3/projects/cf79d37c22144908b61ac9e66b442108/users/9abf6aae951a4900bed13b1076499c2b/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:42.639836 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2439cde-f334-4dd3-a3fc-57f219cd0062 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:42.688334 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-8f2fb5f2-3447-4ce0-8377-bba5ea6c6460 None None] MFA Rules not processed for user `05dcb7349cc34d298d4b6a41799c612f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:42.689822 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8f2fb5f2-3447-4ce0-8377-bba5ea6c6460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:42.799874 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:42.831891 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2439cde-f334-4dd3-a3fc-57f219cd0062 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:42.834582 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 819/1639] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:34:42 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:42.835934 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79e361-d7ec-49c6-906f-ac139e9ec1b7 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:42.836210 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79e361-d7ec-49c6-906f-ac139e9ec1b7 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:42.836490 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79e361-d7ec-49c6-906f-ac139e9ec1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:42.841482 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63af56ff-6f6f-4e8d-83ef-9fda585611b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:42.842216 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af56ff-6f6f-4e8d-83ef-9fda585611b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:42.842498 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af56ff-6f6f-4e8d-83ef-9fda585611b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:42.842770 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af56ff-6f6f-4e8d-83ef-9fda585611b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:42.922529 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-cf79e361-d7ec-49c6-906f-ac139e9ec1b7 None None] MFA Rules not processed for user `9abf6aae951a4900bed13b1076499c2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:42.924352 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-cf79e361-d7ec-49c6-906f-ac139e9ec1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:42.977212 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63af56ff-6f6f-4e8d-83ef-9fda585611b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:42.979050 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63af56ff-6f6f-4e8d-83ef-9fda585611b6 service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:42.995140 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 821/1640] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:34:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:34:42.996768 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63af56ff-6f6f-4e8d-83ef-9fda585611b6 service cinder] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:43.009829 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63af56ff-6f6f-4e8d-83ef-9fda585611b6 service cinder] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:43.014763 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c5917-814b-444e-916b-fc2b0b6cf031 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:43.015512 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c5917-814b-444e-916b-fc2b0b6cf031 service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:43.015870 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c5917-814b-444e-916b-fc2b0b6cf031 service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:43.016359 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c5917-814b-444e-916b-fc2b0b6cf031 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:43.031227 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11c5917-814b-444e-916b-fc2b0b6cf031 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:43.033571 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11c5917-814b-444e-916b-fc2b0b6cf031 service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:43.050112 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 822/1641] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:34:42 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:34:43.053132 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b21c5-fd39-40e3-b9df-cb4320172901 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:43.053634 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b21c5-fd39-40e3-b9df-cb4320172901 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:43.054014 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b21c5-fd39-40e3-b9df-cb4320172901 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:43.061965 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 823/1642] 10.222.0.16 () {54 vars in 912 bytes} [Thu May 26 12:34:43 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:34:43.064867 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89531717-5917-4adf-acb5-2943086aa721 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:43.065980 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89531717-5917-4adf-acb5-2943086aa721 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:43.066460 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89531717-5917-4adf-acb5-2943086aa721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:43.125878 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-89531717-5917-4adf-acb5-2943086aa721 None None] MFA Rules not processed for user `536f68ff77794352adf41aaacdc0645c`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:43.129827 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-89531717-5917-4adf-acb5-2943086aa721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:43.140597 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 820/1643] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:34:42 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:43.162161 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 824/1644] 10.222.0.16 () {58 vars in 1009 bytes} [Thu May 26 12:34:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:43.162814 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf79e361-d7ec-49c6-906f-ac139e9ec1b7 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:43.187498 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89531717-5917-4adf-acb5-2943086aa721 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:43.189576 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-89531717-5917-4adf-acb5-2943086aa721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:43.190252 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf79e361-d7ec-49c6-906f-ac139e9ec1b7 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:43.194618 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e9639-2839-48fd-8a5e-c07bffd74e69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:43.195282 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e9639-2839-48fd-8a5e-c07bffd74e69 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:43.195618 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e9639-2839-48fd-8a5e-c07bffd74e69 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:43.195901 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e9639-2839-48fd-8a5e-c07bffd74e69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:43.212323 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51e9639-2839-48fd-8a5e-c07bffd74e69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:43.217122 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51e9639-2839-48fd-8a5e-c07bffd74e69 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:43.245240 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 821/1645] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:34:43 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:34:43.346361 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89531717-5917-4adf-acb5-2943086aa721 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:43.355678 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbcb7a8-9a97-416b-b43c-97ce43c905fb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad8cfccd3a4d42d381ce62ea90849f19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:43.357132 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbcb7a8-9a97-416b-b43c-97ce43c905fb service glance] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:43.359020 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbcb7a8-9a97-416b-b43c-97ce43c905fb service glance] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:43.359312 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbcb7a8-9a97-416b-b43c-97ce43c905fb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:43.394420 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbcb7a8-9a97-416b-b43c-97ce43c905fb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:43.397966 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbcb7a8-9a97-416b-b43c-97ce43c905fb service glance] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:43.430903 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 825/1646] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:34:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:34:43.441745 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e9639-2839-48fd-8a5e-c07bffd74e69 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:43.453144 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e9639-2839-48fd-8a5e-c07bffd74e69 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:43.465593 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc8e5b8-03b5-4ce7-a0a2-57cddb8e76c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:43.466256 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8e5b8-03b5-4ce7-a0a2-57cddb8e76c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:43.466546 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8e5b8-03b5-4ce7-a0a2-57cddb8e76c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:43.468765 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8e5b8-03b5-4ce7-a0a2-57cddb8e76c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:43.540205 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:43.620910 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc8e5b8-03b5-4ce7-a0a2-57cddb8e76c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:43.624628 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc8e5b8-03b5-4ce7-a0a2-57cddb8e76c3 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:43.656489 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 822/1647] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:34:43 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:34:44.536711 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20a87d-9754-49a8-b007-9e3c17721a36 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:44.537357 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20a87d-9754-49a8-b007-9e3c17721a36 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:44.537452 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20a87d-9754-49a8-b007-9e3c17721a36 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:44.539163 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 826/1648] 10.222.0.16 () {54 vars in 912 bytes} [Thu May 26 12:34:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:34:44.548410 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f6883-9605-43c0-aaec-b0606b69b31f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:44.548892 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f6883-9605-43c0-aaec-b0606b69b31f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:44.548991 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f6883-9605-43c0-aaec-b0606b69b31f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:44.635756 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c23f6883-9605-43c0-aaec-b0606b69b31f None None] MFA Rules not processed for user `68033ffcafbc47bbadd008abd9e56c4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:44.639125 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c23f6883-9605-43c0-aaec-b0606b69b31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:44.796987 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 823/1649] 10.222.0.16 () {58 vars in 1009 bytes} [Thu May 26 12:34:44 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:44.835423 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb20a87d-9754-49a8-b007-9e3c17721a36 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:44.859193 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb20a87d-9754-49a8-b007-9e3c17721a36 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:44.875657 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ae2c99-b46b-4e41-a2b9-dfb9354a8224 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:44.878021 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae2c99-b46b-4e41-a2b9-dfb9354a8224 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:44.880082 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae2c99-b46b-4e41-a2b9-dfb9354a8224 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:44.881112 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae2c99-b46b-4e41-a2b9-dfb9354a8224 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:44.944550 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ae2c99-b46b-4e41-a2b9-dfb9354a8224 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:44.948806 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ae2c99-b46b-4e41-a2b9-dfb9354a8224 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:44.989475 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 827/1650] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:34:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:34:45.057700 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f6883-9605-43c0-aaec-b0606b69b31f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:45.164679 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f6883-9605-43c0-aaec-b0606b69b31f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:45.170909 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596fc427-8cb8-4a91-b919-d5f640ee2b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:45.171311 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596fc427-8cb8-4a91-b919-d5f640ee2b12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:45.188725 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596fc427-8cb8-4a91-b919-d5f640ee2b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:45.190291 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596fc427-8cb8-4a91-b919-d5f640ee2b12 admin admin] PATH_INFO: `/v3/users/9243ab99a1fd412499cb31518fa7fc91` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:45.192577 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596fc427-8cb8-4a91-b919-d5f640ee2b12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9243ab99a1fd412499cb31518fa7fc91)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:45.194959 dv-cinder-815146-11-smb devstack@keystone.service[80181]: WARNING py.warnings [None req-596fc427-8cb8-4a91-b919-d5f640ee2b12 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 12:34:45.194959 dv-cinder-815146-11-smb devstack@keystone.service[80181]: warnings.warn(msg) May 26 12:34:45.194959 dv-cinder-815146-11-smb devstack@keystone.service[80181]: May 26 12:34:45.199047 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596fc427-8cb8-4a91-b919-d5f640ee2b12 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:45.342893 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-596fc427-8cb8-4a91-b919-d5f640ee2b12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9243ab99a1fd412499cb31518fa7fc91'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:45.357878 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-596fc427-8cb8-4a91-b919-d5f640ee2b12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9243ab99a1fd412499cb31518fa7fc91'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:45.357878 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-596fc427-8cb8-4a91-b919-d5f640ee2b12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9243ab99a1fd412499cb31518fa7fc91'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:45.357878 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-596fc427-8cb8-4a91-b919-d5f640ee2b12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9243ab99a1fd412499cb31518fa7fc91'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:45.369751 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:45.374021 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-596fc427-8cb8-4a91-b919-d5f640ee2b12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9243ab99a1fd412499cb31518fa7fc91'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:45.413018 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a2e6b-9964-4a1a-8a73-651518e7f720 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:45.413528 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a2e6b-9964-4a1a-8a73-651518e7f720 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:45.413904 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a2e6b-9964-4a1a-8a73-651518e7f720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:45.417525 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 824/1651] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:34:45 2022] DELETE /identity/v3/users/9243ab99a1fd412499cb31518fa7fc91 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:45.457646 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-883a2e6b-9964-4a1a-8a73-651518e7f720 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:45.459398 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-883a2e6b-9964-4a1a-8a73-651518e7f720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:45.647378 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:45.672078 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 828/1652] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:34:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:45.688338 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596fc427-8cb8-4a91-b919-d5f640ee2b12 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:45.690839 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-596fc427-8cb8-4a91-b919-d5f640ee2b12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:45.789843 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596fc427-8cb8-4a91-b919-d5f640ee2b12 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:45.809752 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe791b-42ca-4619-8fa4-59bfbd39c520 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:45.811146 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe791b-42ca-4619-8fa4-59bfbd39c520 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:45.811736 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe791b-42ca-4619-8fa4-59bfbd39c520 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:45.812318 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe791b-42ca-4619-8fa4-59bfbd39c520 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:45.835282 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fe791b-42ca-4619-8fa4-59bfbd39c520 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:45.837236 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fe791b-42ca-4619-8fa4-59bfbd39c520 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:45.869054 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 825/1653] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:34:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:34:46.054752 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e359872-2c45-4bc4-9bd5-4d5a15c1bf83 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:46.055121 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e359872-2c45-4bc4-9bd5-4d5a15c1bf83 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:46.055409 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e359872-2c45-4bc4-9bd5-4d5a15c1bf83 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:46.057340 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 829/1654] 10.222.0.16 () {54 vars in 960 bytes} [Thu May 26 12:34:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:34:46.068165 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5fa61b-a0a2-4660-8e73-bdfe9b586539 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:46.068507 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5fa61b-a0a2-4660-8e73-bdfe9b586539 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:46.068791 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5fa61b-a0a2-4660-8e73-bdfe9b586539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:46.132768 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-cc5fa61b-a0a2-4660-8e73-bdfe9b586539 None None] MFA Rules not processed for user `4327435c97834afeb7e6806ef02349a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:46.134066 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-cc5fa61b-a0a2-4660-8e73-bdfe9b586539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:46.325724 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 826/1655] 10.222.0.16 () {58 vars in 1057 bytes} [Thu May 26 12:34:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:34:46.339011 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e359872-2c45-4bc4-9bd5-4d5a15c1bf83 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:46.365812 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e359872-2c45-4bc4-9bd5-4d5a15c1bf83 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:46.377569 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c20b93-11ae-46ac-bb3e-cbfd9769b188 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4327435c97834afeb7e6806ef02349a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:46.378358 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c20b93-11ae-46ac-bb3e-cbfd9769b188 service placement] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:46.378650 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c20b93-11ae-46ac-bb3e-cbfd9769b188 service placement] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:46.379181 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c20b93-11ae-46ac-bb3e-cbfd9769b188 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:46.382252 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-c3c20b93-11ae-46ac-bb3e-cbfd9769b188 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:46.430286 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c20b93-11ae-46ac-bb3e-cbfd9769b188 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:46.433962 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c20b93-11ae-46ac-bb3e-cbfd9769b188 service placement] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:46.474697 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 830/1656] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:34:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:34:47.051748 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5fa61b-a0a2-4660-8e73-bdfe9b586539 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:47.053842 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-cc5fa61b-a0a2-4660-8e73-bdfe9b586539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:47.091039 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5fa61b-a0a2-4660-8e73-bdfe9b586539 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:47.110523 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d9ef0-690f-449f-8c8b-6edca767cd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:47.111553 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d9ef0-690f-449f-8c8b-6edca767cd7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:47.120718 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d9ef0-690f-449f-8c8b-6edca767cd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:47.121194 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d9ef0-690f-449f-8c8b-6edca767cd7b admin admin] PATH_INFO: `/v3/projects/f71720f020284ee1af909f3338f93c50` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:47.123430 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62d9ef0-690f-449f-8c8b-6edca767cd7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f71720f020284ee1af909f3338f93c50)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:47.127861 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62d9ef0-690f-449f-8c8b-6edca767cd7b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:47.258766 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d62d9ef0-690f-449f-8c8b-6edca767cd7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f71720f020284ee1af909f3338f93c50', 'request_id': 'req-d62d9ef0-690f-449f-8c8b-6edca767cd7b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:47.271965 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d62d9ef0-690f-449f-8c8b-6edca767cd7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f71720f020284ee1af909f3338f93c50', 'request_id': 'req-d62d9ef0-690f-449f-8c8b-6edca767cd7b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:47.288350 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d62d9ef0-690f-449f-8c8b-6edca767cd7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f71720f020284ee1af909f3338f93c50', 'request_id': 'req-d62d9ef0-690f-449f-8c8b-6edca767cd7b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:47.315399 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:47.320531 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d62d9ef0-690f-449f-8c8b-6edca767cd7b admin admin] The token cache is being invalidate because project f71720f020284ee1af909f3338f93c50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:34:47.320976 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d62d9ef0-690f-449f-8c8b-6edca767cd7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:47.324200 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d62d9ef0-690f-449f-8c8b-6edca767cd7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:47.327903 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 827/1657] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:34:47 2022] DELETE /identity/v3/projects/f71720f020284ee1af909f3338f93c50 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:47.331862 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c20b93-11ae-46ac-bb3e-cbfd9769b188 service placement] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:47.351346 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c20b93-11ae-46ac-bb3e-cbfd9769b188 service placement] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:47.399162 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d9ef0-690f-449f-8c8b-6edca767cd7b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:47.401084 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d62d9ef0-690f-449f-8c8b-6edca767cd7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:47.569574 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d03601c-a4d0-4d77-a331-49b8dd1961b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:47.571472 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03601c-a4d0-4d77-a331-49b8dd1961b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:47.571938 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03601c-a4d0-4d77-a331-49b8dd1961b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:47.572377 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03601c-a4d0-4d77-a331-49b8dd1961b8 admin admin] PATH_INFO: `/v3/users/05dcb7349cc34d298d4b6a41799c612f` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:47.574616 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d03601c-a4d0-4d77-a331-49b8dd1961b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05dcb7349cc34d298d4b6a41799c612f)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:47.579788 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d03601c-a4d0-4d77-a331-49b8dd1961b8 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:47.609959 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d9ef0-690f-449f-8c8b-6edca767cd7b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:47.626177 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61b0d2-8976-42fa-b61d-a0e47bc3dc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:47.627512 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61b0d2-8976-42fa-b61d-a0e47bc3dc35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:47.627977 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61b0d2-8976-42fa-b61d-a0e47bc3dc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:47.629484 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61b0d2-8976-42fa-b61d-a0e47bc3dc35 admin admin] PATH_INFO: `/v3/users/7b0d8d7ebe6643749650e7a00fc3a1c8` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:47.633201 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d61b0d2-8976-42fa-b61d-a0e47bc3dc35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b0d8d7ebe6643749650e7a00fc3a1c8)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:47.640908 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d61b0d2-8976-42fa-b61d-a0e47bc3dc35 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:47.738077 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-1d03601c-a4d0-4d77-a331-49b8dd1961b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05dcb7349cc34d298d4b6a41799c612f'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:47.740961 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-1d03601c-a4d0-4d77-a331-49b8dd1961b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05dcb7349cc34d298d4b6a41799c612f'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:47.765134 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-1d03601c-a4d0-4d77-a331-49b8dd1961b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05dcb7349cc34d298d4b6a41799c612f'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:47.793454 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9d61b0d2-8976-42fa-b61d-a0e47bc3dc35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b0d8d7ebe6643749650e7a00fc3a1c8'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:47.795385 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-1d03601c-a4d0-4d77-a331-49b8dd1961b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05dcb7349cc34d298d4b6a41799c612f'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:47.813372 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9d61b0d2-8976-42fa-b61d-a0e47bc3dc35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b0d8d7ebe6643749650e7a00fc3a1c8'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:47.814625 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9d61b0d2-8976-42fa-b61d-a0e47bc3dc35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b0d8d7ebe6643749650e7a00fc3a1c8'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:47.815920 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9d61b0d2-8976-42fa-b61d-a0e47bc3dc35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b0d8d7ebe6643749650e7a00fc3a1c8'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:47.831155 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9d61b0d2-8976-42fa-b61d-a0e47bc3dc35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b0d8d7ebe6643749650e7a00fc3a1c8'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:47.843167 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-1d03601c-a4d0-4d77-a331-49b8dd1961b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05dcb7349cc34d298d4b6a41799c612f'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:47.872266 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 831/1658] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:34:47 2022] DELETE /identity/v3/users/05dcb7349cc34d298d4b6a41799c612f => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:47.897774 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 828/1659] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:34:47 2022] DELETE /identity/v3/users/7b0d8d7ebe6643749650e7a00fc3a1c8 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:47.901911 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08d93f-aca7-4a23-8ea9-9ee3e98bba0a None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:47.902209 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08d93f-aca7-4a23-8ea9-9ee3e98bba0a None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:47.902505 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08d93f-aca7-4a23-8ea9-9ee3e98bba0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:47.949378 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-7e08d93f-aca7-4a23-8ea9-9ee3e98bba0a None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:47.953373 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-7e08d93f-aca7-4a23-8ea9-9ee3e98bba0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:48.149909 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:48.171828 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 832/1660] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:34:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:48.229584 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61b0d2-8976-42fa-b61d-a0e47bc3dc35 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:48.231092 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9d61b0d2-8976-42fa-b61d-a0e47bc3dc35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:48.485499 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61b0d2-8976-42fa-b61d-a0e47bc3dc35 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:48.499073 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898b66d5-3766-4b5b-9369-ff9e0ecd46d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:48.500234 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b66d5-3766-4b5b-9369-ff9e0ecd46d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:48.500526 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b66d5-3766-4b5b-9369-ff9e0ecd46d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:48.500799 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b66d5-3766-4b5b-9369-ff9e0ecd46d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:48.523997 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898b66d5-3766-4b5b-9369-ff9e0ecd46d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:48.527155 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898b66d5-3766-4b5b-9369-ff9e0ecd46d2 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:48.544468 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 829/1661] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:34:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:34:49.185258 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e08d93f-aca7-4a23-8ea9-9ee3e98bba0a None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:49.188095 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-7e08d93f-aca7-4a23-8ea9-9ee3e98bba0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:49.227927 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e08d93f-aca7-4a23-8ea9-9ee3e98bba0a None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:49.243520 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bae53a-ce1f-4765-820b-213a62f28817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:49.245195 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bae53a-ce1f-4765-820b-213a62f28817 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:49.245651 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bae53a-ce1f-4765-820b-213a62f28817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:49.246119 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bae53a-ce1f-4765-820b-213a62f28817 admin admin] PATH_INFO: `/v3/projects/fdadae8bc3034eaa8e4dad8bd88b8325` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:49.248925 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bae53a-ce1f-4765-820b-213a62f28817 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdadae8bc3034eaa8e4dad8bd88b8325)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:49.249962 dv-cinder-815146-11-smb devstack@keystone.service[80180]: WARNING py.warnings [None req-01bae53a-ce1f-4765-820b-213a62f28817 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 12:34:49.249962 dv-cinder-815146-11-smb devstack@keystone.service[80180]: warnings.warn(msg) May 26 12:34:49.249962 dv-cinder-815146-11-smb devstack@keystone.service[80180]: May 26 12:34:49.251178 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bae53a-ce1f-4765-820b-213a62f28817 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:49.420984 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-01bae53a-ce1f-4765-820b-213a62f28817 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdadae8bc3034eaa8e4dad8bd88b8325', 'request_id': 'req-01bae53a-ce1f-4765-820b-213a62f28817'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:49.445112 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-01bae53a-ce1f-4765-820b-213a62f28817 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdadae8bc3034eaa8e4dad8bd88b8325', 'request_id': 'req-01bae53a-ce1f-4765-820b-213a62f28817'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:49.799960 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-01bae53a-ce1f-4765-820b-213a62f28817 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdadae8bc3034eaa8e4dad8bd88b8325', 'request_id': 'req-01bae53a-ce1f-4765-820b-213a62f28817'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:49.831882 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-01bae53a-ce1f-4765-820b-213a62f28817 admin admin] The token cache is being invalidate because project fdadae8bc3034eaa8e4dad8bd88b8325 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:34:49.831882 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-01bae53a-ce1f-4765-820b-213a62f28817 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:49.832599 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-01bae53a-ce1f-4765-820b-213a62f28817 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:49.834703 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 833/1662] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:34:49 2022] DELETE /identity/v3/projects/fdadae8bc3034eaa8e4dad8bd88b8325 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:49.839735 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb0206-d340-4da6-b7f4-759e935135a5 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:49.840257 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb0206-d340-4da6-b7f4-759e935135a5 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:49.840451 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb0206-d340-4da6-b7f4-759e935135a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:49.880295 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bae53a-ce1f-4765-820b-213a62f28817 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:49.882919 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-01bae53a-ce1f-4765-820b-213a62f28817 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:49.890151 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-4ebb0206-d340-4da6-b7f4-759e935135a5 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:49.891538 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4ebb0206-d340-4da6-b7f4-759e935135a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:49.938357 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:50.065508 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bae53a-ce1f-4765-820b-213a62f28817 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:50.094510 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66410f54-0ecb-410c-af42-f4207af104e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:50.096013 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66410f54-0ecb-410c-af42-f4207af104e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:50.096498 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66410f54-0ecb-410c-af42-f4207af104e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:50.098174 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66410f54-0ecb-410c-af42-f4207af104e0 admin admin] PATH_INFO: `/v3/users/aee5f29e143942d9bb117aafa685144e` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:50.104711 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66410f54-0ecb-410c-af42-f4207af104e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aee5f29e143942d9bb117aafa685144e)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:50.110240 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66410f54-0ecb-410c-af42-f4207af104e0 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:50.362723 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-66410f54-0ecb-410c-af42-f4207af104e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aee5f29e143942d9bb117aafa685144e'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:50.363793 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-66410f54-0ecb-410c-af42-f4207af104e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aee5f29e143942d9bb117aafa685144e'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:50.369348 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-66410f54-0ecb-410c-af42-f4207af104e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aee5f29e143942d9bb117aafa685144e'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:50.402734 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-66410f54-0ecb-410c-af42-f4207af104e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aee5f29e143942d9bb117aafa685144e'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:50.458666 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-66410f54-0ecb-410c-af42-f4207af104e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aee5f29e143942d9bb117aafa685144e'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:50.495340 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 834/1663] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:34:49 2022] DELETE /identity/v3/users/aee5f29e143942d9bb117aafa685144e => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:50.496727 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb83f9-2d6d-4122-9cec-265922eeb1cb None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:50.498116 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb83f9-2d6d-4122-9cec-265922eeb1cb None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:50.498407 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb83f9-2d6d-4122-9cec-265922eeb1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:50.501213 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 830/1664] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:34:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 663 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:50.505354 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155fc123-5b4c-467e-a910-5fd263c1a3aa None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:50.505658 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155fc123-5b4c-467e-a910-5fd263c1a3aa None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:50.505941 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155fc123-5b4c-467e-a910-5fd263c1a3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:50.514840 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:50.531392 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-81fb83f9-2d6d-4122-9cec-265922eeb1cb None None] MFA Rules not processed for user `512b4337083145f9ae57948a63444ced`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:50.535632 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-81fb83f9-2d6d-4122-9cec-265922eeb1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:50.560346 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-155fc123-5b4c-467e-a910-5fd263c1a3aa None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:50.562072 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-155fc123-5b4c-467e-a910-5fd263c1a3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:50.615225 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 835/1665] 10.222.0.16 () {58 vars in 1009 bytes} [Thu May 26 12:34:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:50.616614 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b6213-71f5-4f2b-b10f-87fd96ef650f None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:50.617203 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b6213-71f5-4f2b-b10f-87fd96ef650f None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:50.619657 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b6213-71f5-4f2b-b10f-87fd96ef650f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:50.664066 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-ef7b6213-71f5-4f2b-b10f-87fd96ef650f None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:50.665327 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-ef7b6213-71f5-4f2b-b10f-87fd96ef650f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:50.726906 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 831/1666] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:34:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:50.770634 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155fc123-5b4c-467e-a910-5fd263c1a3aa None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:50.772732 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-155fc123-5b4c-467e-a910-5fd263c1a3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:50.847075 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 836/1667] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:34:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:50.851372 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b6213-71f5-4f2b-b10f-87fd96ef650f None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:50.894792 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b6213-71f5-4f2b-b10f-87fd96ef650f None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:50.905983 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155fc123-5b4c-467e-a910-5fd263c1a3aa None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:50.912199 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0243c773-ad72-4e70-ab0e-1b9472d91dc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:50.914518 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72762949-ef75-4fce-8900-dac5677cd7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:50.915192 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72762949-ef75-4fce-8900-dac5677cd7a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:50.915473 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72762949-ef75-4fce-8900-dac5677cd7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:50.915745 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72762949-ef75-4fce-8900-dac5677cd7a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:50.916487 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72762949-ef75-4fce-8900-dac5677cd7a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:34:50.916785 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72762949-ef75-4fce-8900-dac5677cd7a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:50.918414 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243c773-ad72-4e70-ab0e-1b9472d91dc5 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:50.918759 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243c773-ad72-4e70-ab0e-1b9472d91dc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:50.919031 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243c773-ad72-4e70-ab0e-1b9472d91dc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:50.927569 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72762949-ef75-4fce-8900-dac5677cd7a3 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:50.950008 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0243c773-ad72-4e70-ab0e-1b9472d91dc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:50.951544 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0243c773-ad72-4e70-ab0e-1b9472d91dc5 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:50.968964 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 837/1668] 10.222.0.16 () {58 vars in 1152 bytes} [Thu May 26 12:34:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:34:50.975430 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72762949-ef75-4fce-8900-dac5677cd7a3 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:50.980748 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-72762949-ef75-4fce-8900-dac5677cd7a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:50.991538 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 832/1669] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:34:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:34:50.992430 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0243c773-ad72-4e70-ab0e-1b9472d91dc5 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:51.013686 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0243c773-ad72-4e70-ab0e-1b9472d91dc5 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:51.032060 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d459c8f8-b56b-4364-9851-9e18990ef260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:51.032736 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459c8f8-b56b-4364-9851-9e18990ef260 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:51.033041 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459c8f8-b56b-4364-9851-9e18990ef260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:51.033313 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459c8f8-b56b-4364-9851-9e18990ef260 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:51.034007 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d459c8f8-b56b-4364-9851-9e18990ef260 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:51.035964 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d459c8f8-b56b-4364-9851-9e18990ef260 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:51.115287 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 833/1670] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:34:50 2022] POST /identity/v3/projects => generated 367 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:34:51.122078 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d459c8f8-b56b-4364-9851-9e18990ef260 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:51.133070 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72762949-ef75-4fce-8900-dac5677cd7a3 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:51.193322 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:51.228528 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:51.296467 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d459c8f8-b56b-4364-9851-9e18990ef260 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:51.313205 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74404a81-ee66-458f-8c4a-aa48a50c61c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:51.314020 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74404a81-ee66-458f-8c4a-aa48a50c61c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:51.314309 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74404a81-ee66-458f-8c4a-aa48a50c61c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:51.314766 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5882638d-148d-46d5-b762-771b1e4b2cc0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02767dcbd1574e08a9e82a775ac2b289', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:51.315568 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882638d-148d-46d5-b762-771b1e4b2cc0 service swift] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:51.315856 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882638d-148d-46d5-b762-771b1e4b2cc0 service swift] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:51.316134 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882638d-148d-46d5-b762-771b1e4b2cc0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:51.316797 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74404a81-ee66-458f-8c4a-aa48a50c61c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:51.317644 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74404a81-ee66-458f-8c4a-aa48a50c61c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:51.325008 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74404a81-ee66-458f-8c4a-aa48a50c61c7 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:51.392192 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 834/1671] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:34:51 2022] POST /identity/v3/users => generated 284 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:34:51.394369 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74404a81-ee66-458f-8c4a-aa48a50c61c7 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:51.397446 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-74404a81-ee66-458f-8c4a-aa48a50c61c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:51.492113 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74404a81-ee66-458f-8c4a-aa48a50c61c7 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:51.505551 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d227998-77b4-4256-9d51-79386a84d72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:51.507921 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d227998-77b4-4256-9d51-79386a84d72b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:51.508690 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d227998-77b4-4256-9d51-79386a84d72b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:51.509285 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d227998-77b4-4256-9d51-79386a84d72b admin admin] PATH_INFO: `/v3/projects/459a6488cea344dcb7a646c82a8ff7ea` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:51.514718 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d227998-77b4-4256-9d51-79386a84d72b admin admin] RBAC: Authorizing `identity:delete_project(project_id=459a6488cea344dcb7a646c82a8ff7ea)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:51.518108 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d227998-77b4-4256-9d51-79386a84d72b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:51.575581 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5882638d-148d-46d5-b762-771b1e4b2cc0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:51.584657 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5882638d-148d-46d5-b762-771b1e4b2cc0 service swift] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:51.607918 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 838/1672] 10.222.0.16 () {60 vars in 1384 bytes} [Thu May 26 12:34:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 633 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:34:51.611373 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5882638d-148d-46d5-b762-771b1e4b2cc0 service swift] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:51.637273 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5882638d-148d-46d5-b762-771b1e4b2cc0 service swift] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:51.643447 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8d227998-77b4-4256-9d51-79386a84d72b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '459a6488cea344dcb7a646c82a8ff7ea', 'request_id': 'req-8d227998-77b4-4256-9d51-79386a84d72b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:51.662727 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8d227998-77b4-4256-9d51-79386a84d72b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '459a6488cea344dcb7a646c82a8ff7ea', 'request_id': 'req-8d227998-77b4-4256-9d51-79386a84d72b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:51.675955 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8d227998-77b4-4256-9d51-79386a84d72b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '459a6488cea344dcb7a646c82a8ff7ea', 'request_id': 'req-8d227998-77b4-4256-9d51-79386a84d72b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:51.708006 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8d227998-77b4-4256-9d51-79386a84d72b admin admin] The token cache is being invalidate because project 459a6488cea344dcb7a646c82a8ff7ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:34:51.708292 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8d227998-77b4-4256-9d51-79386a84d72b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:51.709938 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8d227998-77b4-4256-9d51-79386a84d72b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:51.717697 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 835/1673] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:34:51 2022] DELETE /identity/v3/projects/459a6488cea344dcb7a646c82a8ff7ea => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:51.719704 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5239e-5200-4800-8c58-73b9fec17a1e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:51.720004 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5239e-5200-4800-8c58-73b9fec17a1e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:51.726587 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5239e-5200-4800-8c58-73b9fec17a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:51.833399 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-bfa5239e-5200-4800-8c58-73b9fec17a1e None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:51.835088 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-bfa5239e-5200-4800-8c58-73b9fec17a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:51.858726 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61177536-fd8b-49db-ac5a-1a682ae99a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:51.862926 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61177536-fd8b-49db-ac5a-1a682ae99a68 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:51.863115 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61177536-fd8b-49db-ac5a-1a682ae99a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:51.863589 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61177536-fd8b-49db-ac5a-1a682ae99a68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:51.864402 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61177536-fd8b-49db-ac5a-1a682ae99a68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:51.871116 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61177536-fd8b-49db-ac5a-1a682ae99a68 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:51.895951 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 839/1674] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:34:51 2022] GET /identity/v3/roles => generated 1420 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:34:51.897586 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61177536-fd8b-49db-ac5a-1a682ae99a68 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:51.901106 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-61177536-fd8b-49db-ac5a-1a682ae99a68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:51.943732 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61177536-fd8b-49db-ac5a-1a682ae99a68 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:51.957330 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c787234b-27dd-47f8-9653-c17fd4814cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:51.959012 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787234b-27dd-47f8-9653-c17fd4814cb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:51.960408 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787234b-27dd-47f8-9653-c17fd4814cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:51.960990 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787234b-27dd-47f8-9653-c17fd4814cb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:51.965118 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c787234b-27dd-47f8-9653-c17fd4814cb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:51.966918 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c787234b-27dd-47f8-9653-c17fd4814cb0 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:51.999288 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 840/1675] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:34:51 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:34:52.006394 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c787234b-27dd-47f8-9653-c17fd4814cb0 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:52.047067 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c787234b-27dd-47f8-9653-c17fd4814cb0 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:52.065166 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84867302-de66-4ec0-a99b-d2eea5c424db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:52.065944 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 836/1676] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:34:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:52.066517 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84867302-de66-4ec0-a99b-d2eea5c424db admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:52.066517 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84867302-de66-4ec0-a99b-d2eea5c424db admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:52.066967 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84867302-de66-4ec0-a99b-d2eea5c424db admin admin] PATH_INFO: `/v3/projects/224b1677b39f4df49242495646d0d493/users/88bf790f48a64c33aedbad4b623b74bc/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:52.082370 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922896c5-ed9a-450d-b1c3-3ff965a75fe1 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:52.082813 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922896c5-ed9a-450d-b1c3-3ff965a75fe1 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:52.083101 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922896c5-ed9a-450d-b1c3-3ff965a75fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:52.136487 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84867302-de66-4ec0-a99b-d2eea5c424db admin admin] RBAC: Authorizing `identity:create_grant(project_id=224b1677b39f4df49242495646d0d493, user_id=88bf790f48a64c33aedbad4b623b74bc, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:52.144805 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-922896c5-ed9a-450d-b1c3-3ff965a75fe1 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:52.151457 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84867302-de66-4ec0-a99b-d2eea5c424db admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:52.151702 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-922896c5-ed9a-450d-b1c3-3ff965a75fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:52.203481 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 837/1677] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:34:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:52.206388 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922896c5-ed9a-450d-b1c3-3ff965a75fe1 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:52.207166 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 841/1678] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:34:52 2022] PUT /identity/v3/projects/224b1677b39f4df49242495646d0d493/users/88bf790f48a64c33aedbad4b623b74bc/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:52.217996 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a425a75e-0945-4fe5-a5b9-10d74f721e3f None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:52.218359 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a425a75e-0945-4fe5-a5b9-10d74f721e3f None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:52.218715 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a425a75e-0945-4fe5-a5b9-10d74f721e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:52.233962 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922896c5-ed9a-450d-b1c3-3ff965a75fe1 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:52.316213 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-a425a75e-0945-4fe5-a5b9-10d74f721e3f None None] MFA Rules not processed for user `88bf790f48a64c33aedbad4b623b74bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:52.317481 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-a425a75e-0945-4fe5-a5b9-10d74f721e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:52.411511 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:52.420715 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:52.439456 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d513ba-e3a2-4278-a4e5-641636b8ac9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:52.440573 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d513ba-e3a2-4278-a4e5-641636b8ac9f admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:52.441220 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d513ba-e3a2-4278-a4e5-641636b8ac9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:52.441696 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d513ba-e3a2-4278-a4e5-641636b8ac9f admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:52.444181 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d513ba-e3a2-4278-a4e5-641636b8ac9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:34:52.447835 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d513ba-e3a2-4278-a4e5-641636b8ac9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:52.450141 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d513ba-e3a2-4278-a4e5-641636b8ac9f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:52.486635 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 838/1679] 10.222.0.16 () {58 vars in 1152 bytes} [Thu May 26 12:34:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:34:52.490147 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d513ba-e3a2-4278-a4e5-641636b8ac9f admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:52.518484 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d513ba-e3a2-4278-a4e5-641636b8ac9f admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:52.530461 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 842/1680] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:34:52 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:52.531138 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade051d5-00f3-471b-81bb-8384ae3ac93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:52.531918 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade051d5-00f3-471b-81bb-8384ae3ac93a admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:52.532652 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade051d5-00f3-471b-81bb-8384ae3ac93a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:52.532959 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade051d5-00f3-471b-81bb-8384ae3ac93a admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:52.533670 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade051d5-00f3-471b-81bb-8384ae3ac93a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:52.536062 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade051d5-00f3-471b-81bb-8384ae3ac93a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:52.545740 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a425a75e-0945-4fe5-a5b9-10d74f721e3f None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:52.553040 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-a425a75e-0945-4fe5-a5b9-10d74f721e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:52.676701 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 839/1681] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:34:52 2022] POST /identity/v3/projects => generated 371 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:34:52.678296 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8d1aa-6b6f-4b11-8738-7250e30944dd None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:52.678586 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8d1aa-6b6f-4b11-8738-7250e30944dd None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:52.678865 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8d1aa-6b6f-4b11-8738-7250e30944dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:52.800945 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-1be8d1aa-6b6f-4b11-8738-7250e30944dd None None] MFA Rules not processed for user `ae9585c4fe0c4d0eb1a820c9dc096a89`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:52.803538 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1be8d1aa-6b6f-4b11-8738-7250e30944dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:52.814361 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a425a75e-0945-4fe5-a5b9-10d74f721e3f None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:52.963371 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5310e4b-019f-4bdf-a89d-c32da854de73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:52.964439 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5310e4b-019f-4bdf-a89d-c32da854de73 service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:52.965542 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5310e4b-019f-4bdf-a89d-c32da854de73 service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:52.965969 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5310e4b-019f-4bdf-a89d-c32da854de73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:53.008684 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 840/1682] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:34:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:53.011300 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be8d1aa-6b6f-4b11-8738-7250e30944dd None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:53.143876 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5310e4b-019f-4bdf-a89d-c32da854de73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:53.147891 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5310e4b-019f-4bdf-a89d-c32da854de73 service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:53.174160 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 843/1683] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:34:52 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 629 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:34:53.175416 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5310e4b-019f-4bdf-a89d-c32da854de73 service cinder] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:53.176863 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-a5310e4b-019f-4bdf-a89d-c32da854de73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:53.218378 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be8d1aa-6b6f-4b11-8738-7250e30944dd None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:53.230636 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f242e7-2ee1-42af-b016-4b6966709418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:53.231398 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f242e7-2ee1-42af-b016-4b6966709418 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:53.231680 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f242e7-2ee1-42af-b016-4b6966709418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:53.232279 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f242e7-2ee1-42af-b016-4b6966709418 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:53.233571 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f242e7-2ee1-42af-b016-4b6966709418 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:53.235876 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f242e7-2ee1-42af-b016-4b6966709418 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:53.279461 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 841/1684] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:34:53 2022] POST /identity/v3/users => generated 286 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:34:53.280340 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f242e7-2ee1-42af-b016-4b6966709418 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:53.291303 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-55f242e7-2ee1-42af-b016-4b6966709418 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:53.292419 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:53.359874 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5310e4b-019f-4bdf-a89d-c32da854de73 service cinder] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:53.372391 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118bbd77-3fde-4e62-992d-f9b5189b2c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:53.373367 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118bbd77-3fde-4e62-992d-f9b5189b2c2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:53.373654 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118bbd77-3fde-4e62-992d-f9b5189b2c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:53.373932 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118bbd77-3fde-4e62-992d-f9b5189b2c2e admin admin] PATH_INFO: `/v3/projects/a1d95e2f8d034f28ae53f6495a592548` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:53.375161 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118bbd77-3fde-4e62-992d-f9b5189b2c2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1d95e2f8d034f28ae53f6495a592548)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:53.377300 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118bbd77-3fde-4e62-992d-f9b5189b2c2e admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:53.469681 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:53.531793 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-118bbd77-3fde-4e62-992d-f9b5189b2c2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1d95e2f8d034f28ae53f6495a592548', 'request_id': 'req-118bbd77-3fde-4e62-992d-f9b5189b2c2e'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:53.551246 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-118bbd77-3fde-4e62-992d-f9b5189b2c2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1d95e2f8d034f28ae53f6495a592548', 'request_id': 'req-118bbd77-3fde-4e62-992d-f9b5189b2c2e'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:53.570022 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-118bbd77-3fde-4e62-992d-f9b5189b2c2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1d95e2f8d034f28ae53f6495a592548', 'request_id': 'req-118bbd77-3fde-4e62-992d-f9b5189b2c2e'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:53.582218 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f242e7-2ee1-42af-b016-4b6966709418 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:53.614517 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-118bbd77-3fde-4e62-992d-f9b5189b2c2e admin admin] The token cache is being invalidate because project a1d95e2f8d034f28ae53f6495a592548 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:34:53.614853 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-118bbd77-3fde-4e62-992d-f9b5189b2c2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:53.621799 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-118bbd77-3fde-4e62-992d-f9b5189b2c2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:53.633423 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 844/1685] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:34:53 2022] DELETE /identity/v3/projects/a1d95e2f8d034f28ae53f6495a592548 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:53.633423 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118bbd77-3fde-4e62-992d-f9b5189b2c2e admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:53.636289 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-118bbd77-3fde-4e62-992d-f9b5189b2c2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:53.776250 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d4ab89-a6bb-4c5e-9ed0-795b66a0afd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536f68ff77794352adf41aaacdc0645c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:53.778376 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d4ab89-a6bb-4c5e-9ed0-795b66a0afd3 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:53.778811 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d4ab89-a6bb-4c5e-9ed0-795b66a0afd3 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:53.783071 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d4ab89-a6bb-4c5e-9ed0-795b66a0afd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:53.786970 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-21d4ab89-a6bb-4c5e-9ed0-795b66a0afd3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:53.878881 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118bbd77-3fde-4e62-992d-f9b5189b2c2e admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:53.894156 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5bf286-5be0-4c2e-b841-06c95d2146c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:53.895253 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5bf286-5be0-4c2e-b841-06c95d2146c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:53.895541 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5bf286-5be0-4c2e-b841-06c95d2146c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:53.895815 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5bf286-5be0-4c2e-b841-06c95d2146c1 admin admin] PATH_INFO: `/v3/users/88bf790f48a64c33aedbad4b623b74bc` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:53.897119 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5bf286-5be0-4c2e-b841-06c95d2146c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88bf790f48a64c33aedbad4b623b74bc)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:53.899983 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5bf286-5be0-4c2e-b841-06c95d2146c1 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:53.996026 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d4ab89-a6bb-4c5e-9ed0-795b66a0afd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:54.003591 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d4ab89-a6bb-4c5e-9ed0-795b66a0afd3 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:54.018058 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-ee5bf286-5be0-4c2e-b841-06c95d2146c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88bf790f48a64c33aedbad4b623b74bc'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:54.020371 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-ee5bf286-5be0-4c2e-b841-06c95d2146c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88bf790f48a64c33aedbad4b623b74bc'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:54.021197 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-ee5bf286-5be0-4c2e-b841-06c95d2146c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88bf790f48a64c33aedbad4b623b74bc'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:54.037366 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-ee5bf286-5be0-4c2e-b841-06c95d2146c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88bf790f48a64c33aedbad4b623b74bc'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:54.062207 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 842/1686] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:34:53 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 782 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:34:54.064620 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d4ab89-a6bb-4c5e-9ed0-795b66a0afd3 service nova] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:54.071825 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-21d4ab89-a6bb-4c5e-9ed0-795b66a0afd3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:54.077797 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-ee5bf286-5be0-4c2e-b841-06c95d2146c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88bf790f48a64c33aedbad4b623b74bc'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:54.079320 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:54.138409 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d4ab89-a6bb-4c5e-9ed0-795b66a0afd3 service nova] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:54.151031 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 845/1687] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:34:53 2022] DELETE /identity/v3/users/88bf790f48a64c33aedbad4b623b74bc => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:54.152651 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5bf286-5be0-4c2e-b841-06c95d2146c1 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:54.158242 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-ee5bf286-5be0-4c2e-b841-06c95d2146c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:54.159028 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f19e7-8b88-4c1e-b7f9-9cf3454b9721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:54.162160 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f19e7-8b88-4c1e-b7f9-9cf3454b9721 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:54.162509 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f19e7-8b88-4c1e-b7f9-9cf3454b9721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:54.164671 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f19e7-8b88-4c1e-b7f9-9cf3454b9721 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:54.168681 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7f19e7-8b88-4c1e-b7f9-9cf3454b9721 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:54.179079 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7f19e7-8b88-4c1e-b7f9-9cf3454b9721 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:54.227357 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 843/1688] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:34:54.232109 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f19e7-8b88-4c1e-b7f9-9cf3454b9721 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:54.250735 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6b7f19e7-8b88-4c1e-b7f9-9cf3454b9721 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:54.308474 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f19e7-8b88-4c1e-b7f9-9cf3454b9721 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:54.487851 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5bf286-5be0-4c2e-b841-06c95d2146c1 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:54.510113 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa6bf8-c943-4d98-a0ae-4172c8e02121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:54.513264 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa6bf8-c943-4d98-a0ae-4172c8e02121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:54.515566 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa6bf8-c943-4d98-a0ae-4172c8e02121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:54.516138 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa6bf8-c943-4d98-a0ae-4172c8e02121 admin admin] PATH_INFO: `/v3/users/9abf6aae951a4900bed13b1076499c2b` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:54.525825 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa6bf8-c943-4d98-a0ae-4172c8e02121 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9abf6aae951a4900bed13b1076499c2b)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:54.529897 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa6bf8-c943-4d98-a0ae-4172c8e02121 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:54.642980 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e05a3a2-a677-4e00-83db-6a15823767e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:54.643937 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05a3a2-a677-4e00-83db-6a15823767e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:54.644237 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05a3a2-a677-4e00-83db-6a15823767e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:54.644513 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05a3a2-a677-4e00-83db-6a15823767e5 admin admin] PATH_INFO: `/v3/users/699beef896a74de98e314db78b2aa689` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:54.655196 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e05a3a2-a677-4e00-83db-6a15823767e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=699beef896a74de98e314db78b2aa689)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:54.656916 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e05a3a2-a677-4e00-83db-6a15823767e5 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:54.677913 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-2faa6bf8-c943-4d98-a0ae-4172c8e02121 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9abf6aae951a4900bed13b1076499c2b'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:54.679411 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-2faa6bf8-c943-4d98-a0ae-4172c8e02121 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9abf6aae951a4900bed13b1076499c2b'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:54.679983 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:54.685884 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-2faa6bf8-c943-4d98-a0ae-4172c8e02121 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9abf6aae951a4900bed13b1076499c2b'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:54.703197 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-2faa6bf8-c943-4d98-a0ae-4172c8e02121 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9abf6aae951a4900bed13b1076499c2b'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:54.739850 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-2faa6bf8-c943-4d98-a0ae-4172c8e02121 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9abf6aae951a4900bed13b1076499c2b'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:54.788483 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 846/1689] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:34:54 2022] DELETE /identity/v3/users/9abf6aae951a4900bed13b1076499c2b => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:54.793961 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652fa562-bbd3-4f8b-9acd-232e800b9637 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:54.795469 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652fa562-bbd3-4f8b-9acd-232e800b9637 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:54.795781 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652fa562-bbd3-4f8b-9acd-232e800b9637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:54.801988 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-1e05a3a2-a677-4e00-83db-6a15823767e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '699beef896a74de98e314db78b2aa689'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:54.822999 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-1e05a3a2-a677-4e00-83db-6a15823767e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '699beef896a74de98e314db78b2aa689'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:54.824252 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-1e05a3a2-a677-4e00-83db-6a15823767e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '699beef896a74de98e314db78b2aa689'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:54.826953 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-1e05a3a2-a677-4e00-83db-6a15823767e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '699beef896a74de98e314db78b2aa689'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:54.851416 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-1e05a3a2-a677-4e00-83db-6a15823767e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '699beef896a74de98e314db78b2aa689'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:54.856341 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-652fa562-bbd3-4f8b-9acd-232e800b9637 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:54.864575 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-652fa562-bbd3-4f8b-9acd-232e800b9637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:54.926011 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 844/1690] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:34:54 2022] DELETE /identity/v3/users/699beef896a74de98e314db78b2aa689 => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:54.927015 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e05a3a2-a677-4e00-83db-6a15823767e5 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:54.929946 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1e05a3a2-a677-4e00-83db-6a15823767e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:55.058524 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 847/1691] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:34:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:55.058524 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2570b7-6162-45e3-bc1e-49bd03a113eb None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:55.058524 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2570b7-6162-45e3-bc1e-49bd03a113eb None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:55.058524 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2570b7-6162-45e3-bc1e-49bd03a113eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:55.083252 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e05a3a2-a677-4e00-83db-6a15823767e5 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:55.086434 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-ac2570b7-6162-45e3-bc1e-49bd03a113eb None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:55.091149 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-ac2570b7-6162-45e3-bc1e-49bd03a113eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:55.103178 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf08d8e-31d2-447e-be00-62c633056901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:55.104154 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf08d8e-31d2-447e-be00-62c633056901 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:55.104609 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf08d8e-31d2-447e-be00-62c633056901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:55.105050 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf08d8e-31d2-447e-be00-62c633056901 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:55.106113 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf08d8e-31d2-447e-be00-62c633056901 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:55.108754 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf08d8e-31d2-447e-be00-62c633056901 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:55.118771 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 848/1692] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:34:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:55.137867 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 845/1693] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:34:55.142846 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2570b7-6162-45e3-bc1e-49bd03a113eb None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:55.158187 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:55.174337 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2570b7-6162-45e3-bc1e-49bd03a113eb None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:55.206534 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f326f861-5ee9-4385-9da6-7dfbe4951c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:55.207689 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326f861-5ee9-4385-9da6-7dfbe4951c2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:55.209129 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326f861-5ee9-4385-9da6-7dfbe4951c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:55.210151 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326f861-5ee9-4385-9da6-7dfbe4951c2e admin admin] PATH_INFO: `/v3/projects/896dcea7331d41808d26c7ef8a14775b/users/4fbaa6b231994fb4bebc045b5f581b74/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:55.238010 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf08d8e-31d2-447e-be00-62c633056901 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:55.240410 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ddf08d8e-31d2-447e-be00-62c633056901 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:55.261878 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f326f861-5ee9-4385-9da6-7dfbe4951c2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=896dcea7331d41808d26c7ef8a14775b, user_id=4fbaa6b231994fb4bebc045b5f581b74, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:55.273249 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f326f861-5ee9-4385-9da6-7dfbe4951c2e admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:55.328375 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 849/1694] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:34:55 2022] PUT /identity/v3/projects/896dcea7331d41808d26c7ef8a14775b/users/4fbaa6b231994fb4bebc045b5f581b74/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:55.334654 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f326f861-5ee9-4385-9da6-7dfbe4951c2e admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:55.340591 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-f326f861-5ee9-4385-9da6-7dfbe4951c2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:55.517973 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf08d8e-31d2-447e-be00-62c633056901 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:55.609944 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f326f861-5ee9-4385-9da6-7dfbe4951c2e admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:55.626857 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eecba8e-4a26-4ed9-8a0f-934ceb59c710 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:55.627554 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eecba8e-4a26-4ed9-8a0f-934ceb59c710 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:55.627849 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eecba8e-4a26-4ed9-8a0f-934ceb59c710 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:55.628072 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eecba8e-4a26-4ed9-8a0f-934ceb59c710 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:55.638040 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:55.695786 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289030c4-d909-4147-8b7c-65324b741d22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:55.697705 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289030c4-d909-4147-8b7c-65324b741d22 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:55.697994 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289030c4-d909-4147-8b7c-65324b741d22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:55.698276 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289030c4-d909-4147-8b7c-65324b741d22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:55.811343 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eecba8e-4a26-4ed9-8a0f-934ceb59c710 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:55.815800 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eecba8e-4a26-4ed9-8a0f-934ceb59c710 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:55.847164 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 850/1695] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:34:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:34:55.847164 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db402eb-e62a-4b08-bbc3-c95af4a110b2 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:55.847164 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db402eb-e62a-4b08-bbc3-c95af4a110b2 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:55.847164 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db402eb-e62a-4b08-bbc3-c95af4a110b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:55.922063 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289030c4-d909-4147-8b7c-65324b741d22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:55.923584 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-5db402eb-e62a-4b08-bbc3-c95af4a110b2 None None] MFA Rules not processed for user `4fbaa6b231994fb4bebc045b5f581b74`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:55.923786 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289030c4-d909-4147-8b7c-65324b741d22 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:55.925430 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-5db402eb-e62a-4b08-bbc3-c95af4a110b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:55.950635 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 846/1696] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:34:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 713 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:34:56.044076 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3fae9-a1ce-4bdd-a6c0-6a7cbc7e261c None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:56.046112 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3fae9-a1ce-4bdd-a6c0-6a7cbc7e261c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:56.046585 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3fae9-a1ce-4bdd-a6c0-6a7cbc7e261c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:56.083726 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 851/1697] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:34:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:56.088304 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db402eb-e62a-4b08-bbc3-c95af4a110b2 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:56.091964 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c3f3fae9-a1ce-4bdd-a6c0-6a7cbc7e261c None None] MFA Rules not processed for user `68033ffcafbc47bbadd008abd9e56c4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:56.093412 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c3f3fae9-a1ce-4bdd-a6c0-6a7cbc7e261c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:56.111599 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 847/1698] 10.222.0.73 () {58 vars in 1015 bytes} [Thu May 26 12:34:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:34:56.120892 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db402eb-e62a-4b08-bbc3-c95af4a110b2 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:56.138942 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8248e360-8092-48e8-bd05-187a45cf57f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:56.140221 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248e360-8092-48e8-bd05-187a45cf57f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:56.140518 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248e360-8092-48e8-bd05-187a45cf57f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:56.140786 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248e360-8092-48e8-bd05-187a45cf57f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:56.141918 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8248e360-8092-48e8-bd05-187a45cf57f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:56.144565 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8248e360-8092-48e8-bd05-187a45cf57f0 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:56.180752 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:56.213332 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 852/1699] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:34:56 2022] POST /identity/v3/projects => generated 371 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:34:56.215545 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f3fae9-a1ce-4bdd-a6c0-6a7cbc7e261c None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:56.229558 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f3fae9-a1ce-4bdd-a6c0-6a7cbc7e261c None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:56.303672 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8248e360-8092-48e8-bd05-187a45cf57f0 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:56.343299 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369cddce-8266-421c-8909-3f12268bce6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:56.344394 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369cddce-8266-421c-8909-3f12268bce6d admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:56.344701 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369cddce-8266-421c-8909-3f12268bce6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:56.344974 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369cddce-8266-421c-8909-3f12268bce6d admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:56.345677 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369cddce-8266-421c-8909-3f12268bce6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:56.347665 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369cddce-8266-421c-8909-3f12268bce6d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:56.414003 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 848/1700] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:34:56 2022] POST /identity/v3/users => generated 292 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:34:56.415858 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369cddce-8266-421c-8909-3f12268bce6d admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:56.444563 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369cddce-8266-421c-8909-3f12268bce6d admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:56.458586 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4922a21-471c-4708-942e-3aa903af145b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:56.459346 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4922a21-471c-4708-942e-3aa903af145b admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:56.459983 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4922a21-471c-4708-942e-3aa903af145b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:56.459983 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4922a21-471c-4708-942e-3aa903af145b admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:56.461317 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8248e360-8092-48e8-bd05-187a45cf57f0 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:56.462520 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4922a21-471c-4708-942e-3aa903af145b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:56.466434 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4922a21-471c-4708-942e-3aa903af145b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:56.470741 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f48ea-d19a-42ae-a0d1-5b303a691f28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:56.472222 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f48ea-d19a-42ae-a0d1-5b303a691f28 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:56.472587 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f48ea-d19a-42ae-a0d1-5b303a691f28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:56.473659 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f48ea-d19a-42ae-a0d1-5b303a691f28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:56.496026 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345f48ea-d19a-42ae-a0d1-5b303a691f28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:56.503002 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345f48ea-d19a-42ae-a0d1-5b303a691f28 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:56.503374 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 849/1701] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:34:56 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:34:56.505034 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4922a21-471c-4708-942e-3aa903af145b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:56.530895 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 853/1702] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:34:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:34:56.533464 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4922a21-471c-4708-942e-3aa903af145b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:56.539749 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515a21c-c3dc-4b88-90a4-10caa030ecc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:56.541107 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515a21c-c3dc-4b88-90a4-10caa030ecc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:56.541403 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515a21c-c3dc-4b88-90a4-10caa030ecc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:56.541684 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515a21c-c3dc-4b88-90a4-10caa030ecc2 admin admin] PATH_INFO: `/v3/projects/54f8304f58924590a5dca48d2579a752/users/4940c990045f4adab9a17db94864d429/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:56.555474 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f48ea-d19a-42ae-a0d1-5b303a691f28 service neutron] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:56.558430 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-345f48ea-d19a-42ae-a0d1-5b303a691f28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:56.602596 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f48ea-d19a-42ae-a0d1-5b303a691f28 service neutron] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:56.606693 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a515a21c-c3dc-4b88-90a4-10caa030ecc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54f8304f58924590a5dca48d2579a752, user_id=4940c990045f4adab9a17db94864d429, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:56.610446 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a515a21c-c3dc-4b88-90a4-10caa030ecc2 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:56.612530 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1daa1c-a3a9-4e89-8f94-4d5745a022b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:56.613803 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1daa1c-a3a9-4e89-8f94-4d5745a022b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:56.614335 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1daa1c-a3a9-4e89-8f94-4d5745a022b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:56.614837 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1daa1c-a3a9-4e89-8f94-4d5745a022b1 admin admin] PATH_INFO: `/v3/projects/cf79d37c22144908b61ac9e66b442108` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:56.616796 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1daa1c-a3a9-4e89-8f94-4d5745a022b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf79d37c22144908b61ac9e66b442108)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:56.624797 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1daa1c-a3a9-4e89-8f94-4d5745a022b1 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:56.648942 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 850/1703] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:34:56 2022] PUT /identity/v3/projects/54f8304f58924590a5dca48d2579a752/users/4940c990045f4adab9a17db94864d429/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:56.653117 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515a21c-c3dc-4b88-90a4-10caa030ecc2 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:56.779085 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:56.792742 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-ee1daa1c-a3a9-4e89-8f94-4d5745a022b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf79d37c22144908b61ac9e66b442108', 'request_id': 'req-ee1daa1c-a3a9-4e89-8f94-4d5745a022b1'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:56.817002 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-ee1daa1c-a3a9-4e89-8f94-4d5745a022b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf79d37c22144908b61ac9e66b442108', 'request_id': 'req-ee1daa1c-a3a9-4e89-8f94-4d5745a022b1'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:56.827019 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-ee1daa1c-a3a9-4e89-8f94-4d5745a022b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf79d37c22144908b61ac9e66b442108', 'request_id': 'req-ee1daa1c-a3a9-4e89-8f94-4d5745a022b1'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:56.863524 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515a21c-c3dc-4b88-90a4-10caa030ecc2 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:56.871002 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-ee1daa1c-a3a9-4e89-8f94-4d5745a022b1 admin admin] The token cache is being invalidate because project cf79d37c22144908b61ac9e66b442108 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:34:56.873679 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-ee1daa1c-a3a9-4e89-8f94-4d5745a022b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:56.880201 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-ee1daa1c-a3a9-4e89-8f94-4d5745a022b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:56.882479 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 854/1704] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:34:56 2022] DELETE /identity/v3/projects/cf79d37c22144908b61ac9e66b442108 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:34:56.887533 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51cf31b-12d4-42d9-830a-e97077df5311 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:56.887924 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51cf31b-12d4-42d9-830a-e97077df5311 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:56.888307 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51cf31b-12d4-42d9-830a-e97077df5311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:56.932209 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-e51cf31b-12d4-42d9-830a-e97077df5311 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:56.935285 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-e51cf31b-12d4-42d9-830a-e97077df5311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:57.074306 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4103df2-cf45-473b-a72a-351b5ccc9518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:57.077273 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4103df2-cf45-473b-a72a-351b5ccc9518 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:57.077445 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4103df2-cf45-473b-a72a-351b5ccc9518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:57.077732 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4103df2-cf45-473b-a72a-351b5ccc9518 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:57.080775 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4103df2-cf45-473b-a72a-351b5ccc9518 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:57.102574 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4103df2-cf45-473b-a72a-351b5ccc9518 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:57.125489 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 855/1705] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:34:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:34:57.127851 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71440a04-1826-49e3-b502-76dc1eeadca9 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:57.128256 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71440a04-1826-49e3-b502-76dc1eeadca9 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:57.128672 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71440a04-1826-49e3-b502-76dc1eeadca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:57.142136 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 851/1706] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:34:56 2022] GET /identity/v3/roles => generated 1420 bytes in 489 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:34:57.143850 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4103df2-cf45-473b-a72a-351b5ccc9518 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:57.151877 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f4103df2-cf45-473b-a72a-351b5ccc9518 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:57.160589 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-71440a04-1826-49e3-b502-76dc1eeadca9 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:57.165008 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-71440a04-1826-49e3-b502-76dc1eeadca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:57.189638 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 856/1707] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:34:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:34:57.191051 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71440a04-1826-49e3-b502-76dc1eeadca9 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:57.191180 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4103df2-cf45-473b-a72a-351b5ccc9518 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:57.206830 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2d0932-605c-4e88-96e5-a4e972f45d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:57.208077 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d0932-605c-4e88-96e5-a4e972f45d1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:57.208366 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d0932-605c-4e88-96e5-a4e972f45d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:57.209284 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d0932-605c-4e88-96e5-a4e972f45d1a admin admin] PATH_INFO: `/v3/projects/54f8304f58924590a5dca48d2579a752/users/4940c990045f4adab9a17db94864d429/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:57.211544 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71440a04-1826-49e3-b502-76dc1eeadca9 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:57.217598 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2d0932-605c-4e88-96e5-a4e972f45d1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=54f8304f58924590a5dca48d2579a752, user_id=4940c990045f4adab9a17db94864d429, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:57.226801 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f37636d-bbb9-44ef-b1ef-aae11d8b06dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:57.229526 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2d0932-605c-4e88-96e5-a4e972f45d1a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:57.230415 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37636d-bbb9-44ef-b1ef-aae11d8b06dd admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:57.231263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37636d-bbb9-44ef-b1ef-aae11d8b06dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:57.231760 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37636d-bbb9-44ef-b1ef-aae11d8b06dd admin admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:57.236868 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f37636d-bbb9-44ef-b1ef-aae11d8b06dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:34:57.237579 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f37636d-bbb9-44ef-b1ef-aae11d8b06dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:57.239823 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f37636d-bbb9-44ef-b1ef-aae11d8b06dd admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:57.282884 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 857/1708] 10.222.0.16 () {58 vars in 1152 bytes} [Thu May 26 12:34:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:34:57.288155 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f37636d-bbb9-44ef-b1ef-aae11d8b06dd admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:57.297475 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:57.320596 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 852/1709] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:34:57 2022] PUT /identity/v3/projects/54f8304f58924590a5dca48d2579a752/users/4940c990045f4adab9a17db94864d429/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:57.334816 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f1f68f-1741-4b4c-97b0-25a8250ba73f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:57.335137 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f1f68f-1741-4b4c-97b0-25a8250ba73f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:57.335372 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f1f68f-1741-4b4c-97b0-25a8250ba73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:57.337468 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f37636d-bbb9-44ef-b1ef-aae11d8b06dd admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:57.475583 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-f5f1f68f-1741-4b4c-97b0-25a8250ba73f None None] MFA Rules not processed for user `4940c990045f4adab9a17db94864d429`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:57.476906 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f5f1f68f-1741-4b4c-97b0-25a8250ba73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:57.523204 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7fbd1d-6059-4bfb-8db3-46bff5df7b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:57.524052 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7fbd1d-6059-4bfb-8db3-46bff5df7b6d admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:57.524497 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7fbd1d-6059-4bfb-8db3-46bff5df7b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:57.525194 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7fbd1d-6059-4bfb-8db3-46bff5df7b6d admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:57.526898 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7fbd1d-6059-4bfb-8db3-46bff5df7b6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:57.542086 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7fbd1d-6059-4bfb-8db3-46bff5df7b6d admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:57.637754 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 858/1710] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:34:57 2022] POST /identity/v3/projects => generated 409 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:34:57.641425 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7fbd1d-6059-4bfb-8db3-46bff5df7b6d admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:57.796877 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7fbd1d-6059-4bfb-8db3-46bff5df7b6d admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:57.814183 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af2627-2a33-4e7f-960c-aa4887d9d671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:57.815142 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af2627-2a33-4e7f-960c-aa4887d9d671 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:57.815535 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af2627-2a33-4e7f-960c-aa4887d9d671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:57.815913 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af2627-2a33-4e7f-960c-aa4887d9d671 admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:57.816739 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8af2627-2a33-4e7f-960c-aa4887d9d671 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:57.819537 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8af2627-2a33-4e7f-960c-aa4887d9d671 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:57.821732 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 853/1711] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:34:57 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 488 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:34:57.843646 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f1f68f-1741-4b4c-97b0-25a8250ba73f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:57.850003 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f5f1f68f-1741-4b4c-97b0-25a8250ba73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:57.904248 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 859/1712] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:34:57 2022] POST /identity/v3/users => generated 305 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:34:57.908093 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af2627-2a33-4e7f-960c-aa4887d9d671 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:57.929775 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af2627-2a33-4e7f-960c-aa4887d9d671 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:57.944284 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8faa0c7-afde-4ec3-8a68-b4a09de7b3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:57.945016 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8faa0c7-afde-4ec3-8a68-b4a09de7b3fb admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:57.945293 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8faa0c7-afde-4ec3-8a68-b4a09de7b3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:57.945569 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8faa0c7-afde-4ec3-8a68-b4a09de7b3fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:57.946326 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8faa0c7-afde-4ec3-8a68-b4a09de7b3fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:57.948033 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8faa0c7-afde-4ec3-8a68-b4a09de7b3fb admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:57.975598 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 860/1713] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:34:57 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:34:57.976615 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8faa0c7-afde-4ec3-8a68-b4a09de7b3fb admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:58.008584 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8faa0c7-afde-4ec3-8a68-b4a09de7b3fb admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:58.028097 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc7736e-53f5-4b45-9141-197068b16ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:58.030220 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7736e-53f5-4b45-9141-197068b16ba5 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:58.030522 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7736e-53f5-4b45-9141-197068b16ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:58.030803 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7736e-53f5-4b45-9141-197068b16ba5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:58.031555 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc7736e-53f5-4b45-9141-197068b16ba5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:58.033232 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc7736e-53f5-4b45-9141-197068b16ba5 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:58.079660 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 861/1714] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:34:57 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:34:58.080585 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc7736e-53f5-4b45-9141-197068b16ba5 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:58.095727 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f1f68f-1741-4b4c-97b0-25a8250ba73f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:58.112539 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:58.119190 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc7736e-53f5-4b45-9141-197068b16ba5 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:58.134854 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e3b23-c66f-413c-aaaa-c9cd5674086b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:58.135808 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e3b23-c66f-413c-aaaa-c9cd5674086b admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:58.136103 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e3b23-c66f-413c-aaaa-c9cd5674086b admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:58.136377 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e3b23-c66f-413c-aaaa-c9cd5674086b admin admin] PATH_INFO: `/v3/projects/30e104d95f584145bcb3e26301ead424/users/4eecaff9a4a74e4dace7bf7de584b190/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:58.178533 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9e3b23-c66f-413c-aaaa-c9cd5674086b admin admin] RBAC: Authorizing `identity:create_grant(project_id=30e104d95f584145bcb3e26301ead424, user_id=4eecaff9a4a74e4dace7bf7de584b190, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:58.185728 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9e3b23-c66f-413c-aaaa-c9cd5674086b admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:58.232725 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 862/1715] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:34:58 2022] PUT /identity/v3/projects/30e104d95f584145bcb3e26301ead424/users/4eecaff9a4a74e4dace7bf7de584b190/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:58.243320 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066096a-7453-4ff3-8389-e33f5d42891c None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:58.243817 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066096a-7453-4ff3-8389-e33f5d42891c None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:58.244106 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066096a-7453-4ff3-8389-e33f5d42891c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:58.269380 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532cc8ad-fd56-4bd5-aad8-53ca12af8f20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:58.271035 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532cc8ad-fd56-4bd5-aad8-53ca12af8f20 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:58.271767 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532cc8ad-fd56-4bd5-aad8-53ca12af8f20 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:58.271767 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532cc8ad-fd56-4bd5-aad8-53ca12af8f20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:58.334867 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-b066096a-7453-4ff3-8389-e33f5d42891c None None] MFA Rules not processed for user `4eecaff9a4a74e4dace7bf7de584b190`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:58.337823 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-b066096a-7453-4ff3-8389-e33f5d42891c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:58.385158 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:58.496002 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532cc8ad-fd56-4bd5-aad8-53ca12af8f20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:58.499584 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532cc8ad-fd56-4bd5-aad8-53ca12af8f20 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:58.504991 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 863/1716] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:34:58 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:58.509397 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066096a-7453-4ff3-8389-e33f5d42891c None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:58.531806 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 854/1717] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:34:57 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 688 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:34:58.597755 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532cc8ad-fd56-4bd5-aad8-53ca12af8f20 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:58.599301 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-532cc8ad-fd56-4bd5-aad8-53ca12af8f20 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:58.636478 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532cc8ad-fd56-4bd5-aad8-53ca12af8f20 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:58.695922 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066096a-7453-4ff3-8389-e33f5d42891c None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:58.711547 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d97a7d-72de-4b99-8014-0e2678a2c9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:58.712685 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d97a7d-72de-4b99-8014-0e2678a2c9e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:58.713074 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d97a7d-72de-4b99-8014-0e2678a2c9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:58.714615 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d97a7d-72de-4b99-8014-0e2678a2c9e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:58.717317 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d97a7d-72de-4b99-8014-0e2678a2c9e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:58.724893 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d97a7d-72de-4b99-8014-0e2678a2c9e9 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:58.798717 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 864/1718] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:34:58 2022] POST /identity/v3/projects => generated 409 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:34:58.798717 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d97a7d-72de-4b99-8014-0e2678a2c9e9 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:58.830020 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc2926a-494f-4b70-a6d7-1aee073b2117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:58.830923 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2926a-494f-4b70-a6d7-1aee073b2117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:58.831219 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2926a-494f-4b70-a6d7-1aee073b2117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:58.834359 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2926a-494f-4b70-a6d7-1aee073b2117 admin admin] PATH_INFO: `/v3/projects/1157a970544e4c5099c98009bdcdfc6e` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:58.837637 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc2926a-494f-4b70-a6d7-1aee073b2117 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1157a970544e4c5099c98009bdcdfc6e)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:58.839615 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc2926a-494f-4b70-a6d7-1aee073b2117 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:58.962116 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d97a7d-72de-4b99-8014-0e2678a2c9e9 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:58.977427 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e4f78-ebf9-41f8-88aa-6c026038b04a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:58.978094 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e4f78-ebf9-41f8-88aa-6c026038b04a service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:58.978373 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e4f78-ebf9-41f8-88aa-6c026038b04a service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:58.978650 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e4f78-ebf9-41f8-88aa-6c026038b04a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:58.988135 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-b27e4f78-ebf9-41f8-88aa-6c026038b04a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:59.058452 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-cbc2926a-494f-4b70-a6d7-1aee073b2117 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1157a970544e4c5099c98009bdcdfc6e', 'request_id': 'req-cbc2926a-494f-4b70-a6d7-1aee073b2117'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:59.068295 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-cbc2926a-494f-4b70-a6d7-1aee073b2117 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1157a970544e4c5099c98009bdcdfc6e', 'request_id': 'req-cbc2926a-494f-4b70-a6d7-1aee073b2117'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:59.070394 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:59.089571 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-cbc2926a-494f-4b70-a6d7-1aee073b2117 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1157a970544e4c5099c98009bdcdfc6e', 'request_id': 'req-cbc2926a-494f-4b70-a6d7-1aee073b2117'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:59.113871 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-cbc2926a-494f-4b70-a6d7-1aee073b2117 admin admin] The token cache is being invalidate because project 1157a970544e4c5099c98009bdcdfc6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:34:59.114168 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-cbc2926a-494f-4b70-a6d7-1aee073b2117 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:59.115793 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-cbc2926a-494f-4b70-a6d7-1aee073b2117 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:59.120898 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 855/1719] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:34:58 2022] DELETE /identity/v3/projects/1157a970544e4c5099c98009bdcdfc6e => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:59.121741 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc2926a-494f-4b70-a6d7-1aee073b2117 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:59.126015 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-cbc2926a-494f-4b70-a6d7-1aee073b2117 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:59.182934 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27e4f78-ebf9-41f8-88aa-6c026038b04a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:59.184426 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27e4f78-ebf9-41f8-88aa-6c026038b04a service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:59.202911 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:59.217752 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 865/1720] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:34:58 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:34:59.218703 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e4f78-ebf9-41f8-88aa-6c026038b04a service cinder] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:59.222639 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-b27e4f78-ebf9-41f8-88aa-6c026038b04a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:59.313789 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc2926a-494f-4b70-a6d7-1aee073b2117 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:59.328129 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed63b048-2ac1-435a-8346-9f6d844b1f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:59.328939 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63b048-2ac1-435a-8346-9f6d844b1f6e admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:59.329409 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63b048-2ac1-435a-8346-9f6d844b1f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:59.329704 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63b048-2ac1-435a-8346-9f6d844b1f6e admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:59.330664 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed63b048-2ac1-435a-8346-9f6d844b1f6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:59.332680 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed63b048-2ac1-435a-8346-9f6d844b1f6e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:59.415722 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 856/1721] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:34:59 2022] POST /identity/v3/users => generated 311 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:34:59.430797 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b055b-295a-452f-bf68-bac1f4ab7862 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:59.431098 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b055b-295a-452f-bf68-bac1f4ab7862 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:59.435153 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b055b-295a-452f-bf68-bac1f4ab7862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:59.482963 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e4f78-ebf9-41f8-88aa-6c026038b04a service cinder] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:59.503319 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abebfe8-d4bd-4581-b8d1-2cc9f3b1f2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:59.504209 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abebfe8-d4bd-4581-b8d1-2cc9f3b1f2ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:59.504486 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abebfe8-d4bd-4581-b8d1-2cc9f3b1f2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:59.504756 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abebfe8-d4bd-4581-b8d1-2cc9f3b1f2ab admin admin] PATH_INFO: `/v3/projects/224b1677b39f4df49242495646d0d493` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:59.507170 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-943b055b-295a-452f-bf68-bac1f4ab7862 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:59.510404 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-943b055b-295a-452f-bf68-bac1f4ab7862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:59.513781 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abebfe8-d4bd-4581-b8d1-2cc9f3b1f2ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=224b1677b39f4df49242495646d0d493)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:59.515757 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abebfe8-d4bd-4581-b8d1-2cc9f3b1f2ab admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:59.532533 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 857/1722] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:34:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:59.533648 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b055b-295a-452f-bf68-bac1f4ab7862 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:59.557816 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b055b-295a-452f-bf68-bac1f4ab7862 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:59.577121 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7957faf-6503-4a8d-9ae2-46bcc7a19b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:59.580135 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7957faf-6503-4a8d-9ae2-46bcc7a19b94 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:59.581018 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7957faf-6503-4a8d-9ae2-46bcc7a19b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:59.581892 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7957faf-6503-4a8d-9ae2-46bcc7a19b94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:59.585293 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7957faf-6503-4a8d-9ae2-46bcc7a19b94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:59.589879 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7957faf-6503-4a8d-9ae2-46bcc7a19b94 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:59.643633 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 858/1723] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:34:59 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:34:59.646208 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d370870-3fc7-4c4d-974c-ba6c81cb78d9 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:59.648289 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d370870-3fc7-4c4d-974c-ba6c81cb78d9 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:59.648591 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d370870-3fc7-4c4d-974c-ba6c81cb78d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:59.706496 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-0abebfe8-d4bd-4581-b8d1-2cc9f3b1f2ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '224b1677b39f4df49242495646d0d493', 'request_id': 'req-0abebfe8-d4bd-4581-b8d1-2cc9f3b1f2ab'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:59.733330 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-9d370870-3fc7-4c4d-974c-ba6c81cb78d9 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:59.737355 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9d370870-3fc7-4c4d-974c-ba6c81cb78d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:59.741297 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-0abebfe8-d4bd-4581-b8d1-2cc9f3b1f2ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '224b1677b39f4df49242495646d0d493', 'request_id': 'req-0abebfe8-d4bd-4581-b8d1-2cc9f3b1f2ab'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:59.769188 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-0abebfe8-d4bd-4581-b8d1-2cc9f3b1f2ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '224b1677b39f4df49242495646d0d493', 'request_id': 'req-0abebfe8-d4bd-4581-b8d1-2cc9f3b1f2ab'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:59.842413 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-0abebfe8-d4bd-4581-b8d1-2cc9f3b1f2ab admin admin] The token cache is being invalidate because project 224b1677b39f4df49242495646d0d493 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:34:59.842710 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-0abebfe8-d4bd-4581-b8d1-2cc9f3b1f2ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:59.846751 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-0abebfe8-d4bd-4581-b8d1-2cc9f3b1f2ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:59.850771 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 866/1724] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:34:59 2022] DELETE /identity/v3/projects/224b1677b39f4df49242495646d0d493 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:59.858467 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abebfe8-d4bd-4581-b8d1-2cc9f3b1f2ab admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:59.862788 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-0abebfe8-d4bd-4581-b8d1-2cc9f3b1f2ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:59.953715 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 859/1725] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:34:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:59.959983 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10386eda-4636-4179-ac69-a00ce1f499d7 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:59.963588 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10386eda-4636-4179-ac69-a00ce1f499d7 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:59.964125 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10386eda-4636-4179-ac69-a00ce1f499d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:00.017959 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-10386eda-4636-4179-ac69-a00ce1f499d7 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:00.019824 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-10386eda-4636-4179-ac69-a00ce1f499d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:00.046467 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 860/1726] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:34:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:00.047803 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10386eda-4636-4179-ac69-a00ce1f499d7 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:00.069950 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10386eda-4636-4179-ac69-a00ce1f499d7 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:00.090580 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b107e-73f8-4364-98d0-b877612af27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:00.091533 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b107e-73f8-4364-98d0-b877612af27d admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:00.091992 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b107e-73f8-4364-98d0-b877612af27d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:00.092458 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b107e-73f8-4364-98d0-b877612af27d admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:00.093219 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32b107e-73f8-4364-98d0-b877612af27d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:35:00.094222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32b107e-73f8-4364-98d0-b877612af27d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:00.106307 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abebfe8-d4bd-4581-b8d1-2cc9f3b1f2ab admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:00.114035 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32b107e-73f8-4364-98d0-b877612af27d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:00.129992 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d57d65-2201-4b66-b155-07785889353e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:00.130909 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d57d65-2201-4b66-b155-07785889353e admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:00.131189 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d57d65-2201-4b66-b155-07785889353e admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:00.131567 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d57d65-2201-4b66-b155-07785889353e admin admin] PATH_INFO: `/v3/projects/32b9b3438e684284aa175e2c0e221157/users/cb03117e7bde42b7a297161ff8f1d532/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:00.137085 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 861/1727] 10.222.0.16 () {58 vars in 1152 bytes} [Thu May 26 12:35:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:35:00.138786 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf59d7b-804b-4923-af85-3714a1919041 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:00.139178 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf59d7b-804b-4923-af85-3714a1919041 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:00.139627 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf59d7b-804b-4923-af85-3714a1919041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:00.171492 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-5bf59d7b-804b-4923-af85-3714a1919041 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:00.183501 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d57d65-2201-4b66-b155-07785889353e admin admin] RBAC: Authorizing `identity:create_grant(project_id=32b9b3438e684284aa175e2c0e221157, user_id=cb03117e7bde42b7a297161ff8f1d532, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:00.186708 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d57d65-2201-4b66-b155-07785889353e admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:00.190711 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5bf59d7b-804b-4923-af85-3714a1919041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:00.205780 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 862/1728] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:00.206656 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf59d7b-804b-4923-af85-3714a1919041 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:00.225260 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 867/1729] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:34:59 2022] PUT /identity/v3/projects/32b9b3438e684284aa175e2c0e221157/users/cb03117e7bde42b7a297161ff8f1d532/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:00.225748 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf59d7b-804b-4923-af85-3714a1919041 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:00.228716 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d57d65-2201-4b66-b155-07785889353e admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:00.275933 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:00.311070 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:00.379230 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d7d2d3-5238-4d38-9063-e3b12d3c3c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:00.396511 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7d2d3-5238-4d38-9063-e3b12d3c3c38 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:00.396986 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7d2d3-5238-4d38-9063-e3b12d3c3c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:00.397377 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7d2d3-5238-4d38-9063-e3b12d3c3c38 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:00.399355 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d57d65-2201-4b66-b155-07785889353e admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:00.400575 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d7d2d3-5238-4d38-9063-e3b12d3c3c38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:00.408376 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d7d2d3-5238-4d38-9063-e3b12d3c3c38 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:00.410070 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13c9f7-7e41-4117-aa9f-151e7d052fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:00.411027 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13c9f7-7e41-4117-aa9f-151e7d052fbb admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:00.411383 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13c9f7-7e41-4117-aa9f-151e7d052fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:00.411606 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13c9f7-7e41-4117-aa9f-151e7d052fbb admin admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:00.412355 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f13c9f7-7e41-4117-aa9f-151e7d052fbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:35:00.412665 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f13c9f7-7e41-4117-aa9f-151e7d052fbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:00.419177 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f13c9f7-7e41-4117-aa9f-151e7d052fbb admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:00.463368 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 868/1730] 10.222.0.16 () {58 vars in 1152 bytes} [Thu May 26 12:35:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:35:00.466462 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13c9f7-7e41-4117-aa9f-151e7d052fbb admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:00.493992 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13c9f7-7e41-4117-aa9f-151e7d052fbb admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:00.509565 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 863/1731] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:35:00 2022] POST /identity/v3/projects => generated 405 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:35:00.509565 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d7d2d3-5238-4d38-9063-e3b12d3c3c38 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:00.510847 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1118f867-6116-4f7d-b493-5843c12ae8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:00.514619 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118f867-6116-4f7d-b493-5843c12ae8a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:00.515156 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118f867-6116-4f7d-b493-5843c12ae8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:00.518310 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118f867-6116-4f7d-b493-5843c12ae8a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:00.519216 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1118f867-6116-4f7d-b493-5843c12ae8a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:00.521568 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1118f867-6116-4f7d-b493-5843c12ae8a5 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:00.564222 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 869/1732] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:35:00.566363 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1118f867-6116-4f7d-b493-5843c12ae8a5 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:00.591307 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1118f867-6116-4f7d-b493-5843c12ae8a5 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:00.696573 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d7d2d3-5238-4d38-9063-e3b12d3c3c38 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:00.719951 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca41dae-5709-4f62-bec8-1f7eaaf46c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:00.722115 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca41dae-5709-4f62-bec8-1f7eaaf46c03 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:00.722559 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca41dae-5709-4f62-bec8-1f7eaaf46c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:00.724966 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca41dae-5709-4f62-bec8-1f7eaaf46c03 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:00.725681 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca41dae-5709-4f62-bec8-1f7eaaf46c03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:00.727751 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca41dae-5709-4f62-bec8-1f7eaaf46c03 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:00.799625 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db1a8e-cf07-4727-ba9c-7d19bd999d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:00.806948 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db1a8e-cf07-4727-ba9c-7d19bd999d59 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:00.808821 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db1a8e-cf07-4727-ba9c-7d19bd999d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:00.812018 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db1a8e-cf07-4727-ba9c-7d19bd999d59 admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:00.813729 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7db1a8e-cf07-4727-ba9c-7d19bd999d59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:00.833647 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7db1a8e-cf07-4727-ba9c-7d19bd999d59 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:00.837519 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 864/1733] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:35:00 2022] POST /identity/v3/projects => generated 385 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:35:00.838757 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca41dae-5709-4f62-bec8-1f7eaaf46c03 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:00.928194 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 870/1734] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:35:00 2022] POST /identity/v3/users => generated 303 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:35:00.929444 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db1a8e-cf07-4727-ba9c-7d19bd999d59 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:00.954790 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db1a8e-cf07-4727-ba9c-7d19bd999d59 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:01.108373 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca41dae-5709-4f62-bec8-1f7eaaf46c03 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:01.121769 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d9afb-3ccb-4e2c-b3ec-949c3394c49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:01.123572 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d9afb-3ccb-4e2c-b3ec-949c3394c49c admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:01.126422 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d9afb-3ccb-4e2c-b3ec-949c3394c49c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:01.128314 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d9afb-3ccb-4e2c-b3ec-949c3394c49c admin admin] PATH_INFO: `/v3/projects/32b9b3438e684284aa175e2c0e221157/users/cb03117e7bde42b7a297161ff8f1d532/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:01.134537 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d9afb-3ccb-4e2c-b3ec-949c3394c49c admin admin] RBAC: Authorizing `identity:create_grant(project_id=32b9b3438e684284aa175e2c0e221157, user_id=cb03117e7bde42b7a297161ff8f1d532, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:01.143443 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d9afb-3ccb-4e2c-b3ec-949c3394c49c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:01.171371 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9760fa58-8531-4025-ab70-3c960a3d02d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:01.172092 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760fa58-8531-4025-ab70-3c960a3d02d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:01.172385 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760fa58-8531-4025-ab70-3c960a3d02d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:01.176293 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760fa58-8531-4025-ab70-3c960a3d02d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:01.178162 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9760fa58-8531-4025-ab70-3c960a3d02d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:01.180143 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 865/1735] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:35:00 2022] PUT /identity/v3/projects/32b9b3438e684284aa175e2c0e221157/users/cb03117e7bde42b7a297161ff8f1d532/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:01.181310 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d9afb-3ccb-4e2c-b3ec-949c3394c49c admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:01.182491 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9760fa58-8531-4025-ab70-3c960a3d02d9 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:01.238210 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 871/1736] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:35:00 2022] POST /identity/v3/users => generated 293 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:35:01.239015 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744522c-3e5c-4d87-b53a-0266ee0ea96d None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:01.239015 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744522c-3e5c-4d87-b53a-0266ee0ea96d None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:01.239169 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744522c-3e5c-4d87-b53a-0266ee0ea96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:01.318684 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-8744522c-3e5c-4d87-b53a-0266ee0ea96d None None] MFA Rules not processed for user `cb03117e7bde42b7a297161ff8f1d532`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:01.319991 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-8744522c-3e5c-4d87-b53a-0266ee0ea96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:01.334673 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:01.365453 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:01.455997 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d9afb-3ccb-4e2c-b3ec-949c3394c49c admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:01.475633 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a0b50-02af-41ed-8672-8788bd34d20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:01.476523 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a0b50-02af-41ed-8672-8788bd34d20b admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:01.476978 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a0b50-02af-41ed-8672-8788bd34d20b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:01.477365 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a0b50-02af-41ed-8672-8788bd34d20b admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:01.479621 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5a0b50-02af-41ed-8672-8788bd34d20b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:01.484281 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5a0b50-02af-41ed-8672-8788bd34d20b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:01.529151 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 866/1737] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:35:01 2022] GET /identity/v3/roles => generated 1420 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:35:01.531375 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a0b50-02af-41ed-8672-8788bd34d20b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:01.555845 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 872/1738] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:01 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:01.556137 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a0b50-02af-41ed-8672-8788bd34d20b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:01.556225 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a05b0-ba2c-4422-bd79-72573a6e76dc None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:01.556225 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a05b0-ba2c-4422-bd79-72573a6e76dc None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:01.556693 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a05b0-ba2c-4422-bd79-72573a6e76dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:01.583392 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e980dee-5c7e-4253-b055-6b72aa08e2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:01.585849 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e980dee-5c7e-4253-b055-6b72aa08e2b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:01.589206 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e980dee-5c7e-4253-b055-6b72aa08e2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:01.589206 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e980dee-5c7e-4253-b055-6b72aa08e2b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:01.589206 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e980dee-5c7e-4253-b055-6b72aa08e2b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:01.599680 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e980dee-5c7e-4253-b055-6b72aa08e2b4 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:01.643955 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-054a05b0-ba2c-4422-bd79-72573a6e76dc None None] MFA Rules not processed for user `62ff83542a7c4c7982affdc3b882cdd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:01.645906 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-054a05b0-ba2c-4422-bd79-72573a6e76dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:01.646324 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 867/1739] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:35:01 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:35:01.648881 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e980dee-5c7e-4253-b055-6b72aa08e2b4 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:01.673714 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e980dee-5c7e-4253-b055-6b72aa08e2b4 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:01.702701 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb9d31-d2f0-4015-8cef-93cfc5eb0f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:01.704115 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb9d31-d2f0-4015-8cef-93cfc5eb0f17 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:01.704563 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb9d31-d2f0-4015-8cef-93cfc5eb0f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:01.704982 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb9d31-d2f0-4015-8cef-93cfc5eb0f17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:01.705963 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb9d31-d2f0-4015-8cef-93cfc5eb0f17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:01.711492 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb9d31-d2f0-4015-8cef-93cfc5eb0f17 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:01.757490 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 868/1740] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:35:01 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:35:01.758868 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb9d31-d2f0-4015-8cef-93cfc5eb0f17 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:01.762031 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-74bb9d31-d2f0-4015-8cef-93cfc5eb0f17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:01.881147 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 873/1741] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:01.882208 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a05b0-ba2c-4422-bd79-72573a6e76dc None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:01.895642 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a05b0-ba2c-4422-bd79-72573a6e76dc None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:01.917202 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c01430-4d70-4f7e-82f8-904e9c002704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:01.917917 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c01430-4d70-4f7e-82f8-904e9c002704 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:01.940800 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c01430-4d70-4f7e-82f8-904e9c002704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:01.941186 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c01430-4d70-4f7e-82f8-904e9c002704 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:01.942091 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c01430-4d70-4f7e-82f8-904e9c002704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:01.952915 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c01430-4d70-4f7e-82f8-904e9c002704 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:01.967597 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb9d31-d2f0-4015-8cef-93cfc5eb0f17 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:01.987410 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab568cd-e8f1-4f59-9412-f3f5b2b3b999 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:01.988256 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab568cd-e8f1-4f59-9412-f3f5b2b3b999 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:01.988653 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab568cd-e8f1-4f59-9412-f3f5b2b3b999 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:01.989092 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab568cd-e8f1-4f59-9412-f3f5b2b3b999 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:02.020148 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 874/1742] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:35:01 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:35:02.021110 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c01430-4d70-4f7e-82f8-904e9c002704 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:02.025774 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab568cd-e8f1-4f59-9412-f3f5b2b3b999 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:02.032342 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab568cd-e8f1-4f59-9412-f3f5b2b3b999 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:02.057416 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 869/1743] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:35:01 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:35:02.058952 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab568cd-e8f1-4f59-9412-f3f5b2b3b999 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:02.060623 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2ab568cd-e8f1-4f59-9412-f3f5b2b3b999 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:02.087609 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c01430-4d70-4f7e-82f8-904e9c002704 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:02.113912 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcc018c-b6cd-49cf-8b1c-ea31a965df79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:02.114882 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc018c-b6cd-49cf-8b1c-ea31a965df79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:02.115173 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc018c-b6cd-49cf-8b1c-ea31a965df79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:02.115513 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc018c-b6cd-49cf-8b1c-ea31a965df79 admin admin] PATH_INFO: `/v3/projects/9341f9bb360d443e83ca6f9ed05ab355/users/fff8671199f24cb2b2f8c2c5998056ae/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:02.152724 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcc018c-b6cd-49cf-8b1c-ea31a965df79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9341f9bb360d443e83ca6f9ed05ab355, user_id=fff8671199f24cb2b2f8c2c5998056ae, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:02.163875 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcc018c-b6cd-49cf-8b1c-ea31a965df79 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:02.207176 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 875/1744] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:35:02 2022] PUT /identity/v3/projects/9341f9bb360d443e83ca6f9ed05ab355/users/fff8671199f24cb2b2f8c2c5998056ae/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:02.209869 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcc018c-b6cd-49cf-8b1c-ea31a965df79 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:02.242050 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab568cd-e8f1-4f59-9412-f3f5b2b3b999 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:02.442311 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:02.446288 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:02.457733 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcc018c-b6cd-49cf-8b1c-ea31a965df79 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:02.489849 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414dae40-a245-499a-bd47-3cf5ec61dca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:02.495543 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414dae40-a245-499a-bd47-3cf5ec61dca1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:02.495909 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414dae40-a245-499a-bd47-3cf5ec61dca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:02.496111 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414dae40-a245-499a-bd47-3cf5ec61dca1 admin admin] PATH_INFO: `/v3/projects/7c021f5a675444baaf2b84ae84d5d646/users/b687a62f5bdd4bf48ab38d7906da4333/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:02.516562 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33df322-aa24-4b0c-940c-6ef702d1e7ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536f68ff77794352adf41aaacdc0645c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:02.521981 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33df322-aa24-4b0c-940c-6ef702d1e7ca service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:02.522272 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33df322-aa24-4b0c-940c-6ef702d1e7ca service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:02.522552 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33df322-aa24-4b0c-940c-6ef702d1e7ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:02.553432 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414dae40-a245-499a-bd47-3cf5ec61dca1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c021f5a675444baaf2b84ae84d5d646, user_id=b687a62f5bdd4bf48ab38d7906da4333, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:02.556062 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414dae40-a245-499a-bd47-3cf5ec61dca1 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:02.603202 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 876/1745] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:35:02 2022] PUT /identity/v3/projects/7c021f5a675444baaf2b84ae84d5d646/users/b687a62f5bdd4bf48ab38d7906da4333/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:02.610726 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d22536-c2e1-42d7-9246-9317b5378006 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:02.613234 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d22536-c2e1-42d7-9246-9317b5378006 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:02.613571 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d22536-c2e1-42d7-9246-9317b5378006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:02.723489 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-90d22536-c2e1-42d7-9246-9317b5378006 None None] MFA Rules not processed for user `fff8671199f24cb2b2f8c2c5998056ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:02.731178 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-90d22536-c2e1-42d7-9246-9317b5378006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:02.781615 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33df322-aa24-4b0c-940c-6ef702d1e7ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:02.795391 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33df322-aa24-4b0c-940c-6ef702d1e7ca service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:02.845319 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 870/1746] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:35:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 787 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:35:02.851463 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c7d59-f96a-4dfa-aa1d-ba3254402aee None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:02.853021 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c7d59-f96a-4dfa-aa1d-ba3254402aee None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:02.854667 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c7d59-f96a-4dfa-aa1d-ba3254402aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:02.993512 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c40c7d59-f96a-4dfa-aa1d-ba3254402aee None None] MFA Rules not processed for user `bd25ae73d8f943839c9682cc4503909d`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:02.998112 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c40c7d59-f96a-4dfa-aa1d-ba3254402aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:03.089228 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 877/1747] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:02 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 486 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:03.096722 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d22536-c2e1-42d7-9246-9317b5378006 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:03.316370 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d22536-c2e1-42d7-9246-9317b5378006 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:03.328540 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35af4263-37bb-4d16-8173-990ca10de0b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:03.337280 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af4263-37bb-4d16-8173-990ca10de0b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:03.337656 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af4263-37bb-4d16-8173-990ca10de0b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:03.338027 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af4263-37bb-4d16-8173-990ca10de0b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:03.348162 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-35af4263-37bb-4d16-8173-990ca10de0b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:03.373530 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 871/1748] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 515 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:03.373530 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39036967-b853-4fda-bf59-2a1b94906c31 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:03.373530 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39036967-b853-4fda-bf59-2a1b94906c31 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:03.373530 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39036967-b853-4fda-bf59-2a1b94906c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:03.429009 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-39036967-b853-4fda-bf59-2a1b94906c31 None None] MFA Rules not processed for user `b687a62f5bdd4bf48ab38d7906da4333`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:03.430248 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-39036967-b853-4fda-bf59-2a1b94906c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:03.632268 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 872/1749] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:03.633735 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac108f-894e-4216-a6c4-706aaaead766 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:03.634036 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac108f-894e-4216-a6c4-706aaaead766 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:03.634315 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac108f-894e-4216-a6c4-706aaaead766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:03.644193 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35af4263-37bb-4d16-8173-990ca10de0b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:03.646159 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35af4263-37bb-4d16-8173-990ca10de0b1 service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:03.667945 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 878/1750] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:35:03 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:35:03.670223 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65480596-b507-46fd-88c4-a190f23a2346 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:03.670575 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65480596-b507-46fd-88c4-a190f23a2346 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:03.670863 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65480596-b507-46fd-88c4-a190f23a2346 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:03.673051 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 879/1751] 10.222.0.16 () {54 vars in 921 bytes} [Thu May 26 12:35:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:35:03.674596 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65480596-b507-46fd-88c4-a190f23a2346 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:03.679142 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a0ac108f-894e-4216-a6c4-706aaaead766 None None] MFA Rules not processed for user `ae9585c4fe0c4d0eb1a820c9dc096a89`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:03.689239 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a0ac108f-894e-4216-a6c4-706aaaead766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:03.702280 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:03.736463 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:03.855039 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65480596-b507-46fd-88c4-a190f23a2346 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:03.866140 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c10783-c51f-4855-af96-c102a65b4484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:03.868531 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c10783-c51f-4855-af96-c102a65b4484 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:03.869905 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c10783-c51f-4855-af96-c102a65b4484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:03.870503 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c10783-c51f-4855-af96-c102a65b4484 admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:03.872584 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c10783-c51f-4855-af96-c102a65b4484 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:03.875458 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c10783-c51f-4855-af96-c102a65b4484 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:03.876595 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 873/1752] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:03.879224 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528b9c2-e08b-4cf1-9d9b-45d47794ea08 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:03.881021 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528b9c2-e08b-4cf1-9d9b-45d47794ea08 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:03.882541 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528b9c2-e08b-4cf1-9d9b-45d47794ea08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:03.975292 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c528b9c2-e08b-4cf1-9d9b-45d47794ea08 None None] MFA Rules not processed for user `bd25ae73d8f943839c9682cc4503909d`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:03.978421 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c528b9c2-e08b-4cf1-9d9b-45d47794ea08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:03.988852 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 880/1753] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:35:03 2022] POST /identity/v3/projects => generated 405 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:35:03.992986 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c196d-4097-460a-8028-4ecd5b20fa69 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:03.993453 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c196d-4097-460a-8028-4ecd5b20fa69 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:03.993858 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c196d-4097-460a-8028-4ecd5b20fa69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:04.086739 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-ce9c196d-4097-460a-8028-4ecd5b20fa69 None None] MFA Rules not processed for user `536f68ff77794352adf41aaacdc0645c`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:04.091519 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-ce9c196d-4097-460a-8028-4ecd5b20fa69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:04.265615 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 874/1754] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:04.275746 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528b9c2-e08b-4cf1-9d9b-45d47794ea08 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:04.393891 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 881/1755] 10.222.0.16 () {58 vars in 1018 bytes} [Thu May 26 12:35:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:04.394879 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c196d-4097-460a-8028-4ecd5b20fa69 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:04.398892 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-ce9c196d-4097-460a-8028-4ecd5b20fa69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:04.527480 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528b9c2-e08b-4cf1-9d9b-45d47794ea08 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:04.544006 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ea7d2-3af6-4c16-aa2a-e16d91dad3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:04.545277 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ea7d2-3af6-4c16-aa2a-e16d91dad3a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:04.553107 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ea7d2-3af6-4c16-aa2a-e16d91dad3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:04.553462 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ea7d2-3af6-4c16-aa2a-e16d91dad3a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:04.554220 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61ea7d2-3af6-4c16-aa2a-e16d91dad3a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:04.564209 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61ea7d2-3af6-4c16-aa2a-e16d91dad3a6 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:04.653038 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 875/1756] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:35:04 2022] POST /identity/v3/users => generated 309 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:35:04.659640 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ea7d2-3af6-4c16-aa2a-e16d91dad3a6 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:04.672511 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c196d-4097-460a-8028-4ecd5b20fa69 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:04.695893 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de61372-44b5-4b74-97ee-c295d7b21378 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:04.697983 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de61372-44b5-4b74-97ee-c295d7b21378 service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:04.699103 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de61372-44b5-4b74-97ee-c295d7b21378 service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:04.701149 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de61372-44b5-4b74-97ee-c295d7b21378 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:04.706975 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ea7d2-3af6-4c16-aa2a-e16d91dad3a6 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:04.735456 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c2767b-0a7f-44fe-a505-7e8db9d4bc85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:04.735456 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2767b-0a7f-44fe-a505-7e8db9d4bc85 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:04.735456 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2767b-0a7f-44fe-a505-7e8db9d4bc85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:04.735456 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2767b-0a7f-44fe-a505-7e8db9d4bc85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:04.736046 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c2767b-0a7f-44fe-a505-7e8db9d4bc85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:04.737722 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c2767b-0a7f-44fe-a505-7e8db9d4bc85 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:04.811945 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 876/1757] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:35:04.816668 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c2767b-0a7f-44fe-a505-7e8db9d4bc85 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:04.846824 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c2767b-0a7f-44fe-a505-7e8db9d4bc85 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:04.862446 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:04.869958 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf1dba8-7adc-4b4c-9f43-88e363fb8c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:04.872291 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de61372-44b5-4b74-97ee-c295d7b21378 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:04.874482 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1dba8-7adc-4b4c-9f43-88e363fb8c60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:04.875553 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1dba8-7adc-4b4c-9f43-88e363fb8c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:04.876180 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de61372-44b5-4b74-97ee-c295d7b21378 service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:04.876740 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1dba8-7adc-4b4c-9f43-88e363fb8c60 admin admin] PATH_INFO: `/v3/projects/0828e06a380944b3b8e2a97f5e9e020b/users/995f08df23c34907b4db7f3c8507e32e/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:04.903724 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 882/1758] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:35:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:35:04.926136 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf1dba8-7adc-4b4c-9f43-88e363fb8c60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0828e06a380944b3b8e2a97f5e9e020b, user_id=995f08df23c34907b4db7f3c8507e32e, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:04.929955 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf1dba8-7adc-4b4c-9f43-88e363fb8c60 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:04.964058 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 877/1759] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:35:04 2022] PUT /identity/v3/projects/0828e06a380944b3b8e2a97f5e9e020b/users/995f08df23c34907b4db7f3c8507e32e/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:04.970806 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de61372-44b5-4b74-97ee-c295d7b21378 service cinder] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:05.030567 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de61372-44b5-4b74-97ee-c295d7b21378 service cinder] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:05.231001 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e309b26e-bcc4-4071-a414-d08eff763cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:05.231840 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309b26e-bcc4-4071-a414-d08eff763cf2 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:05.232209 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309b26e-bcc4-4071-a414-d08eff763cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:05.233319 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309b26e-bcc4-4071-a414-d08eff763cf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:05.234346 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e309b26e-bcc4-4071-a414-d08eff763cf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:05.236461 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e309b26e-bcc4-4071-a414-d08eff763cf2 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:05.242585 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf1dba8-7adc-4b4c-9f43-88e363fb8c60 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:05.244392 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ccf1dba8-7adc-4b4c-9f43-88e363fb8c60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:05.249241 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 883/1760] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:35:05.253508 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e309b26e-bcc4-4071-a414-d08eff763cf2 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:05.268819 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e309b26e-bcc4-4071-a414-d08eff763cf2 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:05.292606 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:05.303408 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bd6fb5-c81a-499e-ae99-65595c8046ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:05.304474 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd6fb5-c81a-499e-ae99-65595c8046ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:05.304762 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd6fb5-c81a-499e-ae99-65595c8046ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:05.305111 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd6fb5-c81a-499e-ae99-65595c8046ef admin admin] PATH_INFO: `/v3/projects/0828e06a380944b3b8e2a97f5e9e020b/users/995f08df23c34907b4db7f3c8507e32e/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:05.310402 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bd6fb5-c81a-499e-ae99-65595c8046ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=0828e06a380944b3b8e2a97f5e9e020b, user_id=995f08df23c34907b4db7f3c8507e32e, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:05.313911 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bd6fb5-c81a-499e-ae99-65595c8046ef admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:05.369935 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 884/1761] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:35:05 2022] PUT /identity/v3/projects/0828e06a380944b3b8e2a97f5e9e020b/users/995f08df23c34907b4db7f3c8507e32e/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:05.392502 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b377c-7226-4708-88cc-a74648df9205 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:05.396917 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b377c-7226-4708-88cc-a74648df9205 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:05.396917 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b377c-7226-4708-88cc-a74648df9205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:05.491063 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf1dba8-7adc-4b4c-9f43-88e363fb8c60 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:05.555498 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-1a4b377c-7226-4708-88cc-a74648df9205 None None] MFA Rules not processed for user `995f08df23c34907b4db7f3c8507e32e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:05.559382 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-1a4b377c-7226-4708-88cc-a74648df9205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:05.790936 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 885/1762] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:05 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:05.792267 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38c0bd-63d7-4e58-b1ca-11563cf0d577 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:05.792671 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38c0bd-63d7-4e58-b1ca-11563cf0d577 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:05.807047 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38c0bd-63d7-4e58-b1ca-11563cf0d577 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:05.810979 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 886/1763] 10.222.0.16 () {54 vars in 912 bytes} [Thu May 26 12:35:05 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:35:05.816984 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9df8a-0c58-4f6e-ae51-bac00d49d243 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:05.817414 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9df8a-0c58-4f6e-ae51-bac00d49d243 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:05.817880 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9df8a-0c58-4f6e-ae51-bac00d49d243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:05.819421 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6048aa35-11e5-4501-8f77-46c834acc12b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536f68ff77794352adf41aaacdc0645c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:05.820740 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048aa35-11e5-4501-8f77-46c834acc12b service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:05.821068 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048aa35-11e5-4501-8f77-46c834acc12b service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:05.821339 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048aa35-11e5-4501-8f77-46c834acc12b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:05.876409 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-dce9df8a-0c58-4f6e-ae51-bac00d49d243 None None] MFA Rules not processed for user `68033ffcafbc47bbadd008abd9e56c4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:05.880454 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-dce9df8a-0c58-4f6e-ae51-bac00d49d243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:06.006353 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6048aa35-11e5-4501-8f77-46c834acc12b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:06.013008 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6048aa35-11e5-4501-8f77-46c834acc12b service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:06.064174 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 878/1764] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:35:05 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 822 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:35:06.066129 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6048aa35-11e5-4501-8f77-46c834acc12b service nova] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:06.147151 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 887/1765] 10.222.0.16 () {58 vars in 1009 bytes} [Thu May 26 12:35:05 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:06.181093 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce9df8a-0c58-4f6e-ae51-bac00d49d243 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:06.182656 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-dce9df8a-0c58-4f6e-ae51-bac00d49d243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:06.220725 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce9df8a-0c58-4f6e-ae51-bac00d49d243 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:06.245750 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba8637-3bba-4f29-b9e0-f4a5ac93acf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:06.246465 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba8637-3bba-4f29-b9e0-f4a5ac93acf0 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:06.246750 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba8637-3bba-4f29-b9e0-f4a5ac93acf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:06.251172 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba8637-3bba-4f29-b9e0-f4a5ac93acf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:06.271551 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba8637-3bba-4f29-b9e0-f4a5ac93acf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:06.277095 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba8637-3bba-4f29-b9e0-f4a5ac93acf0 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:06.302195 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:06.307441 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:06.315837 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6048aa35-11e5-4501-8f77-46c834acc12b service nova] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:06.318868 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 888/1766] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:35:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:35:06.327953 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a70fb-0004-42c7-aae3-6820fe789d4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:06.329022 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a70fb-0004-42c7-aae3-6820fe789d4a service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:06.329539 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a70fb-0004-42c7-aae3-6820fe789d4a service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:06.330052 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a70fb-0004-42c7-aae3-6820fe789d4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:06.363235 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48a70fb-0004-42c7-aae3-6820fe789d4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:06.364823 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48a70fb-0004-42c7-aae3-6820fe789d4a service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:06.408877 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 879/1767] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:35:06 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:35:06.898348 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba8637-3bba-4f29-b9e0-f4a5ac93acf0 service neutron] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:07.038170 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba8637-3bba-4f29-b9e0-f4a5ac93acf0 service neutron] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:07.059896 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f9b64-6714-41dd-8e2d-3b696f5a8c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:07.063016 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f9b64-6714-41dd-8e2d-3b696f5a8c4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:07.063320 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f9b64-6714-41dd-8e2d-3b696f5a8c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:07.065591 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f9b64-6714-41dd-8e2d-3b696f5a8c4c admin admin] PATH_INFO: `/v3/users/fff8671199f24cb2b2f8c2c5998056ae` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:07.068464 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1f9b64-6714-41dd-8e2d-3b696f5a8c4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fff8671199f24cb2b2f8c2c5998056ae)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:07.075817 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1f9b64-6714-41dd-8e2d-3b696f5a8c4c admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:07.195403 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-cd1f9b64-6714-41dd-8e2d-3b696f5a8c4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fff8671199f24cb2b2f8c2c5998056ae'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:07.196498 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-cd1f9b64-6714-41dd-8e2d-3b696f5a8c4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fff8671199f24cb2b2f8c2c5998056ae'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:07.197416 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-cd1f9b64-6714-41dd-8e2d-3b696f5a8c4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fff8671199f24cb2b2f8c2c5998056ae'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:07.220379 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-cd1f9b64-6714-41dd-8e2d-3b696f5a8c4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fff8671199f24cb2b2f8c2c5998056ae'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:07.242838 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-cd1f9b64-6714-41dd-8e2d-3b696f5a8c4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fff8671199f24cb2b2f8c2c5998056ae'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:07.262106 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 889/1768] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:35:06 2022] DELETE /identity/v3/users/fff8671199f24cb2b2f8c2c5998056ae => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:07.270647 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59de920-e8fa-450e-ba61-0df18bbc644a None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:07.272510 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59de920-e8fa-450e-ba61-0df18bbc644a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:07.272887 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59de920-e8fa-450e-ba61-0df18bbc644a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:07.300316 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b59de920-e8fa-450e-ba61-0df18bbc644a None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:07.301863 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b59de920-e8fa-450e-ba61-0df18bbc644a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:07.387890 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f9b64-6714-41dd-8e2d-3b696f5a8c4c admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:07.389977 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-cd1f9b64-6714-41dd-8e2d-3b696f5a8c4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:07.529713 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 880/1769] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:07.538509 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59de920-e8fa-450e-ba61-0df18bbc644a None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:07.544392 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b59de920-e8fa-450e-ba61-0df18bbc644a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:07.663730 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f9b64-6714-41dd-8e2d-3b696f5a8c4c admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:07.677531 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d13ff89-381c-4f25-9d9e-17264667a1a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536f68ff77794352adf41aaacdc0645c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:07.680796 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13ff89-381c-4f25-9d9e-17264667a1a2 service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:07.681199 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13ff89-381c-4f25-9d9e-17264667a1a2 service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:07.681480 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13ff89-381c-4f25-9d9e-17264667a1a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:07.686495 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-2d13ff89-381c-4f25-9d9e-17264667a1a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:07.703193 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59de920-e8fa-450e-ba61-0df18bbc644a None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:07.725938 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd65c5db-f495-4f5c-8322-f202fc91bd02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:07.726871 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65c5db-f495-4f5c-8322-f202fc91bd02 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:07.727164 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65c5db-f495-4f5c-8322-f202fc91bd02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:07.727442 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65c5db-f495-4f5c-8322-f202fc91bd02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:07.728950 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d13ff89-381c-4f25-9d9e-17264667a1a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:07.735546 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d13ff89-381c-4f25-9d9e-17264667a1a2 service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:07.771218 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd65c5db-f495-4f5c-8322-f202fc91bd02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:07.794437 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd65c5db-f495-4f5c-8322-f202fc91bd02 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:07.819336 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 890/1770] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:35:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:35:07.843534 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 881/1771] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:35:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:35:08.100873 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319083c-4742-4c1a-8558-3184411bbc8b None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:08.101445 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319083c-4742-4c1a-8558-3184411bbc8b None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:08.101445 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319083c-4742-4c1a-8558-3184411bbc8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:08.115820 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:08.211931 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-c319083c-4742-4c1a-8558-3184411bbc8b None None] MFA Rules not processed for user `bd25ae73d8f943839c9682cc4503909d`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:08.221048 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-c319083c-4742-4c1a-8558-3184411bbc8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:08.449247 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 891/1772] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:08.888272 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9426e4e-7653-4f9f-81cf-2c89f9c55599 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:08.889377 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9426e4e-7653-4f9f-81cf-2c89f9c55599 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:08.889639 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9426e4e-7653-4f9f-81cf-2c89f9c55599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:08.921658 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-f9426e4e-7653-4f9f-81cf-2c89f9c55599 None None] MFA Rules not processed for user `62ff83542a7c4c7982affdc3b882cdd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:08.931485 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f9426e4e-7653-4f9f-81cf-2c89f9c55599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:09.080034 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 882/1773] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:09.273917 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c319083c-4742-4c1a-8558-3184411bbc8b None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:09.275401 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-c319083c-4742-4c1a-8558-3184411bbc8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:09.300184 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c319083c-4742-4c1a-8558-3184411bbc8b None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:09.316637 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c1200d-17ae-4d08-aa7a-b8abafb09e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:09.317884 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c1200d-17ae-4d08-aa7a-b8abafb09e84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:09.318134 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c1200d-17ae-4d08-aa7a-b8abafb09e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:09.318410 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c1200d-17ae-4d08-aa7a-b8abafb09e84 admin admin] PATH_INFO: `/v3/projects/9341f9bb360d443e83ca6f9ed05ab355` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:09.319916 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c1200d-17ae-4d08-aa7a-b8abafb09e84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9341f9bb360d443e83ca6f9ed05ab355)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:09.321888 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c1200d-17ae-4d08-aa7a-b8abafb09e84 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:09.505238 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-88c1200d-17ae-4d08-aa7a-b8abafb09e84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9341f9bb360d443e83ca6f9ed05ab355', 'request_id': 'req-88c1200d-17ae-4d08-aa7a-b8abafb09e84'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:09.521681 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-88c1200d-17ae-4d08-aa7a-b8abafb09e84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9341f9bb360d443e83ca6f9ed05ab355', 'request_id': 'req-88c1200d-17ae-4d08-aa7a-b8abafb09e84'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:09.536190 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-88c1200d-17ae-4d08-aa7a-b8abafb09e84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9341f9bb360d443e83ca6f9ed05ab355', 'request_id': 'req-88c1200d-17ae-4d08-aa7a-b8abafb09e84'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:09.584641 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-88c1200d-17ae-4d08-aa7a-b8abafb09e84 admin admin] The token cache is being invalidate because project 9341f9bb360d443e83ca6f9ed05ab355 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:35:09.585227 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-88c1200d-17ae-4d08-aa7a-b8abafb09e84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:09.585994 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-88c1200d-17ae-4d08-aa7a-b8abafb09e84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:09.587632 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 892/1774] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:35:09 2022] DELETE /identity/v3/projects/9341f9bb360d443e83ca6f9ed05ab355 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:09.591976 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9426e4e-7653-4f9f-81cf-2c89f9c55599 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:09.608865 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9426e4e-7653-4f9f-81cf-2c89f9c55599 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:09.738507 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:09.781865 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a8a68-d6fc-4f7f-8a7e-8329c19b86d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:09.782823 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a8a68-d6fc-4f7f-8a7e-8329c19b86d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:09.783108 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a8a68-d6fc-4f7f-8a7e-8329c19b86d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:09.783609 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a8a68-d6fc-4f7f-8a7e-8329c19b86d4 admin admin] PATH_INFO: `/v3/users/995f08df23c34907b4db7f3c8507e32e` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:09.785146 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356a8a68-d6fc-4f7f-8a7e-8329c19b86d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=995f08df23c34907b4db7f3c8507e32e)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:09.788638 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356a8a68-d6fc-4f7f-8a7e-8329c19b86d4 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:09.892019 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-356a8a68-d6fc-4f7f-8a7e-8329c19b86d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '995f08df23c34907b4db7f3c8507e32e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:09.924418 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-356a8a68-d6fc-4f7f-8a7e-8329c19b86d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '995f08df23c34907b4db7f3c8507e32e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:09.931741 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-356a8a68-d6fc-4f7f-8a7e-8329c19b86d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '995f08df23c34907b4db7f3c8507e32e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:09.933729 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-356a8a68-d6fc-4f7f-8a7e-8329c19b86d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '995f08df23c34907b4db7f3c8507e32e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:09.961465 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-356a8a68-d6fc-4f7f-8a7e-8329c19b86d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '995f08df23c34907b4db7f3c8507e32e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:09.990903 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 883/1775] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:35:09 2022] DELETE /identity/v3/users/995f08df23c34907b4db7f3c8507e32e => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:10.886413 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c1200d-17ae-4d08-aa7a-b8abafb09e84 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:10.887881 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-88c1200d-17ae-4d08-aa7a-b8abafb09e84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:10.912051 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c1200d-17ae-4d08-aa7a-b8abafb09e84 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:11.032824 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b691b27-aab4-4064-81e5-a52c8a219663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:11.033798 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b691b27-aab4-4064-81e5-a52c8a219663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:11.034428 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b691b27-aab4-4064-81e5-a52c8a219663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:11.034973 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b691b27-aab4-4064-81e5-a52c8a219663 admin admin] PATH_INFO: `/v3/projects/0828e06a380944b3b8e2a97f5e9e020b` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:11.036511 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b691b27-aab4-4064-81e5-a52c8a219663 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0828e06a380944b3b8e2a97f5e9e020b)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:11.038854 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b691b27-aab4-4064-81e5-a52c8a219663 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:11.102310 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:11.116513 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-8b691b27-aab4-4064-81e5-a52c8a219663 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0828e06a380944b3b8e2a97f5e9e020b', 'request_id': 'req-8b691b27-aab4-4064-81e5-a52c8a219663'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:11.128724 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-8b691b27-aab4-4064-81e5-a52c8a219663 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0828e06a380944b3b8e2a97f5e9e020b', 'request_id': 'req-8b691b27-aab4-4064-81e5-a52c8a219663'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:11.139826 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-8b691b27-aab4-4064-81e5-a52c8a219663 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0828e06a380944b3b8e2a97f5e9e020b', 'request_id': 'req-8b691b27-aab4-4064-81e5-a52c8a219663'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:11.157205 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-8b691b27-aab4-4064-81e5-a52c8a219663 admin admin] The token cache is being invalidate because project 0828e06a380944b3b8e2a97f5e9e020b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:35:11.157584 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-8b691b27-aab4-4064-81e5-a52c8a219663 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:11.158490 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-8b691b27-aab4-4064-81e5-a52c8a219663 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:11.160457 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 893/1776] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:35:10 2022] DELETE /identity/v3/projects/0828e06a380944b3b8e2a97f5e9e020b => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:11.165596 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba7a8d-457c-4afb-bb1b-b17d7b274108 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:11.166169 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba7a8d-457c-4afb-bb1b-b17d7b274108 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:11.166380 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba7a8d-457c-4afb-bb1b-b17d7b274108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:11.209205 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-0bba7a8d-457c-4afb-bb1b-b17d7b274108 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:11.210660 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0bba7a8d-457c-4afb-bb1b-b17d7b274108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:11.425787 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 884/1777] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:35:11.436297 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c60fadb-37af-4e70-b043-612c941fee55 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:11.436672 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c60fadb-37af-4e70-b043-612c941fee55 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:11.437136 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c60fadb-37af-4e70-b043-612c941fee55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:11.526480 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-0c60fadb-37af-4e70-b043-612c941fee55 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:11.527969 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-0c60fadb-37af-4e70-b043-612c941fee55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:11.564444 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 894/1778] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:11.569143 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bba7a8d-457c-4afb-bb1b-b17d7b274108 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:11.587063 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bba7a8d-457c-4afb-bb1b-b17d7b274108 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:11.603752 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c8f3a-5905-47ff-8647-f8c7497dec9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:11.604950 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c8f3a-5905-47ff-8647-f8c7497dec9d admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:11.607433 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c8f3a-5905-47ff-8647-f8c7497dec9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:11.609145 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c8f3a-5905-47ff-8647-f8c7497dec9d admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:11.613601 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c8f3a-5905-47ff-8647-f8c7497dec9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:35:11.615137 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c8f3a-5905-47ff-8647-f8c7497dec9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:11.618589 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c8f3a-5905-47ff-8647-f8c7497dec9d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:11.667286 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c60fadb-37af-4e70-b043-612c941fee55 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:11.674497 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 885/1779] 10.222.0.16 () {58 vars in 1152 bytes} [Thu May 26 12:35:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:35:11.682429 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c60fadb-37af-4e70-b043-612c941fee55 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:11.697550 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077cc94f-a5da-4a84-b103-be2ecf6297c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:11.698476 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077cc94f-a5da-4a84-b103-be2ecf6297c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:11.698929 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077cc94f-a5da-4a84-b103-be2ecf6297c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:11.699367 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077cc94f-a5da-4a84-b103-be2ecf6297c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:11.700531 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077cc94f-a5da-4a84-b103-be2ecf6297c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:11.705639 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077cc94f-a5da-4a84-b103-be2ecf6297c7 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:11.770074 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 895/1780] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:35:11 2022] POST /identity/v3/projects => generated 355 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:35:11.773731 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c8f3a-5905-47ff-8647-f8c7497dec9d admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:11.797418 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c8f3a-5905-47ff-8647-f8c7497dec9d admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:11.950004 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:11.976577 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5a4625-6ae5-46be-af3a-ba1407400afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:11.977613 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a4625-6ae5-46be-af3a-ba1407400afc admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:11.979102 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a4625-6ae5-46be-af3a-ba1407400afc admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:11.979602 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a4625-6ae5-46be-af3a-ba1407400afc admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:11.980516 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5a4625-6ae5-46be-af3a-ba1407400afc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:11.985766 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5a4625-6ae5-46be-af3a-ba1407400afc admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:12.019296 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 886/1781] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:35:11 2022] POST /identity/v3/users => generated 278 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:35:12.024453 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077cc94f-a5da-4a84-b103-be2ecf6297c7 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:12.035951 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5a4625-6ae5-46be-af3a-ba1407400afc admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:12.038970 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6d5a4625-6ae5-46be-af3a-ba1407400afc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:12.050058 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077cc94f-a5da-4a84-b103-be2ecf6297c7 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:12.068589 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59294da1-5d67-46cf-9e05-97db716cd36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:12.069543 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59294da1-5d67-46cf-9e05-97db716cd36f admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:12.073494 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59294da1-5d67-46cf-9e05-97db716cd36f admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:12.074224 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59294da1-5d67-46cf-9e05-97db716cd36f admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:12.075562 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59294da1-5d67-46cf-9e05-97db716cd36f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:12.080294 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5a4625-6ae5-46be-af3a-ba1407400afc admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:12.080491 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59294da1-5d67-46cf-9e05-97db716cd36f admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:12.104887 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d1e7cb-9c49-401a-9028-fd07c5a42287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:12.104887 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1e7cb-9c49-401a-9028-fd07c5a42287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:12.104887 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1e7cb-9c49-401a-9028-fd07c5a42287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:12.104887 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1e7cb-9c49-401a-9028-fd07c5a42287 admin admin] PATH_INFO: `/v3/users/4eecaff9a4a74e4dace7bf7de584b190` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:12.105391 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d1e7cb-9c49-401a-9028-fd07c5a42287 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4eecaff9a4a74e4dace7bf7de584b190)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:12.105391 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d1e7cb-9c49-401a-9028-fd07c5a42287 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:12.105524 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 896/1782] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:35:12.109208 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59294da1-5d67-46cf-9e05-97db716cd36f admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:12.129187 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59294da1-5d67-46cf-9e05-97db716cd36f admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:12.139119 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf83d57-81f6-479b-a3c7-9f975a7556c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:12.140206 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf83d57-81f6-479b-a3c7-9f975a7556c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:12.140863 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf83d57-81f6-479b-a3c7-9f975a7556c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:12.141216 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf83d57-81f6-479b-a3c7-9f975a7556c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:12.143036 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf83d57-81f6-479b-a3c7-9f975a7556c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:12.145227 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf83d57-81f6-479b-a3c7-9f975a7556c2 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:12.157456 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 897/1783] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:35:12.161741 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf83d57-81f6-479b-a3c7-9f975a7556c2 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:12.166769 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-45d1e7cb-9c49-401a-9028-fd07c5a42287 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4eecaff9a4a74e4dace7bf7de584b190'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:12.173718 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf83d57-81f6-479b-a3c7-9f975a7556c2 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:12.176033 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-45d1e7cb-9c49-401a-9028-fd07c5a42287 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4eecaff9a4a74e4dace7bf7de584b190'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:12.176818 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-45d1e7cb-9c49-401a-9028-fd07c5a42287 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4eecaff9a4a74e4dace7bf7de584b190'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:12.177528 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-45d1e7cb-9c49-401a-9028-fd07c5a42287 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4eecaff9a4a74e4dace7bf7de584b190'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:12.179377 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03efcc6a-4c36-4c62-b3b8-59f29c071544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:12.180319 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03efcc6a-4c36-4c62-b3b8-59f29c071544 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:12.180620 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03efcc6a-4c36-4c62-b3b8-59f29c071544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:12.180911 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03efcc6a-4c36-4c62-b3b8-59f29c071544 admin admin] PATH_INFO: `/v3/projects/aac9ac546b48497d9dea2c314b9b8744/users/8a840973f0aa4c46b91a94c3e8d04893/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:12.186029 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-45d1e7cb-9c49-401a-9028-fd07c5a42287 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4eecaff9a4a74e4dace7bf7de584b190'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:12.197321 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03efcc6a-4c36-4c62-b3b8-59f29c071544 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aac9ac546b48497d9dea2c314b9b8744, user_id=8a840973f0aa4c46b91a94c3e8d04893, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:12.200045 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03efcc6a-4c36-4c62-b3b8-59f29c071544 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:12.206715 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 887/1784] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:35:12 2022] DELETE /identity/v3/users/4eecaff9a4a74e4dace7bf7de584b190 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:35:12.211144 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9c14f-a6ac-43e9-be45-23ec32e7526b None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:12.211432 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9c14f-a6ac-43e9-be45-23ec32e7526b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:12.211707 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9c14f-a6ac-43e9-be45-23ec32e7526b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:12.215820 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 898/1785] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:35:12 2022] PUT /identity/v3/projects/aac9ac546b48497d9dea2c314b9b8744/users/8a840973f0aa4c46b91a94c3e8d04893/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:12.226107 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaade97-baba-4709-82c5-287ee898dc6e None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:12.226477 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaade97-baba-4709-82c5-287ee898dc6e None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:12.226930 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaade97-baba-4709-82c5-287ee898dc6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:12.233629 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-4ea9c14f-a6ac-43e9-be45-23ec32e7526b None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:12.234821 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4ea9c14f-a6ac-43e9-be45-23ec32e7526b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:12.269049 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-4eaade97-baba-4709-82c5-287ee898dc6e None None] MFA Rules not processed for user `8a840973f0aa4c46b91a94c3e8d04893`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:12.270590 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-4eaade97-baba-4709-82c5-287ee898dc6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:12.320210 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 888/1786] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:12.329440 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea9c14f-a6ac-43e9-be45-23ec32e7526b None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:12.331084 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4ea9c14f-a6ac-43e9-be45-23ec32e7526b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:12.357858 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 899/1787] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:12 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:35:12.362160 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaade97-baba-4709-82c5-287ee898dc6e None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:12.363524 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-4eaade97-baba-4709-82c5-287ee898dc6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:12.377598 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaade97-baba-4709-82c5-287ee898dc6e None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:12.382236 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c72540-cb2e-4d86-9e7e-d7915e7e6681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:12.382884 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c72540-cb2e-4d86-9e7e-d7915e7e6681 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:12.383167 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c72540-cb2e-4d86-9e7e-d7915e7e6681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:12.383445 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c72540-cb2e-4d86-9e7e-d7915e7e6681 admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:12.384128 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c72540-cb2e-4d86-9e7e-d7915e7e6681 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:12.386084 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c72540-cb2e-4d86-9e7e-d7915e7e6681 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:12.396306 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:12.400351 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea9c14f-a6ac-43e9-be45-23ec32e7526b None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:12.406256 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da490cd-f269-41fe-b196-eb95713de49a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:12.407065 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da490cd-f269-41fe-b196-eb95713de49a service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:12.408027 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da490cd-f269-41fe-b196-eb95713de49a service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:12.408340 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da490cd-f269-41fe-b196-eb95713de49a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:12.416658 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 900/1788] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:35:12 2022] POST /identity/v3/projects => generated 353 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:35:12.417675 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c72540-cb2e-4d86-9e7e-d7915e7e6681 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:12.418547 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da490cd-f269-41fe-b196-eb95713de49a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:12.420036 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da490cd-f269-41fe-b196-eb95713de49a service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:12.429703 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 889/1789] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:35:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:35:12.431051 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:12.480111 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c72540-cb2e-4d86-9e7e-d7915e7e6681 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:12.485994 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bdc17e-720c-4284-acd0-8b228d70530f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:12.486678 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bdc17e-720c-4284-acd0-8b228d70530f admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:12.486959 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bdc17e-720c-4284-acd0-8b228d70530f admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:12.487230 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bdc17e-720c-4284-acd0-8b228d70530f admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:12.487986 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bdc17e-720c-4284-acd0-8b228d70530f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:12.490270 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bdc17e-720c-4284-acd0-8b228d70530f admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:12.524028 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 901/1790] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:35:12 2022] POST /identity/v3/users => generated 283 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:35:12.525223 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da490cd-f269-41fe-b196-eb95713de49a service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:12.535520 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da490cd-f269-41fe-b196-eb95713de49a service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:12.541332 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164625ff-6286-4d15-88d8-fcb844205cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:12.542002 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164625ff-6286-4d15-88d8-fcb844205cfc admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:12.542289 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164625ff-6286-4d15-88d8-fcb844205cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:12.542574 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164625ff-6286-4d15-88d8-fcb844205cfc admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:12.543283 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164625ff-6286-4d15-88d8-fcb844205cfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:12.545438 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164625ff-6286-4d15-88d8-fcb844205cfc admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:12.556651 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 890/1791] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:35:12.561202 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bdc17e-720c-4284-acd0-8b228d70530f admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:12.573244 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bdc17e-720c-4284-acd0-8b228d70530f admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:12.583170 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635db943-572e-4be9-9970-dda926578817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:12.583578 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635db943-572e-4be9-9970-dda926578817 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:12.583987 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635db943-572e-4be9-9970-dda926578817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:12.584269 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635db943-572e-4be9-9970-dda926578817 admin admin] PATH_INFO: `/v3/projects/ccd69e93c4aa4687b40f63a8d50ada01/users/09dcb366a82d4bdc81c084da0da88a22/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:12.614894 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635db943-572e-4be9-9970-dda926578817 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccd69e93c4aa4687b40f63a8d50ada01, user_id=09dcb366a82d4bdc81c084da0da88a22, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:12.617636 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635db943-572e-4be9-9970-dda926578817 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:12.635137 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 902/1792] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:35:12 2022] PUT /identity/v3/projects/ccd69e93c4aa4687b40f63a8d50ada01/users/09dcb366a82d4bdc81c084da0da88a22/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:12.639714 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164625ff-6286-4d15-88d8-fcb844205cfc admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:12.655377 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164625ff-6286-4d15-88d8-fcb844205cfc admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:12.764351 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a326a78-eee1-4939-be9f-6b9b9b9a8a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:12.765628 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a326a78-eee1-4939-be9f-6b9b9b9a8a46 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:12.765923 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a326a78-eee1-4939-be9f-6b9b9b9a8a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:12.766478 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a326a78-eee1-4939-be9f-6b9b9b9a8a46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:12.767162 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a326a78-eee1-4939-be9f-6b9b9b9a8a46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:12.769097 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a326a78-eee1-4939-be9f-6b9b9b9a8a46 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:12.787869 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 891/1793] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:35:12.788052 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635db943-572e-4be9-9970-dda926578817 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:12.798391 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a326a78-eee1-4939-be9f-6b9b9b9a8a46 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:12.800412 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6a326a78-eee1-4939-be9f-6b9b9b9a8a46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:12.813960 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635db943-572e-4be9-9970-dda926578817 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:12.824237 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a326a78-eee1-4939-be9f-6b9b9b9a8a46 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:12.830862 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd2d060-cfec-4a85-a3bf-55ae883c46fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:12.832182 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd2d060-cfec-4a85-a3bf-55ae883c46fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:12.832182 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd2d060-cfec-4a85-a3bf-55ae883c46fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:12.837581 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd19ab-bdaf-491a-a9fe-6218ed30deaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:12.838474 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd19ab-bdaf-491a-a9fe-6218ed30deaf admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:12.838769 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd19ab-bdaf-491a-a9fe-6218ed30deaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:12.839055 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd19ab-bdaf-491a-a9fe-6218ed30deaf admin admin] PATH_INFO: `/v3/projects/ccd69e93c4aa4687b40f63a8d50ada01/users/09dcb366a82d4bdc81c084da0da88a22/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:12.839579 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd2d060-cfec-4a85-a3bf-55ae883c46fb admin admin] PATH_INFO: `/v3/projects/30e104d95f584145bcb3e26301ead424` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:12.841045 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd2d060-cfec-4a85-a3bf-55ae883c46fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=30e104d95f584145bcb3e26301ead424)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:12.843426 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd2d060-cfec-4a85-a3bf-55ae883c46fb admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:12.865321 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cd19ab-bdaf-491a-a9fe-6218ed30deaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccd69e93c4aa4687b40f63a8d50ada01, user_id=09dcb366a82d4bdc81c084da0da88a22, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:12.867887 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cd19ab-bdaf-491a-a9fe-6218ed30deaf admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:12.892874 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 903/1794] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:35:12 2022] PUT /identity/v3/projects/ccd69e93c4aa4687b40f63a8d50ada01/users/09dcb366a82d4bdc81c084da0da88a22/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:35:12.904832 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2cc337-46b7-4a19-9df5-4a2f953fcd1b None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:12.905146 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2cc337-46b7-4a19-9df5-4a2f953fcd1b None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:12.905426 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2cc337-46b7-4a19-9df5-4a2f953fcd1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:12.942825 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-1dd2d060-cfec-4a85-a3bf-55ae883c46fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30e104d95f584145bcb3e26301ead424', 'request_id': 'req-1dd2d060-cfec-4a85-a3bf-55ae883c46fb'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:12.961480 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-1dd2d060-cfec-4a85-a3bf-55ae883c46fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30e104d95f584145bcb3e26301ead424', 'request_id': 'req-1dd2d060-cfec-4a85-a3bf-55ae883c46fb'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:12.979101 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-1dd2d060-cfec-4a85-a3bf-55ae883c46fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30e104d95f584145bcb3e26301ead424', 'request_id': 'req-1dd2d060-cfec-4a85-a3bf-55ae883c46fb'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:13.001699 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-1dd2d060-cfec-4a85-a3bf-55ae883c46fb admin admin] The token cache is being invalidate because project 30e104d95f584145bcb3e26301ead424 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:35:13.001994 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-1dd2d060-cfec-4a85-a3bf-55ae883c46fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:13.004548 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-1dd2d060-cfec-4a85-a3bf-55ae883c46fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:13.007356 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 892/1795] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:35:12 2022] DELETE /identity/v3/projects/30e104d95f584145bcb3e26301ead424 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:35:13.012257 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-fc2cc337-46b7-4a19-9df5-4a2f953fcd1b None None] MFA Rules not processed for user `09dcb366a82d4bdc81c084da0da88a22`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:13.015532 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd2d060-cfec-4a85-a3bf-55ae883c46fb admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:13.016071 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-fc2cc337-46b7-4a19-9df5-4a2f953fcd1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:13.018847 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1dd2d060-cfec-4a85-a3bf-55ae883c46fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:13.188248 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 904/1796] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:12 2022] POST /identity/v3/auth/tokens => generated 3287 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:13.190453 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2cc337-46b7-4a19-9df5-4a2f953fcd1b None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:13.193477 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-fc2cc337-46b7-4a19-9df5-4a2f953fcd1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:13.226690 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd2d060-cfec-4a85-a3bf-55ae883c46fb admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:13.236695 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2cc337-46b7-4a19-9df5-4a2f953fcd1b None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:13.244391 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668139b4-7174-46e1-a7a5-76e07cbfa6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:13.245433 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668139b4-7174-46e1-a7a5-76e07cbfa6f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:13.245562 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c4f4f-eb00-4f81-bfc0-6298b03bd8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:13.245945 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668139b4-7174-46e1-a7a5-76e07cbfa6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:13.246060 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668139b4-7174-46e1-a7a5-76e07cbfa6f5 admin admin] PATH_INFO: `/v3/users/b687a62f5bdd4bf48ab38d7906da4333` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:13.246470 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c4f4f-eb00-4f81-bfc0-6298b03bd8a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:13.246781 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c4f4f-eb00-4f81-bfc0-6298b03bd8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:13.246994 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c4f4f-eb00-4f81-bfc0-6298b03bd8a3 admin admin] PATH_INFO: `/v3/users/cb03117e7bde42b7a297161ff8f1d532` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:13.247607 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668139b4-7174-46e1-a7a5-76e07cbfa6f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b687a62f5bdd4bf48ab38d7906da4333)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:13.249887 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c4f4f-eb00-4f81-bfc0-6298b03bd8a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb03117e7bde42b7a297161ff8f1d532)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:13.250839 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668139b4-7174-46e1-a7a5-76e07cbfa6f5 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:13.255209 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c4f4f-eb00-4f81-bfc0-6298b03bd8a3 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:13.267589 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:13.339595 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:13.344097 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-668139b4-7174-46e1-a7a5-76e07cbfa6f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b687a62f5bdd4bf48ab38d7906da4333'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:13.345007 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-668139b4-7174-46e1-a7a5-76e07cbfa6f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b687a62f5bdd4bf48ab38d7906da4333'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:13.349746 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-668139b4-7174-46e1-a7a5-76e07cbfa6f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b687a62f5bdd4bf48ab38d7906da4333'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:13.371746 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-668139b4-7174-46e1-a7a5-76e07cbfa6f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b687a62f5bdd4bf48ab38d7906da4333'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:13.399534 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-668139b4-7174-46e1-a7a5-76e07cbfa6f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b687a62f5bdd4bf48ab38d7906da4333'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:13.408524 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fd8c4f4f-eb00-4f81-bfc0-6298b03bd8a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb03117e7bde42b7a297161ff8f1d532'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:13.429752 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 905/1797] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:35:13 2022] DELETE /identity/v3/users/b687a62f5bdd4bf48ab38d7906da4333 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:13.430117 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fd8c4f4f-eb00-4f81-bfc0-6298b03bd8a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb03117e7bde42b7a297161ff8f1d532'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:13.430693 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fd8c4f4f-eb00-4f81-bfc0-6298b03bd8a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb03117e7bde42b7a297161ff8f1d532'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:13.431326 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fd8c4f4f-eb00-4f81-bfc0-6298b03bd8a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb03117e7bde42b7a297161ff8f1d532'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:13.431470 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668139b4-7174-46e1-a7a5-76e07cbfa6f5 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:13.434792 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-668139b4-7174-46e1-a7a5-76e07cbfa6f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:13.442656 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fd8c4f4f-eb00-4f81-bfc0-6298b03bd8a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb03117e7bde42b7a297161ff8f1d532'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:13.487677 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 893/1798] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:35:13 2022] DELETE /identity/v3/users/cb03117e7bde42b7a297161ff8f1d532 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:13.489175 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1763acc-5cad-4fbc-84c8-4ff99a0a40b8 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:13.489524 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1763acc-5cad-4fbc-84c8-4ff99a0a40b8 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:13.489870 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1763acc-5cad-4fbc-84c8-4ff99a0a40b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:13.510183 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d1763acc-5cad-4fbc-84c8-4ff99a0a40b8 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:13.511765 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d1763acc-5cad-4fbc-84c8-4ff99a0a40b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:13.527866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668139b4-7174-46e1-a7a5-76e07cbfa6f5 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:13.601216 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 894/1799] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:13.611688 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc4cc5-027a-4bf4-8fda-baa8f4dd8a09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:13.612350 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc4cc5-027a-4bf4-8fda-baa8f4dd8a09 service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:13.612704 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc4cc5-027a-4bf4-8fda-baa8f4dd8a09 service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:13.613013 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc4cc5-027a-4bf4-8fda-baa8f4dd8a09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:13.615022 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-29dc4cc5-027a-4bf4-8fda-baa8f4dd8a09 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:13.641884 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1763acc-5cad-4fbc-84c8-4ff99a0a40b8 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:13.643320 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d1763acc-5cad-4fbc-84c8-4ff99a0a40b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:13.719433 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dc4cc5-027a-4bf4-8fda-baa8f4dd8a09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:13.721054 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dc4cc5-027a-4bf4-8fda-baa8f4dd8a09 service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:13.733503 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 906/1800] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:35:13 2022] GET /identity/v3/auth/tokens => generated 3287 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:35:13.775764 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1763acc-5cad-4fbc-84c8-4ff99a0a40b8 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:13.798215 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa1434-e94d-4d88-a67a-0ae7674a66b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:13.799986 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa1434-e94d-4d88-a67a-0ae7674a66b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:13.800487 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa1434-e94d-4d88-a67a-0ae7674a66b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:13.801004 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa1434-e94d-4d88-a67a-0ae7674a66b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:13.825867 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa1434-e94d-4d88-a67a-0ae7674a66b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:13.828687 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa1434-e94d-4d88-a67a-0ae7674a66b0 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:13.874128 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 895/1801] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:35:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:35:13.917595 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc4cc5-027a-4bf4-8fda-baa8f4dd8a09 service cinder] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:13.919071 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-29dc4cc5-027a-4bf4-8fda-baa8f4dd8a09 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:13.934430 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc4cc5-027a-4bf4-8fda-baa8f4dd8a09 service cinder] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:13.944774 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef393511-23e5-4a76-ad9c-64351cda9461 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:13.945468 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef393511-23e5-4a76-ad9c-64351cda9461 service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:13.945753 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef393511-23e5-4a76-ad9c-64351cda9461 service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:13.946029 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef393511-23e5-4a76-ad9c-64351cda9461 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:13.957288 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-ef393511-23e5-4a76-ad9c-64351cda9461 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:14.040287 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:14.102551 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef393511-23e5-4a76-ad9c-64351cda9461 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:14.104300 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef393511-23e5-4a76-ad9c-64351cda9461 service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:14.140816 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 907/1802] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:35:13 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:35:14.421656 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa1434-e94d-4d88-a67a-0ae7674a66b0 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:14.423732 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-94fa1434-e94d-4d88-a67a-0ae7674a66b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:14.448301 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa1434-e94d-4d88-a67a-0ae7674a66b0 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:14.476967 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b923f-a4ee-4f9b-9daf-4ba3a42c0112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:14.477874 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b923f-a4ee-4f9b-9daf-4ba3a42c0112 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:14.478154 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b923f-a4ee-4f9b-9daf-4ba3a42c0112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:14.478429 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b923f-a4ee-4f9b-9daf-4ba3a42c0112 admin admin] PATH_INFO: `/v3/projects/32b9b3438e684284aa175e2c0e221157` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:14.482501 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701b923f-a4ee-4f9b-9daf-4ba3a42c0112 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32b9b3438e684284aa175e2c0e221157)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:14.490249 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701b923f-a4ee-4f9b-9daf-4ba3a42c0112 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:14.521981 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:14.597558 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-701b923f-a4ee-4f9b-9daf-4ba3a42c0112 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32b9b3438e684284aa175e2c0e221157', 'request_id': 'req-701b923f-a4ee-4f9b-9daf-4ba3a42c0112'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:14.619607 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-701b923f-a4ee-4f9b-9daf-4ba3a42c0112 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32b9b3438e684284aa175e2c0e221157', 'request_id': 'req-701b923f-a4ee-4f9b-9daf-4ba3a42c0112'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:14.640370 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-701b923f-a4ee-4f9b-9daf-4ba3a42c0112 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32b9b3438e684284aa175e2c0e221157', 'request_id': 'req-701b923f-a4ee-4f9b-9daf-4ba3a42c0112'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:14.690707 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-701b923f-a4ee-4f9b-9daf-4ba3a42c0112 admin admin] The token cache is being invalidate because project 32b9b3438e684284aa175e2c0e221157 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:35:14.690999 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-701b923f-a4ee-4f9b-9daf-4ba3a42c0112 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:14.695908 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-701b923f-a4ee-4f9b-9daf-4ba3a42c0112 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:14.701892 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 896/1803] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:35:14 2022] DELETE /identity/v3/projects/32b9b3438e684284aa175e2c0e221157 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:35:14.704194 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67424ba-a5ca-48ff-b25e-24ba77182b33 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:14.704194 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67424ba-a5ca-48ff-b25e-24ba77182b33 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:14.704194 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67424ba-a5ca-48ff-b25e-24ba77182b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:14.742323 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-a67424ba-a5ca-48ff-b25e-24ba77182b33 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:14.755583 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-a67424ba-a5ca-48ff-b25e-24ba77182b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:14.897545 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 908/1804] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:14.905403 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fabea2-eae6-487a-8112-065141fd7178 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:14.905709 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fabea2-eae6-487a-8112-065141fd7178 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:14.905964 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fabea2-eae6-487a-8112-065141fd7178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:14.944273 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-55fabea2-eae6-487a-8112-065141fd7178 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:14.945648 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-55fabea2-eae6-487a-8112-065141fd7178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:14.959518 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 897/1805] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:14.964050 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67424ba-a5ca-48ff-b25e-24ba77182b33 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:14.980704 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67424ba-a5ca-48ff-b25e-24ba77182b33 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:15.003209 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247bd4a0-fd40-41ae-ae9f-92e0225e644e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:15.004424 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247bd4a0-fd40-41ae-ae9f-92e0225e644e admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:15.006297 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247bd4a0-fd40-41ae-ae9f-92e0225e644e admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:15.010025 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247bd4a0-fd40-41ae-ae9f-92e0225e644e admin admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:15.011298 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247bd4a0-fd40-41ae-ae9f-92e0225e644e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:35:15.012258 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247bd4a0-fd40-41ae-ae9f-92e0225e644e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:15.017093 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247bd4a0-fd40-41ae-ae9f-92e0225e644e admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:15.038825 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 909/1806] 10.222.0.16 () {58 vars in 1152 bytes} [Thu May 26 12:35:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:35:15.043186 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fabea2-eae6-487a-8112-065141fd7178 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:15.052641 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fabea2-eae6-487a-8112-065141fd7178 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:15.058128 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f4d47c-0c17-4957-a861-c8c96b095c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:15.059304 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4d47c-0c17-4957-a861-c8c96b095c64 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:15.059304 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4d47c-0c17-4957-a861-c8c96b095c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:15.059480 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4d47c-0c17-4957-a861-c8c96b095c64 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:15.060568 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f4d47c-0c17-4957-a861-c8c96b095c64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:15.062606 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f4d47c-0c17-4957-a861-c8c96b095c64 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:15.111209 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 898/1807] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:35:15 2022] POST /identity/v3/projects => generated 379 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:35:15.112099 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247bd4a0-fd40-41ae-ae9f-92e0225e644e admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:15.122613 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247bd4a0-fd40-41ae-ae9f-92e0225e644e admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:15.218071 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edacd86e-fc15-408d-9975-cb8a76576a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:15.218905 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edacd86e-fc15-408d-9975-cb8a76576a72 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:15.219259 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edacd86e-fc15-408d-9975-cb8a76576a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:15.219599 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edacd86e-fc15-408d-9975-cb8a76576a72 admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:15.220458 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edacd86e-fc15-408d-9975-cb8a76576a72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:15.233417 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edacd86e-fc15-408d-9975-cb8a76576a72 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:15.268046 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 910/1808] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:35:15 2022] POST /identity/v3/users => generated 290 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:35:15.269279 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f4d47c-0c17-4957-a861-c8c96b095c64 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:15.284460 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f4d47c-0c17-4957-a861-c8c96b095c64 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:15.293054 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0a876-8541-48fc-b7a9-0f861403dd50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:15.293949 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0a876-8541-48fc-b7a9-0f861403dd50 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:15.294308 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0a876-8541-48fc-b7a9-0f861403dd50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:15.294662 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0a876-8541-48fc-b7a9-0f861403dd50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:15.295518 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a0a876-8541-48fc-b7a9-0f861403dd50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:15.297339 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a0a876-8541-48fc-b7a9-0f861403dd50 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:15.312874 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 899/1809] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:35:15 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:35:15.315148 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edacd86e-fc15-408d-9975-cb8a76576a72 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:15.315940 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0a876-8541-48fc-b7a9-0f861403dd50 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:15.318381 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e6a0a876-8541-48fc-b7a9-0f861403dd50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:15.326938 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edacd86e-fc15-408d-9975-cb8a76576a72 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:15.333554 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e8412a-b8ee-4cb0-9961-f471dbf37825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:15.344009 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0a876-8541-48fc-b7a9-0f861403dd50 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:15.348415 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8412a-b8ee-4cb0-9961-f471dbf37825 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:15.348874 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8412a-b8ee-4cb0-9961-f471dbf37825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:15.349261 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8412a-b8ee-4cb0-9961-f471dbf37825 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:15.351257 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e22b080-acf7-418f-86f4-35613e163b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:15.351625 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e8412a-b8ee-4cb0-9961-f471dbf37825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:15.352483 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22b080-acf7-418f-86f4-35613e163b7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:15.352950 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22b080-acf7-418f-86f4-35613e163b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:15.353383 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22b080-acf7-418f-86f4-35613e163b7e admin admin] PATH_INFO: `/v3/projects/7c021f5a675444baaf2b84ae84d5d646` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:15.354478 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e8412a-b8ee-4cb0-9961-f471dbf37825 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:15.355644 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e22b080-acf7-418f-86f4-35613e163b7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c021f5a675444baaf2b84ae84d5d646)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:15.360183 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e22b080-acf7-418f-86f4-35613e163b7e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:15.387533 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 911/1810] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:35:15 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:35:15.392403 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e8412a-b8ee-4cb0-9961-f471dbf37825 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:15.434813 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e8412a-b8ee-4cb0-9961-f471dbf37825 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:15.465456 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3e22b080-acf7-418f-86f4-35613e163b7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c021f5a675444baaf2b84ae84d5d646', 'request_id': 'req-3e22b080-acf7-418f-86f4-35613e163b7e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:15.477473 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3e22b080-acf7-418f-86f4-35613e163b7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c021f5a675444baaf2b84ae84d5d646', 'request_id': 'req-3e22b080-acf7-418f-86f4-35613e163b7e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:15.494406 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3e22b080-acf7-418f-86f4-35613e163b7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c021f5a675444baaf2b84ae84d5d646', 'request_id': 'req-3e22b080-acf7-418f-86f4-35613e163b7e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:15.530548 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3e22b080-acf7-418f-86f4-35613e163b7e admin admin] The token cache is being invalidate because project 7c021f5a675444baaf2b84ae84d5d646 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:35:15.530820 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3e22b080-acf7-418f-86f4-35613e163b7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:15.531496 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3e22b080-acf7-418f-86f4-35613e163b7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:15.533445 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 900/1811] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:35:15 2022] DELETE /identity/v3/projects/7c021f5a675444baaf2b84ae84d5d646 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:35:15.538236 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da385ccc-f31b-460f-be9e-6e7b4d6f7f17 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:15.538653 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da385ccc-f31b-460f-be9e-6e7b4d6f7f17 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:15.539026 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da385ccc-f31b-460f-be9e-6e7b4d6f7f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:15.543373 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:15.586054 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-da385ccc-f31b-460f-be9e-6e7b4d6f7f17 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:15.589525 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-da385ccc-f31b-460f-be9e-6e7b4d6f7f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:15.619403 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd7583c-0565-4b67-b88f-c33bcef9da58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:15.620434 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7583c-0565-4b67-b88f-c33bcef9da58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:15.620820 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7583c-0565-4b67-b88f-c33bcef9da58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:15.621303 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7583c-0565-4b67-b88f-c33bcef9da58 admin admin] PATH_INFO: `/v3/projects/f5ffb487023a4350b57ae81eb6b26e4e/users/0cc14a3ef9954e85b6b84234fbb223ac/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:15.666116 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd7583c-0565-4b67-b88f-c33bcef9da58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5ffb487023a4350b57ae81eb6b26e4e, user_id=0cc14a3ef9954e85b6b84234fbb223ac, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:15.678910 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd7583c-0565-4b67-b88f-c33bcef9da58 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:15.719693 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 912/1812] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:35:15 2022] PUT /identity/v3/projects/f5ffb487023a4350b57ae81eb6b26e4e/users/0cc14a3ef9954e85b6b84234fbb223ac/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:35:15.722378 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505167a7-95e0-47f1-9af7-d595a48ea99c None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:15.723201 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505167a7-95e0-47f1-9af7-d595a48ea99c None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:15.723937 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505167a7-95e0-47f1-9af7-d595a48ea99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:15.757215 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:15.783331 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 901/1813] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:15.793900 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6b345-d64a-4cfd-b4c6-2c780c8b67b3 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:15.795281 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6b345-d64a-4cfd-b4c6-2c780c8b67b3 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:15.795281 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6b345-d64a-4cfd-b4c6-2c780c8b67b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:15.800478 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-505167a7-95e0-47f1-9af7-d595a48ea99c None None] MFA Rules not processed for user `0cc14a3ef9954e85b6b84234fbb223ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:15.805572 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-505167a7-95e0-47f1-9af7-d595a48ea99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:15.831988 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-8ff6b345-d64a-4cfd-b4c6-2c780c8b67b3 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:15.835442 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8ff6b345-d64a-4cfd-b4c6-2c780c8b67b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:15.964549 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 913/1814] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:15.969475 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505167a7-95e0-47f1-9af7-d595a48ea99c None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:15.971506 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-505167a7-95e0-47f1-9af7-d595a48ea99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:15.999493 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 902/1815] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:16.002377 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff6b345-d64a-4cfd-b4c6-2c780c8b67b3 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:16.021745 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff6b345-d64a-4cfd-b4c6-2c780c8b67b3 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:16.027932 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c10c8b0-8feb-4b2a-a0e3-738d523fa08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:16.028868 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10c8b0-8feb-4b2a-a0e3-738d523fa08c admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:16.030408 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10c8b0-8feb-4b2a-a0e3-738d523fa08c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:16.030833 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10c8b0-8feb-4b2a-a0e3-738d523fa08c admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:16.031722 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c10c8b0-8feb-4b2a-a0e3-738d523fa08c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:35:16.032035 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c10c8b0-8feb-4b2a-a0e3-738d523fa08c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:16.033887 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c10c8b0-8feb-4b2a-a0e3-738d523fa08c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:16.077214 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 903/1816] 10.222.0.16 () {58 vars in 1152 bytes} [Thu May 26 12:35:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:35:16.078077 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c10c8b0-8feb-4b2a-a0e3-738d523fa08c admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:16.093250 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c10c8b0-8feb-4b2a-a0e3-738d523fa08c admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:16.110177 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead3481e-a92e-4f05-aab4-c8a87ca9fd8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:16.110863 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead3481e-a92e-4f05-aab4-c8a87ca9fd8a admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:16.111147 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead3481e-a92e-4f05-aab4-c8a87ca9fd8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:16.111428 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead3481e-a92e-4f05-aab4-c8a87ca9fd8a admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:16.112131 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead3481e-a92e-4f05-aab4-c8a87ca9fd8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:16.114136 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead3481e-a92e-4f05-aab4-c8a87ca9fd8a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:16.127513 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505167a7-95e0-47f1-9af7-d595a48ea99c None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:16.143432 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e809dfdc-f7be-4066-a220-ff2803ed5e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:16.144274 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e809dfdc-f7be-4066-a220-ff2803ed5e6f admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:16.144402 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e809dfdc-f7be-4066-a220-ff2803ed5e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:16.144661 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e809dfdc-f7be-4066-a220-ff2803ed5e6f admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:16.145395 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e809dfdc-f7be-4066-a220-ff2803ed5e6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:16.149977 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e809dfdc-f7be-4066-a220-ff2803ed5e6f admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:16.178340 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 904/1817] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:35:16 2022] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:35:16.179234 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead3481e-a92e-4f05-aab4-c8a87ca9fd8a admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:16.225303 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 914/1818] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:35:15 2022] POST /identity/v3/projects => generated 379 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:35:16.227759 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e809dfdc-f7be-4066-a220-ff2803ed5e6f admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:16.317254 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:16.323139 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead3481e-a92e-4f05-aab4-c8a87ca9fd8a admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:16.387330 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e809dfdc-f7be-4066-a220-ff2803ed5e6f admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:16.398863 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe77e32e-6652-4c5a-b8ee-6258f2b293ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:16.400764 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77e32e-6652-4c5a-b8ee-6258f2b293ee admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:16.401595 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77e32e-6652-4c5a-b8ee-6258f2b293ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:16.402402 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77e32e-6652-4c5a-b8ee-6258f2b293ee admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:16.404699 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe77e32e-6652-4c5a-b8ee-6258f2b293ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:16.409985 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe77e32e-6652-4c5a-b8ee-6258f2b293ee admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:16.474083 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 915/1819] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:35:16 2022] POST /identity/v3/users => generated 290 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:35:16.477288 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf1638-36b1-4b07-8fa6-bf0105dd05d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:16.478001 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf1638-36b1-4b07-8fa6-bf0105dd05d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:16.478287 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf1638-36b1-4b07-8fa6-bf0105dd05d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:16.479003 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf1638-36b1-4b07-8fa6-bf0105dd05d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:16.479259 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaf1638-36b1-4b07-8fa6-bf0105dd05d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:16.481691 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaf1638-36b1-4b07-8fa6-bf0105dd05d8 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:16.486326 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe77e32e-6652-4c5a-b8ee-6258f2b293ee admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:16.506915 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe77e32e-6652-4c5a-b8ee-6258f2b293ee admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:16.509876 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:16.518525 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c707fbf-9274-484b-bc1c-97fb17f84ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:16.519832 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c707fbf-9274-484b-bc1c-97fb17f84ad7 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:16.520050 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c707fbf-9274-484b-bc1c-97fb17f84ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:16.520343 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c707fbf-9274-484b-bc1c-97fb17f84ad7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:16.522734 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c707fbf-9274-484b-bc1c-97fb17f84ad7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:16.525864 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c707fbf-9274-484b-bc1c-97fb17f84ad7 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:16.548450 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 916/1820] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:35:16.549549 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 905/1821] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:35:16 2022] POST /identity/v3/users => generated 292 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:35:16.550749 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf1638-36b1-4b07-8fa6-bf0105dd05d8 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:16.566278 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c292c-371d-4a8a-ace6-570957c74e1b None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:16.566481 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c292c-371d-4a8a-ace6-570957c74e1b None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:16.566766 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c292c-371d-4a8a-ace6-570957c74e1b None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:16.571478 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 917/1822] 10.222.0.16 () {54 vars in 921 bytes} [Thu May 26 12:35:16 2022] GET /identity => generated 270 bytes in 25 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:35:16.575039 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993c292c-371d-4a8a-ace6-570957c74e1b None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:16.584628 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf1638-36b1-4b07-8fa6-bf0105dd05d8 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:16.594925 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d217cab-704a-43d3-aa23-2a620bad195f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:16.595917 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d217cab-704a-43d3-aa23-2a620bad195f admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:16.596692 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d217cab-704a-43d3-aa23-2a620bad195f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:16.597595 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d217cab-704a-43d3-aa23-2a620bad195f admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:16.599208 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d217cab-704a-43d3-aa23-2a620bad195f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:16.601303 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d217cab-704a-43d3-aa23-2a620bad195f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:16.621711 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 906/1823] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:35:16.621943 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993c292c-371d-4a8a-ace6-570957c74e1b None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:16.628112 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d217cab-704a-43d3-aa23-2a620bad195f admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:16.637844 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d24a2f-b969-46c9-9969-57654551b1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:16.641519 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d24a2f-b969-46c9-9969-57654551b1f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:16.642059 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d24a2f-b969-46c9-9969-57654551b1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:16.642345 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d24a2f-b969-46c9-9969-57654551b1f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:16.644778 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d24a2f-b969-46c9-9969-57654551b1f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:16.649538 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d24a2f-b969-46c9-9969-57654551b1f1 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:16.663380 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d217cab-704a-43d3-aa23-2a620bad195f admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:16.681438 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc1b69-4e14-4298-ad6b-4f3c398cf8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:16.682578 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 918/1824] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:35:16.683369 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc1b69-4e14-4298-ad6b-4f3c398cf8f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:16.683681 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc1b69-4e14-4298-ad6b-4f3c398cf8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:16.683970 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc1b69-4e14-4298-ad6b-4f3c398cf8f0 admin admin] PATH_INFO: `/v3/projects/151f71db9aad4fd0a5523ceb992fa315/users/bf591456f4e14433815583c5084c4617/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:16.687206 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a2430-cafc-4d42-b786-9db6104e839d None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:16.687503 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a2430-cafc-4d42-b786-9db6104e839d None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:16.687793 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a2430-cafc-4d42-b786-9db6104e839d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:16.718712 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc1b69-4e14-4298-ad6b-4f3c398cf8f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=151f71db9aad4fd0a5523ceb992fa315, user_id=bf591456f4e14433815583c5084c4617, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:16.730230 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc1b69-4e14-4298-ad6b-4f3c398cf8f0 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:16.732447 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-f86a2430-cafc-4d42-b786-9db6104e839d None None] MFA Rules not processed for user `536f68ff77794352adf41aaacdc0645c`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:16.736136 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-f86a2430-cafc-4d42-b786-9db6104e839d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:16.770005 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 907/1825] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:35:16 2022] PUT /identity/v3/projects/151f71db9aad4fd0a5523ceb992fa315/users/bf591456f4e14433815583c5084c4617/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:16.773642 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc1b69-4e14-4298-ad6b-4f3c398cf8f0 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:16.898305 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 919/1826] 10.222.0.16 () {58 vars in 1018 bytes} [Thu May 26 12:35:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:16.900086 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9c7b3-9067-4f20-b5f4-d46259e61349 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:16.900385 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9c7b3-9067-4f20-b5f4-d46259e61349 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:16.900667 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9c7b3-9067-4f20-b5f4-d46259e61349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:16.957220 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc1b69-4e14-4298-ad6b-4f3c398cf8f0 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:16.973130 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe890e4b-63c6-4d9b-b2ef-79e2b7ae069a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:16.975914 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe890e4b-63c6-4d9b-b2ef-79e2b7ae069a admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:16.976041 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe890e4b-63c6-4d9b-b2ef-79e2b7ae069a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:16.976318 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe890e4b-63c6-4d9b-b2ef-79e2b7ae069a admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:16.977254 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe890e4b-63c6-4d9b-b2ef-79e2b7ae069a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:16.978925 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe890e4b-63c6-4d9b-b2ef-79e2b7ae069a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:16.984457 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-c4e9c7b3-9067-4f20-b5f4-d46259e61349 None None] MFA Rules not processed for user `bf591456f4e14433815583c5084c4617`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:16.988718 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-c4e9c7b3-9067-4f20-b5f4-d46259e61349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:17.006248 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 908/1827] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:35:17.017291 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe890e4b-63c6-4d9b-b2ef-79e2b7ae069a admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:17.053309 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe890e4b-63c6-4d9b-b2ef-79e2b7ae069a admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:17.071757 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79846b1a-127f-4831-a387-c2e0e5e69760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:17.073205 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79846b1a-127f-4831-a387-c2e0e5e69760 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:17.073609 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79846b1a-127f-4831-a387-c2e0e5e69760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:17.074038 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79846b1a-127f-4831-a387-c2e0e5e69760 admin admin] PATH_INFO: `/v3/projects/1c595dc44a224a3a974dbbc2797e4525/users/d95f12edb3e3478a82e6a048b918239e/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:17.116168 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79846b1a-127f-4831-a387-c2e0e5e69760 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c595dc44a224a3a974dbbc2797e4525, user_id=d95f12edb3e3478a82e6a048b918239e, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:17.121221 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79846b1a-127f-4831-a387-c2e0e5e69760 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:17.155131 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 909/1828] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:35:17 2022] PUT /identity/v3/projects/1c595dc44a224a3a974dbbc2797e4525/users/d95f12edb3e3478a82e6a048b918239e/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:17.167958 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867e0f2-2057-4f08-a6fd-0f8a5c338d4e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:17.168264 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867e0f2-2057-4f08-a6fd-0f8a5c338d4e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:17.168522 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867e0f2-2057-4f08-a6fd-0f8a5c338d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:17.198273 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 920/1829] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:17.202413 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e9c7b3-9067-4f20-b5f4-d46259e61349 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:17.209501 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-3867e0f2-2057-4f08-a6fd-0f8a5c338d4e None None] MFA Rules not processed for user `d95f12edb3e3478a82e6a048b918239e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:17.214442 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3867e0f2-2057-4f08-a6fd-0f8a5c338d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:17.228802 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e9c7b3-9067-4f20-b5f4-d46259e61349 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:17.264584 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:17.376790 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 910/1830] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:35:17.378110 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3867e0f2-2057-4f08-a6fd-0f8a5c338d4e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:17.384197 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3867e0f2-2057-4f08-a6fd-0f8a5c338d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:17.427255 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:17.447494 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a33cd1-e843-42d9-9f17-a0d6aa9dc6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:17.449363 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a33cd1-e843-42d9-9f17-a0d6aa9dc6e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:17.449657 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a33cd1-e843-42d9-9f17-a0d6aa9dc6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:17.450056 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a33cd1-e843-42d9-9f17-a0d6aa9dc6e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:17.450784 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a33cd1-e843-42d9-9f17-a0d6aa9dc6e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:17.456810 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a33cd1-e843-42d9-9f17-a0d6aa9dc6e7 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:17.526287 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 921/1831] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:35:17 2022] POST /identity/v3/projects => generated 377 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:35:17.527374 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a33cd1-e843-42d9-9f17-a0d6aa9dc6e7 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:17.562259 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3867e0f2-2057-4f08-a6fd-0f8a5c338d4e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:17.669359 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a33cd1-e843-42d9-9f17-a0d6aa9dc6e7 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:17.688275 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e3084-f373-4e9a-b226-8015c7fa71cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:17.689092 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e3084-f373-4e9a-b226-8015c7fa71cc admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:17.689451 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e3084-f373-4e9a-b226-8015c7fa71cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:17.689849 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e3084-f373-4e9a-b226-8015c7fa71cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:17.690934 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461e3084-f373-4e9a-b226-8015c7fa71cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:17.692766 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461e3084-f373-4e9a-b226-8015c7fa71cc admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:17.717347 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc9a4c2-eae0-48d0-a2ee-4c5c09988ffc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536f68ff77794352adf41aaacdc0645c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:17.719835 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9a4c2-eae0-48d0-a2ee-4c5c09988ffc service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:17.720294 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9a4c2-eae0-48d0-a2ee-4c5c09988ffc service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:17.720915 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9a4c2-eae0-48d0-a2ee-4c5c09988ffc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:17.741791 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc9a4c2-eae0-48d0-a2ee-4c5c09988ffc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:17.746277 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc9a4c2-eae0-48d0-a2ee-4c5c09988ffc service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:17.752179 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 922/1832] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:35:17 2022] POST /identity/v3/projects => generated 385 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:35:17.753716 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e3084-f373-4e9a-b226-8015c7fa71cc admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:17.772157 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 911/1833] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:35:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:35:17.773374 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc9a4c2-eae0-48d0-a2ee-4c5c09988ffc service nova] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:17.785524 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc9a4c2-eae0-48d0-a2ee-4c5c09988ffc service nova] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:17.878111 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e3084-f373-4e9a-b226-8015c7fa71cc admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:17.890145 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b881289f-57a6-4615-a96f-c64de459981f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:17.890852 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881289f-57a6-4615-a96f-c64de459981f admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:17.891146 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881289f-57a6-4615-a96f-c64de459981f admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:17.891650 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881289f-57a6-4615-a96f-c64de459981f admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:17.892288 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b881289f-57a6-4615-a96f-c64de459981f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:17.892607 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac692ba-a170-45a2-9539-afd9daab62f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:17.894110 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac692ba-a170-45a2-9539-afd9daab62f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:17.894477 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac692ba-a170-45a2-9539-afd9daab62f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:17.894674 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac692ba-a170-45a2-9539-afd9daab62f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:17.895317 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b881289f-57a6-4615-a96f-c64de459981f admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:17.895655 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac692ba-a170-45a2-9539-afd9daab62f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:17.899494 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac692ba-a170-45a2-9539-afd9daab62f7 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:17.926507 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 923/1834] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:35:17 2022] POST /identity/v3/users => generated 295 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:35:17.928697 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b881289f-57a6-4615-a96f-c64de459981f admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:17.953357 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 912/1835] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:35:17 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:35:17.956971 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b881289f-57a6-4615-a96f-c64de459981f admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:17.957742 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac692ba-a170-45a2-9539-afd9daab62f7 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:17.977612 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8769254-4810-4fbb-b01b-9c182efb8c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:17.978305 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8769254-4810-4fbb-b01b-9c182efb8c64 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:17.978591 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8769254-4810-4fbb-b01b-9c182efb8c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:17.978870 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8769254-4810-4fbb-b01b-9c182efb8c64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:17.979610 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8769254-4810-4fbb-b01b-9c182efb8c64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:17.983094 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac692ba-a170-45a2-9539-afd9daab62f7 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:17.983790 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8769254-4810-4fbb-b01b-9c182efb8c64 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:17.992791 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c0a088-f718-4ff5-bfc5-85abb6b18ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:17.994125 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0a088-f718-4ff5-bfc5-85abb6b18ce4 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:17.994622 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0a088-f718-4ff5-bfc5-85abb6b18ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:17.995302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0a088-f718-4ff5-bfc5-85abb6b18ce4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:17.996583 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c0a088-f718-4ff5-bfc5-85abb6b18ce4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:17.999212 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c0a088-f718-4ff5-bfc5-85abb6b18ce4 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:18.009228 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 924/1836] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:35:17 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:35:18.009948 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8769254-4810-4fbb-b01b-9c182efb8c64 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:18.021867 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 913/1837] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:35:17 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:35:18.027903 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c0a088-f718-4ff5-bfc5-85abb6b18ce4 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:18.038843 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8769254-4810-4fbb-b01b-9c182efb8c64 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:18.045766 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d7096-3376-4d39-8576-556c38adcd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:18.046982 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c0a088-f718-4ff5-bfc5-85abb6b18ce4 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:18.049594 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d7096-3376-4d39-8576-556c38adcd3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:18.055084 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d7096-3376-4d39-8576-556c38adcd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:18.055566 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d7096-3376-4d39-8576-556c38adcd3e admin admin] PATH_INFO: `/v3/projects/8960db1e5cee40018e3b2b3fc6338c40/users/df56f27314774c1fa8ad1f9e91d640ab/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:18.059198 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa1faa-b8b6-4ce2-9b7e-c99d62b61169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:18.060292 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa1faa-b8b6-4ce2-9b7e-c99d62b61169 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:18.061572 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa1faa-b8b6-4ce2-9b7e-c99d62b61169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:18.062768 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa1faa-b8b6-4ce2-9b7e-c99d62b61169 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:18.064096 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aa1faa-b8b6-4ce2-9b7e-c99d62b61169 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:18.067951 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:18.068935 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aa1faa-b8b6-4ce2-9b7e-c99d62b61169 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:18.090959 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 914/1838] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:35:18.092626 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa1faa-b8b6-4ce2-9b7e-c99d62b61169 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:18.093441 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3d7096-3376-4d39-8576-556c38adcd3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8960db1e5cee40018e3b2b3fc6338c40, user_id=df56f27314774c1fa8ad1f9e91d640ab, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:18.096584 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3d7096-3376-4d39-8576-556c38adcd3e admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:18.108136 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa1faa-b8b6-4ce2-9b7e-c99d62b61169 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:18.115899 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4b7c26-bc17-4e89-acef-def4650fa3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:18.117665 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b7c26-bc17-4e89-acef-def4650fa3a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:18.118315 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b7c26-bc17-4e89-acef-def4650fa3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:18.119120 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b7c26-bc17-4e89-acef-def4650fa3a2 admin admin] PATH_INFO: `/v3/projects/e6c45c1f918846a7a5eb289290bc59dd/users/e4038a07f5d04c858acaa0c6e58274d5/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:18.120030 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 925/1839] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:35:18 2022] PUT /identity/v3/projects/8960db1e5cee40018e3b2b3fc6338c40/users/df56f27314774c1fa8ad1f9e91d640ab/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:18.128965 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:18.131358 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d7096-3376-4d39-8576-556c38adcd3e admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:18.157990 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4b7c26-bc17-4e89-acef-def4650fa3a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6c45c1f918846a7a5eb289290bc59dd, user_id=e4038a07f5d04c858acaa0c6e58274d5, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:18.163501 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4b7c26-bc17-4e89-acef-def4650fa3a2 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:18.192897 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 915/1840] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:35:18 2022] PUT /identity/v3/projects/e6c45c1f918846a7a5eb289290bc59dd/users/e4038a07f5d04c858acaa0c6e58274d5/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:18.198163 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29c23b-7882-4c1f-8e57-c5da0796f217 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:18.198601 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29c23b-7882-4c1f-8e57-c5da0796f217 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:18.198975 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29c23b-7882-4c1f-8e57-c5da0796f217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:18.246663 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-3e29c23b-7882-4c1f-8e57-c5da0796f217 None None] MFA Rules not processed for user `e4038a07f5d04c858acaa0c6e58274d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:18.248726 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3e29c23b-7882-4c1f-8e57-c5da0796f217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:18.271015 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d7096-3376-4d39-8576-556c38adcd3e admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:18.355568 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 916/1841] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:18.361506 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e29c23b-7882-4c1f-8e57-c5da0796f217 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:18.445805 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f8866-88dd-4369-a251-f43f0d4f47d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:18.447001 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f8866-88dd-4369-a251-f43f0d4f47d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:18.447862 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f8866-88dd-4369-a251-f43f0d4f47d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:18.448151 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f8866-88dd-4369-a251-f43f0d4f47d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:18.452526 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7f8866-88dd-4369-a251-f43f0d4f47d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:18.455856 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7f8866-88dd-4369-a251-f43f0d4f47d3 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:18.481583 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 926/1842] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:35:18.481583 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f8866-88dd-4369-a251-f43f0d4f47d3 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:18.504467 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f8866-88dd-4369-a251-f43f0d4f47d3 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:18.516315 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb8687-2271-4413-916f-7df2b4a97448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:18.520755 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb8687-2271-4413-916f-7df2b4a97448 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:18.520755 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb8687-2271-4413-916f-7df2b4a97448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:18.520755 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb8687-2271-4413-916f-7df2b4a97448 admin admin] PATH_INFO: `/v3/projects/8960db1e5cee40018e3b2b3fc6338c40/users/df56f27314774c1fa8ad1f9e91d640ab/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:18.521810 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bb8687-2271-4413-916f-7df2b4a97448 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8960db1e5cee40018e3b2b3fc6338c40, user_id=df56f27314774c1fa8ad1f9e91d640ab, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:18.521949 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e29c23b-7882-4c1f-8e57-c5da0796f217 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:18.527463 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bb8687-2271-4413-916f-7df2b4a97448 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:18.531567 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a3bfe-1f84-485b-9dc0-d76de95a9c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:18.533212 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a3bfe-1f84-485b-9dc0-d76de95a9c40 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:18.533576 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a3bfe-1f84-485b-9dc0-d76de95a9c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:18.534621 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a3bfe-1f84-485b-9dc0-d76de95a9c40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:18.535464 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9a3bfe-1f84-485b-9dc0-d76de95a9c40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:18.538882 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9a3bfe-1f84-485b-9dc0-d76de95a9c40 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:18.553597 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 927/1843] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:35:18 2022] PUT /identity/v3/projects/8960db1e5cee40018e3b2b3fc6338c40/users/df56f27314774c1fa8ad1f9e91d640ab/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:18.564718 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee1f90-6b1e-44ee-8cb1-8d93dc22b472 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:18.565385 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee1f90-6b1e-44ee-8cb1-8d93dc22b472 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:18.566152 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee1f90-6b1e-44ee-8cb1-8d93dc22b472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:18.595068 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 917/1844] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:35:18 2022] POST /identity/v3/projects => generated 385 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:35:18.599949 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a3bfe-1f84-485b-9dc0-d76de95a9c40 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:18.729252 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-c0ee1f90-6b1e-44ee-8cb1-8d93dc22b472 None None] MFA Rules not processed for user `df56f27314774c1fa8ad1f9e91d640ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:18.741300 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-c0ee1f90-6b1e-44ee-8cb1-8d93dc22b472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:18.854316 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a3bfe-1f84-485b-9dc0-d76de95a9c40 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:18.879353 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04fb004-b0b6-4154-a9d2-902f99c5b21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:18.880361 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04fb004-b0b6-4154-a9d2-902f99c5b21b admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:18.880706 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04fb004-b0b6-4154-a9d2-902f99c5b21b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:18.881203 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04fb004-b0b6-4154-a9d2-902f99c5b21b admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:18.882199 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04fb004-b0b6-4154-a9d2-902f99c5b21b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:18.892615 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04fb004-b0b6-4154-a9d2-902f99c5b21b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:18.923130 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:18.959444 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:18.972527 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 918/1845] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:35:18 2022] POST /identity/v3/users => generated 299 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:35:18.977487 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04fb004-b0b6-4154-a9d2-902f99c5b21b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:18.980417 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 928/1846] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:18 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:18.993874 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee1f90-6b1e-44ee-8cb1-8d93dc22b472 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:18.996039 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-c0ee1f90-6b1e-44ee-8cb1-8d93dc22b472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:19.024771 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04fb004-b0b6-4154-a9d2-902f99c5b21b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:19.049553 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8e503-a8bb-40b8-9aae-c915bd180c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:19.050403 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8e503-a8bb-40b8-9aae-c915bd180c17 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:19.050858 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8e503-a8bb-40b8-9aae-c915bd180c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:19.051243 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8e503-a8bb-40b8-9aae-c915bd180c17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:19.055364 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf8e503-a8bb-40b8-9aae-c915bd180c17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:19.061506 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf8e503-a8bb-40b8-9aae-c915bd180c17 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:19.132528 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 919/1847] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:35:19.140220 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8e503-a8bb-40b8-9aae-c915bd180c17 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:19.188983 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8e503-a8bb-40b8-9aae-c915bd180c17 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:19.205541 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74653fd6-2a67-4e16-8ab9-afdcb9c835d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:19.213911 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74653fd6-2a67-4e16-8ab9-afdcb9c835d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:19.214184 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74653fd6-2a67-4e16-8ab9-afdcb9c835d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:19.214473 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74653fd6-2a67-4e16-8ab9-afdcb9c835d2 admin admin] PATH_INFO: `/v3/projects/a3e885fa1af4460d8c644db14c291027/users/669e3bcaa0b54c019c006810f0256cfc/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:19.246689 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee1f90-6b1e-44ee-8cb1-8d93dc22b472 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:19.254432 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e94ec-0b99-4bbd-99aa-2ea373d6e285 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:19.255101 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e94ec-0b99-4bbd-99aa-2ea373d6e285 service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:19.255387 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e94ec-0b99-4bbd-99aa-2ea373d6e285 service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:19.255667 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e94ec-0b99-4bbd-99aa-2ea373d6e285 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:19.260022 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74653fd6-2a67-4e16-8ab9-afdcb9c835d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3e885fa1af4460d8c644db14c291027, user_id=669e3bcaa0b54c019c006810f0256cfc, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:19.265428 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74653fd6-2a67-4e16-8ab9-afdcb9c835d2 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:19.280143 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6e94ec-0b99-4bbd-99aa-2ea373d6e285 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:19.284119 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6e94ec-0b99-4bbd-99aa-2ea373d6e285 service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:19.291728 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 920/1848] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:35:19 2022] PUT /identity/v3/projects/a3e885fa1af4460d8c644db14c291027/users/669e3bcaa0b54c019c006810f0256cfc/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:19.295522 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74653fd6-2a67-4e16-8ab9-afdcb9c835d2 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:19.316665 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 929/1849] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:35:18 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:35:19.371687 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e94ec-0b99-4bbd-99aa-2ea373d6e285 service cinder] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:19.381335 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e94ec-0b99-4bbd-99aa-2ea373d6e285 service cinder] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:19.425526 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74653fd6-2a67-4e16-8ab9-afdcb9c835d2 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:19.441444 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67994348-8ea8-45d1-8140-69ecc233b2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:19.442454 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67994348-8ea8-45d1-8140-69ecc233b2ed admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:19.442803 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67994348-8ea8-45d1-8140-69ecc233b2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:19.443085 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67994348-8ea8-45d1-8140-69ecc233b2ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:19.446884 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67994348-8ea8-45d1-8140-69ecc233b2ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:19.450364 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67994348-8ea8-45d1-8140-69ecc233b2ed admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:19.477560 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 921/1850] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:35:19 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:35:19.480603 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593c7cc7-cd49-478c-a0ba-1f5de07c89e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:19.481681 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67994348-8ea8-45d1-8140-69ecc233b2ed admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:19.484291 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c7cc7-cd49-478c-a0ba-1f5de07c89e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:19.484291 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c7cc7-cd49-478c-a0ba-1f5de07c89e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:19.484291 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c7cc7-cd49-478c-a0ba-1f5de07c89e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:19.506215 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67994348-8ea8-45d1-8140-69ecc233b2ed admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:19.517652 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628bd526-4238-40fe-ab12-4fd19a5af95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:19.518518 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628bd526-4238-40fe-ab12-4fd19a5af95f admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:19.519284 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628bd526-4238-40fe-ab12-4fd19a5af95f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:19.519284 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628bd526-4238-40fe-ab12-4fd19a5af95f admin admin] PATH_INFO: `/v3/projects/a3e885fa1af4460d8c644db14c291027/users/669e3bcaa0b54c019c006810f0256cfc/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:19.527925 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628bd526-4238-40fe-ab12-4fd19a5af95f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3e885fa1af4460d8c644db14c291027, user_id=669e3bcaa0b54c019c006810f0256cfc, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:19.537102 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628bd526-4238-40fe-ab12-4fd19a5af95f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:19.565767 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 922/1851] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:35:19 2022] PUT /identity/v3/projects/a3e885fa1af4460d8c644db14c291027/users/669e3bcaa0b54c019c006810f0256cfc/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:19.574897 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce49c5a-b148-4dd9-8944-30afa3732641 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:19.575256 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce49c5a-b148-4dd9-8944-30afa3732641 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:19.575553 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce49c5a-b148-4dd9-8944-30afa3732641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:19.616779 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593c7cc7-cd49-478c-a0ba-1f5de07c89e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:19.618735 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593c7cc7-cd49-478c-a0ba-1f5de07c89e6 service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:19.657960 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 930/1852] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:35:19 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:35:19.671044 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-5ce49c5a-b148-4dd9-8944-30afa3732641 None None] MFA Rules not processed for user `669e3bcaa0b54c019c006810f0256cfc`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:19.674241 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5ce49c5a-b148-4dd9-8944-30afa3732641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:19.861958 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 923/1853] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:19 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:35:19.902647 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593c7cc7-cd49-478c-a0ba-1f5de07c89e6 service cinder] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:19.906815 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-593c7cc7-cd49-478c-a0ba-1f5de07c89e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:19.922262 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593c7cc7-cd49-478c-a0ba-1f5de07c89e6 service cinder] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:20.041224 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4644d3-e4ed-4b8e-be58-1f6c303e2a27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:20.041994 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4644d3-e4ed-4b8e-be58-1f6c303e2a27 service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:20.042176 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4644d3-e4ed-4b8e-be58-1f6c303e2a27 service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:20.042454 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4644d3-e4ed-4b8e-be58-1f6c303e2a27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:20.076233 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:20.203041 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4644d3-e4ed-4b8e-be58-1f6c303e2a27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:20.205620 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4644d3-e4ed-4b8e-be58-1f6c303e2a27 service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:20.221820 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 931/1854] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:35:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:35:20.549665 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89025814-0621-47f1-886d-620a1fe98c2b None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:20.549956 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89025814-0621-47f1-886d-620a1fe98c2b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:20.550236 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89025814-0621-47f1-886d-620a1fe98c2b None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:20.551813 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 924/1855] 10.222.0.16 () {54 vars in 921 bytes} [Thu May 26 12:35:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:35:20.576900 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cbc314-cdf9-4d4a-b263-2bfb9ebe2705 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:20.578313 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cbc314-cdf9-4d4a-b263-2bfb9ebe2705 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:20.578787 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cbc314-cdf9-4d4a-b263-2bfb9ebe2705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:20.629943 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-b3cbc314-cdf9-4d4a-b263-2bfb9ebe2705 None None] MFA Rules not processed for user `536f68ff77794352adf41aaacdc0645c`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:20.639944 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-b3cbc314-cdf9-4d4a-b263-2bfb9ebe2705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:20.799128 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 932/1856] 10.222.0.16 () {58 vars in 1018 bytes} [Thu May 26 12:35:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:20.813902 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89025814-0621-47f1-886d-620a1fe98c2b None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:20.815714 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-89025814-0621-47f1-886d-620a1fe98c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:20.836365 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89025814-0621-47f1-886d-620a1fe98c2b None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:20.845164 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef194b72-2967-4fd9-89a4-9a8027187d62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536f68ff77794352adf41aaacdc0645c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:20.846017 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef194b72-2967-4fd9-89a4-9a8027187d62 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:20.846307 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef194b72-2967-4fd9-89a4-9a8027187d62 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:20.846586 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef194b72-2967-4fd9-89a4-9a8027187d62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:20.866981 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef194b72-2967-4fd9-89a4-9a8027187d62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:20.869406 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef194b72-2967-4fd9-89a4-9a8027187d62 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:20.883924 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 925/1857] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:35:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:35:21.922325 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cbc314-cdf9-4d4a-b263-2bfb9ebe2705 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:21.931879 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cbc314-cdf9-4d4a-b263-2bfb9ebe2705 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:21.935951 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed43b88-0bb2-4b97-abe0-d99fb961ea28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:21.936647 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed43b88-0bb2-4b97-abe0-d99fb961ea28 service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:21.936961 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed43b88-0bb2-4b97-abe0-d99fb961ea28 service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:21.937232 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed43b88-0bb2-4b97-abe0-d99fb961ea28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:21.998098 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed43b88-0bb2-4b97-abe0-d99fb961ea28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:21.999511 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed43b88-0bb2-4b97-abe0-d99fb961ea28 service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:22.008592 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 933/1858] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:35:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:35:22.721349 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef194b72-2967-4fd9-89a4-9a8027187d62 service nova] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:22.731804 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef194b72-2967-4fd9-89a4-9a8027187d62 service nova] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:22.737112 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd73a559-cc8a-49b6-8c69-846146d78395 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:22.738190 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd73a559-cc8a-49b6-8c69-846146d78395 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:22.738552 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd73a559-cc8a-49b6-8c69-846146d78395 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:22.739043 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd73a559-cc8a-49b6-8c69-846146d78395 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:22.750091 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd73a559-cc8a-49b6-8c69-846146d78395 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:22.751812 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd73a559-cc8a-49b6-8c69-846146d78395 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:22.757356 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:22.777362 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 926/1859] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:35:22 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:35:23.038522 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed43b88-0bb2-4b97-abe0-d99fb961ea28 service cinder] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:23.084263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:23.103050 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed43b88-0bb2-4b97-abe0-d99fb961ea28 service cinder] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:23.107522 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9735af7e-9b3a-4c36-b53c-0029cca5fdf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:23.108786 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735af7e-9b3a-4c36-b53c-0029cca5fdf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:23.109110 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735af7e-9b3a-4c36-b53c-0029cca5fdf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:23.109416 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735af7e-9b3a-4c36-b53c-0029cca5fdf7 admin admin] PATH_INFO: `/v3/users/0cc14a3ef9954e85b6b84234fbb223ac` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:23.110626 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9735af7e-9b3a-4c36-b53c-0029cca5fdf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cc14a3ef9954e85b6b84234fbb223ac)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:23.112777 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9735af7e-9b3a-4c36-b53c-0029cca5fdf7 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:23.163859 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-9735af7e-9b3a-4c36-b53c-0029cca5fdf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cc14a3ef9954e85b6b84234fbb223ac'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:23.164512 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-9735af7e-9b3a-4c36-b53c-0029cca5fdf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cc14a3ef9954e85b6b84234fbb223ac'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:23.165142 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-9735af7e-9b3a-4c36-b53c-0029cca5fdf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cc14a3ef9954e85b6b84234fbb223ac'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:23.173439 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-9735af7e-9b3a-4c36-b53c-0029cca5fdf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cc14a3ef9954e85b6b84234fbb223ac'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:23.186018 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-9735af7e-9b3a-4c36-b53c-0029cca5fdf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cc14a3ef9954e85b6b84234fbb223ac'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:23.199753 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 934/1860] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:35:23 2022] DELETE /identity/v3/users/0cc14a3ef9954e85b6b84234fbb223ac => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:23.204720 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd976e-6ff5-49d4-a236-3aa5585f50a1 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:23.205047 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd976e-6ff5-49d4-a236-3aa5585f50a1 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:23.205335 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd976e-6ff5-49d4-a236-3aa5585f50a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:23.223710 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-6ddd976e-6ff5-49d4-a236-3aa5585f50a1 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:23.224984 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6ddd976e-6ff5-49d4-a236-3aa5585f50a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:23.292110 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 927/1861] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:23.309234 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9735af7e-9b3a-4c36-b53c-0029cca5fdf7 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:23.311072 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-9735af7e-9b3a-4c36-b53c-0029cca5fdf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:23.373173 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9735af7e-9b3a-4c36-b53c-0029cca5fdf7 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:23.377120 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e795b7-dee0-49a4-b646-b7bb4a9d0e07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:23.377776 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e795b7-dee0-49a4-b646-b7bb4a9d0e07 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:23.378058 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e795b7-dee0-49a4-b646-b7bb4a9d0e07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:23.378357 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e795b7-dee0-49a4-b646-b7bb4a9d0e07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:23.387874 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e795b7-dee0-49a4-b646-b7bb4a9d0e07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:23.389360 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e795b7-dee0-49a4-b646-b7bb4a9d0e07 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:23.399573 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 935/1862] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:35:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:35:23.770623 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd976e-6ff5-49d4-a236-3aa5585f50a1 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:23.772093 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6ddd976e-6ff5-49d4-a236-3aa5585f50a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:23.789756 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd976e-6ff5-49d4-a236-3aa5585f50a1 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:23.801613 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e1123-bc6f-496e-adc6-7b60468e7060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:23.802853 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e1123-bc6f-496e-adc6-7b60468e7060 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:23.803260 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e1123-bc6f-496e-adc6-7b60468e7060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:23.803741 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e1123-bc6f-496e-adc6-7b60468e7060 admin admin] PATH_INFO: `/v3/projects/f5ffb487023a4350b57ae81eb6b26e4e` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:23.805063 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e1123-bc6f-496e-adc6-7b60468e7060 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5ffb487023a4350b57ae81eb6b26e4e)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:23.807380 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e1123-bc6f-496e-adc6-7b60468e7060 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:23.867656 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f55e1123-bc6f-496e-adc6-7b60468e7060 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5ffb487023a4350b57ae81eb6b26e4e', 'request_id': 'req-f55e1123-bc6f-496e-adc6-7b60468e7060'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:23.881551 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f55e1123-bc6f-496e-adc6-7b60468e7060 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5ffb487023a4350b57ae81eb6b26e4e', 'request_id': 'req-f55e1123-bc6f-496e-adc6-7b60468e7060'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:23.891939 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f55e1123-bc6f-496e-adc6-7b60468e7060 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5ffb487023a4350b57ae81eb6b26e4e', 'request_id': 'req-f55e1123-bc6f-496e-adc6-7b60468e7060'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:23.909539 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f55e1123-bc6f-496e-adc6-7b60468e7060 admin admin] The token cache is being invalidate because project f5ffb487023a4350b57ae81eb6b26e4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:35:23.910847 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f55e1123-bc6f-496e-adc6-7b60468e7060 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:23.911639 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f55e1123-bc6f-496e-adc6-7b60468e7060 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:23.914390 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 928/1863] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:35:23 2022] DELETE /identity/v3/projects/f5ffb487023a4350b57ae81eb6b26e4e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:23.918381 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e795b7-dee0-49a4-b646-b7bb4a9d0e07 service neutron] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:23.939012 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e795b7-dee0-49a4-b646-b7bb4a9d0e07 service neutron] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:24.067018 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30564f52-6f17-47d0-b723-51bf1961f772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:24.068996 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30564f52-6f17-47d0-b723-51bf1961f772 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:24.071795 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30564f52-6f17-47d0-b723-51bf1961f772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:24.072087 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30564f52-6f17-47d0-b723-51bf1961f772 admin admin] PATH_INFO: `/v3/users/bf591456f4e14433815583c5084c4617` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:24.073447 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30564f52-6f17-47d0-b723-51bf1961f772 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf591456f4e14433815583c5084c4617)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:24.075665 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30564f52-6f17-47d0-b723-51bf1961f772 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:24.083341 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:24.161025 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-30564f52-6f17-47d0-b723-51bf1961f772 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf591456f4e14433815583c5084c4617'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:24.161722 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-30564f52-6f17-47d0-b723-51bf1961f772 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf591456f4e14433815583c5084c4617'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:24.162480 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-30564f52-6f17-47d0-b723-51bf1961f772 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf591456f4e14433815583c5084c4617'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:24.170952 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-30564f52-6f17-47d0-b723-51bf1961f772 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf591456f4e14433815583c5084c4617'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:24.185740 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-30564f52-6f17-47d0-b723-51bf1961f772 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf591456f4e14433815583c5084c4617'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:24.204879 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 936/1864] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:35:23 2022] DELETE /identity/v3/users/bf591456f4e14433815583c5084c4617 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:24.506132 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e1123-bc6f-496e-adc6-7b60468e7060 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:24.507563 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f55e1123-bc6f-496e-adc6-7b60468e7060 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:24.524971 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e1123-bc6f-496e-adc6-7b60468e7060 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:24.581532 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93890550-bc29-46f9-b4c1-2671630b5008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:24.582327 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93890550-bc29-46f9-b4c1-2671630b5008 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:24.583046 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93890550-bc29-46f9-b4c1-2671630b5008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:24.583046 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93890550-bc29-46f9-b4c1-2671630b5008 admin admin] PATH_INFO: `/v3/projects/151f71db9aad4fd0a5523ceb992fa315` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:24.584042 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93890550-bc29-46f9-b4c1-2671630b5008 admin admin] RBAC: Authorizing `identity:delete_project(project_id=151f71db9aad4fd0a5523ceb992fa315)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:24.585997 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93890550-bc29-46f9-b4c1-2671630b5008 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:24.609786 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:24.642667 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-93890550-bc29-46f9-b4c1-2671630b5008 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '151f71db9aad4fd0a5523ceb992fa315', 'request_id': 'req-93890550-bc29-46f9-b4c1-2671630b5008'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:24.650875 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-93890550-bc29-46f9-b4c1-2671630b5008 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '151f71db9aad4fd0a5523ceb992fa315', 'request_id': 'req-93890550-bc29-46f9-b4c1-2671630b5008'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:24.657450 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-93890550-bc29-46f9-b4c1-2671630b5008 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '151f71db9aad4fd0a5523ceb992fa315', 'request_id': 'req-93890550-bc29-46f9-b4c1-2671630b5008'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:24.676465 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-93890550-bc29-46f9-b4c1-2671630b5008 admin admin] The token cache is being invalidate because project 151f71db9aad4fd0a5523ceb992fa315 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:35:24.676797 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-93890550-bc29-46f9-b4c1-2671630b5008 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:24.677615 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-93890550-bc29-46f9-b4c1-2671630b5008 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:24.679447 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 929/1865] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:35:24 2022] DELETE /identity/v3/projects/151f71db9aad4fd0a5523ceb992fa315 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:24.683400 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30564f52-6f17-47d0-b723-51bf1961f772 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:24.685339 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-30564f52-6f17-47d0-b723-51bf1961f772 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:24.699418 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30564f52-6f17-47d0-b723-51bf1961f772 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:24.771816 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368150c1-da11-41ed-8ba7-e448f5d01d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:24.772695 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368150c1-da11-41ed-8ba7-e448f5d01d86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:24.773010 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368150c1-da11-41ed-8ba7-e448f5d01d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:24.773288 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368150c1-da11-41ed-8ba7-e448f5d01d86 admin admin] PATH_INFO: `/v3/users/df56f27314774c1fa8ad1f9e91d640ab` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:24.774480 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368150c1-da11-41ed-8ba7-e448f5d01d86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df56f27314774c1fa8ad1f9e91d640ab)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:24.776404 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368150c1-da11-41ed-8ba7-e448f5d01d86 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:24.828330 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-368150c1-da11-41ed-8ba7-e448f5d01d86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df56f27314774c1fa8ad1f9e91d640ab'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:24.829039 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-368150c1-da11-41ed-8ba7-e448f5d01d86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df56f27314774c1fa8ad1f9e91d640ab'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:24.829644 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-368150c1-da11-41ed-8ba7-e448f5d01d86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df56f27314774c1fa8ad1f9e91d640ab'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:24.837503 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-368150c1-da11-41ed-8ba7-e448f5d01d86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df56f27314774c1fa8ad1f9e91d640ab'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:24.852379 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-368150c1-da11-41ed-8ba7-e448f5d01d86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df56f27314774c1fa8ad1f9e91d640ab'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:24.867875 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 937/1866] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:35:24 2022] DELETE /identity/v3/users/df56f27314774c1fa8ad1f9e91d640ab => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:25.234132 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93890550-bc29-46f9-b4c1-2671630b5008 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:25.236502 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-93890550-bc29-46f9-b4c1-2671630b5008 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:25.259646 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93890550-bc29-46f9-b4c1-2671630b5008 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:25.339111 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff5eec5-e105-47af-bce9-e6a91aecd1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:25.340303 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff5eec5-e105-47af-bce9-e6a91aecd1fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:25.340659 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff5eec5-e105-47af-bce9-e6a91aecd1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:25.341142 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff5eec5-e105-47af-bce9-e6a91aecd1fa admin admin] PATH_INFO: `/v3/projects/8960db1e5cee40018e3b2b3fc6338c40` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:25.342580 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff5eec5-e105-47af-bce9-e6a91aecd1fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=8960db1e5cee40018e3b2b3fc6338c40)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:25.344806 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff5eec5-e105-47af-bce9-e6a91aecd1fa admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:25.412018 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9ff5eec5-e105-47af-bce9-e6a91aecd1fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8960db1e5cee40018e3b2b3fc6338c40', 'request_id': 'req-9ff5eec5-e105-47af-bce9-e6a91aecd1fa'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:25.431123 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9ff5eec5-e105-47af-bce9-e6a91aecd1fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8960db1e5cee40018e3b2b3fc6338c40', 'request_id': 'req-9ff5eec5-e105-47af-bce9-e6a91aecd1fa'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:25.441798 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9ff5eec5-e105-47af-bce9-e6a91aecd1fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8960db1e5cee40018e3b2b3fc6338c40', 'request_id': 'req-9ff5eec5-e105-47af-bce9-e6a91aecd1fa'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:25.459574 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9ff5eec5-e105-47af-bce9-e6a91aecd1fa admin admin] The token cache is being invalidate because project 8960db1e5cee40018e3b2b3fc6338c40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:35:25.459871 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9ff5eec5-e105-47af-bce9-e6a91aecd1fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:25.460557 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9ff5eec5-e105-47af-bce9-e6a91aecd1fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:25.464913 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 930/1867] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:35:25 2022] DELETE /identity/v3/projects/8960db1e5cee40018e3b2b3fc6338c40 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:25.469817 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946677e8-b9bd-4224-8b0d-664d69900513 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:25.470355 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946677e8-b9bd-4224-8b0d-664d69900513 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:25.471068 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946677e8-b9bd-4224-8b0d-664d69900513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:25.478343 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:25.500775 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-946677e8-b9bd-4224-8b0d-664d69900513 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:25.502961 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-946677e8-b9bd-4224-8b0d-664d69900513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:25.588154 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 938/1868] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:35:25.598129 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd38bed0-b665-493d-b6bc-3f00796c0eb7 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:25.598419 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd38bed0-b665-493d-b6bc-3f00796c0eb7 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:25.598724 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd38bed0-b665-493d-b6bc-3f00796c0eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:25.626915 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-fd38bed0-b665-493d-b6bc-3f00796c0eb7 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:25.628265 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-fd38bed0-b665-493d-b6bc-3f00796c0eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:25.637151 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 931/1869] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:25.641067 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946677e8-b9bd-4224-8b0d-664d69900513 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:25.652348 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946677e8-b9bd-4224-8b0d-664d69900513 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:25.657760 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f8cdfb-2488-4bd8-a4ca-327443ac94b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:25.658573 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f8cdfb-2488-4bd8-a4ca-327443ac94b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:25.658935 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f8cdfb-2488-4bd8-a4ca-327443ac94b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:25.659278 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f8cdfb-2488-4bd8-a4ca-327443ac94b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:25.660112 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f8cdfb-2488-4bd8-a4ca-327443ac94b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:35:25.660486 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f8cdfb-2488-4bd8-a4ca-327443ac94b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:25.662439 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f8cdfb-2488-4bd8-a4ca-327443ac94b7 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:25.694471 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 939/1870] 10.222.0.16 () {58 vars in 1152 bytes} [Thu May 26 12:35:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:35:25.699758 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd38bed0-b665-493d-b6bc-3f00796c0eb7 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:25.718646 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd38bed0-b665-493d-b6bc-3f00796c0eb7 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:25.725352 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53557bd9-dcbb-419c-877b-c59254b6066b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:25.726823 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53557bd9-dcbb-419c-877b-c59254b6066b admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:25.727744 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53557bd9-dcbb-419c-877b-c59254b6066b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:25.728188 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53557bd9-dcbb-419c-877b-c59254b6066b admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:25.729890 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53557bd9-dcbb-419c-877b-c59254b6066b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:25.732941 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53557bd9-dcbb-419c-877b-c59254b6066b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:25.784468 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 932/1871] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:35:25 2022] POST /identity/v3/projects => generated 387 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:35:25.785697 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f8cdfb-2488-4bd8-a4ca-327443ac94b7 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:25.799951 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f8cdfb-2488-4bd8-a4ca-327443ac94b7 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:25.900160 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce64d7b-dd94-4eb7-a1d1-64853c828570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:25.900945 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce64d7b-dd94-4eb7-a1d1-64853c828570 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:25.901286 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce64d7b-dd94-4eb7-a1d1-64853c828570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:25.901571 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce64d7b-dd94-4eb7-a1d1-64853c828570 admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:25.902677 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce64d7b-dd94-4eb7-a1d1-64853c828570 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:25.904941 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce64d7b-dd94-4eb7-a1d1-64853c828570 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:25.934233 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 940/1872] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:35:25 2022] POST /identity/v3/users => generated 294 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:35:25.943278 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53557bd9-dcbb-419c-877b-c59254b6066b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:25.960553 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53557bd9-dcbb-419c-877b-c59254b6066b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:25.969264 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c9051-faef-495c-a2a9-7f2171daf885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:25.970839 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c9051-faef-495c-a2a9-7f2171daf885 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:25.970839 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c9051-faef-495c-a2a9-7f2171daf885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:25.970839 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c9051-faef-495c-a2a9-7f2171daf885 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:25.971574 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4c9051-faef-495c-a2a9-7f2171daf885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:25.973547 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4c9051-faef-495c-a2a9-7f2171daf885 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:25.981039 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:25.994478 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 933/1873] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:35:25.995804 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce64d7b-dd94-4eb7-a1d1-64853c828570 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:26.012078 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce64d7b-dd94-4eb7-a1d1-64853c828570 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:26.018092 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a528e7-22f7-4ff9-ba75-5fa859e7ff7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:26.018818 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a528e7-22f7-4ff9-ba75-5fa859e7ff7f admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:26.019390 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a528e7-22f7-4ff9-ba75-5fa859e7ff7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:26.019524 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a528e7-22f7-4ff9-ba75-5fa859e7ff7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:26.020751 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a528e7-22f7-4ff9-ba75-5fa859e7ff7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:26.022653 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a528e7-22f7-4ff9-ba75-5fa859e7ff7f admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:26.040398 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 941/1874] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:35:26.042729 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c9051-faef-495c-a2a9-7f2171daf885 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:26.066975 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c9051-faef-495c-a2a9-7f2171daf885 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:26.069500 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d7c34e-91d1-4158-a1c7-21247d4eb1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:26.070660 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7c34e-91d1-4158-a1c7-21247d4eb1f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:26.070948 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7c34e-91d1-4158-a1c7-21247d4eb1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:26.071380 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7c34e-91d1-4158-a1c7-21247d4eb1f1 admin admin] PATH_INFO: `/v3/projects/c315d84953fa46768a04ce4e24d6fd88/users/4ca3ed09a70e4bba9cd81f39d6f38c6a/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:26.094401 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d7c34e-91d1-4158-a1c7-21247d4eb1f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c315d84953fa46768a04ce4e24d6fd88, user_id=4ca3ed09a70e4bba9cd81f39d6f38c6a, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:26.099078 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d7c34e-91d1-4158-a1c7-21247d4eb1f1 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:26.122945 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 934/1875] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:35:26 2022] PUT /identity/v3/projects/c315d84953fa46768a04ce4e24d6fd88/users/4ca3ed09a70e4bba9cd81f39d6f38c6a/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:35:26.134085 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b9ae6-e7e0-446e-80fb-90da6197ff03 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:26.134413 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b9ae6-e7e0-446e-80fb-90da6197ff03 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:26.134749 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b9ae6-e7e0-446e-80fb-90da6197ff03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:26.174489 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-327b9ae6-e7e0-446e-80fb-90da6197ff03 None None] MFA Rules not processed for user `4ca3ed09a70e4bba9cd81f39d6f38c6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:26.175706 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-327b9ae6-e7e0-446e-80fb-90da6197ff03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:26.258051 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:26.267558 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d7c34e-91d1-4158-a1c7-21247d4eb1f1 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:26.279549 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 942/1876] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:26.357425 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d7c34e-91d1-4158-a1c7-21247d4eb1f1 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:26.364259 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a26c2-a023-416f-b654-160ed042afaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:26.365121 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a26c2-a023-416f-b654-160ed042afaf admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:26.365533 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a26c2-a023-416f-b654-160ed042afaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:26.365811 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a26c2-a023-416f-b654-160ed042afaf admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:26.366498 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1a26c2-a023-416f-b654-160ed042afaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:26.368423 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1a26c2-a023-416f-b654-160ed042afaf admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:26.407923 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 935/1877] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:35:26 2022] POST /identity/v3/projects => generated 385 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:35:26.412157 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b9ae6-e7e0-446e-80fb-90da6197ff03 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:26.429899 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b9ae6-e7e0-446e-80fb-90da6197ff03 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:26.635155 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7dbff2-527f-4fa5-81bb-f776b7c998b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:26.635848 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7dbff2-527f-4fa5-81bb-f776b7c998b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:26.635848 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7dbff2-527f-4fa5-81bb-f776b7c998b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:26.636553 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7dbff2-527f-4fa5-81bb-f776b7c998b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:26.636872 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7dbff2-527f-4fa5-81bb-f776b7c998b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:26.638841 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7dbff2-527f-4fa5-81bb-f776b7c998b2 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:26.701993 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a26c2-a023-416f-b654-160ed042afaf admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:26.704966 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 943/1878] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:35:26 2022] POST /identity/v3/users => generated 299 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:35:26.715170 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a26c2-a023-416f-b654-160ed042afaf admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:26.725468 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d54efa-2ecb-470e-bbfa-1ca37bbd67cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:26.726298 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d54efa-2ecb-470e-bbfa-1ca37bbd67cf admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:26.726667 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d54efa-2ecb-470e-bbfa-1ca37bbd67cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:26.726951 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d54efa-2ecb-470e-bbfa-1ca37bbd67cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:26.727738 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d54efa-2ecb-470e-bbfa-1ca37bbd67cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:26.736766 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d54efa-2ecb-470e-bbfa-1ca37bbd67cf admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:26.758762 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 936/1879] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:35:26 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:35:26.760109 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7dbff2-527f-4fa5-81bb-f776b7c998b2 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:26.776701 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7dbff2-527f-4fa5-81bb-f776b7c998b2 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:26.795484 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d123316-51e7-4679-b539-ee3d6c796f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:26.796755 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d123316-51e7-4679-b539-ee3d6c796f2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:26.798298 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d123316-51e7-4679-b539-ee3d6c796f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:26.798603 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d123316-51e7-4679-b539-ee3d6c796f2d admin admin] PATH_INFO: `/v3/projects/684796dbe7ad45ce87075644c5747c27/users/92ea6303f36045349bb8db3af389cb28/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:26.820931 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d123316-51e7-4679-b539-ee3d6c796f2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=684796dbe7ad45ce87075644c5747c27, user_id=92ea6303f36045349bb8db3af389cb28, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:26.824762 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d123316-51e7-4679-b539-ee3d6c796f2d admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:26.856773 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 944/1880] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:35:26 2022] PUT /identity/v3/projects/684796dbe7ad45ce87075644c5747c27/users/92ea6303f36045349bb8db3af389cb28/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:26.860427 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d54efa-2ecb-470e-bbfa-1ca37bbd67cf admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:26.873829 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d54efa-2ecb-470e-bbfa-1ca37bbd67cf admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:26.952825 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a772e1-aef8-4bf3-9251-87797803e5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:26.953548 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a772e1-aef8-4bf3-9251-87797803e5ab admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:26.953833 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a772e1-aef8-4bf3-9251-87797803e5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:26.954264 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a772e1-aef8-4bf3-9251-87797803e5ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:26.955004 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a772e1-aef8-4bf3-9251-87797803e5ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:26.956643 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a772e1-aef8-4bf3-9251-87797803e5ab admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:26.973229 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 937/1881] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:35:26 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:35:26.975301 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d123316-51e7-4679-b539-ee3d6c796f2d admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:26.994309 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d123316-51e7-4679-b539-ee3d6c796f2d admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:27.013187 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f210d937-7e5f-4212-95d5-80f778a64e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:27.014427 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210d937-7e5f-4212-95d5-80f778a64e33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:27.015590 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210d937-7e5f-4212-95d5-80f778a64e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:27.015880 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210d937-7e5f-4212-95d5-80f778a64e33 admin admin] PATH_INFO: `/v3/projects/684796dbe7ad45ce87075644c5747c27/users/92ea6303f36045349bb8db3af389cb28/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:27.021116 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f210d937-7e5f-4212-95d5-80f778a64e33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=684796dbe7ad45ce87075644c5747c27, user_id=92ea6303f36045349bb8db3af389cb28, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:27.024899 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f210d937-7e5f-4212-95d5-80f778a64e33 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:27.047729 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 945/1882] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:35:26 2022] PUT /identity/v3/projects/684796dbe7ad45ce87075644c5747c27/users/92ea6303f36045349bb8db3af389cb28/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:27.058552 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc79c7-0567-4f78-a9ce-9e32e806354a None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:27.058851 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc79c7-0567-4f78-a9ce-9e32e806354a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:27.059326 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc79c7-0567-4f78-a9ce-9e32e806354a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:27.111657 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-1cbc79c7-0567-4f78-a9ce-9e32e806354a None None] MFA Rules not processed for user `92ea6303f36045349bb8db3af389cb28`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:27.113651 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1cbc79c7-0567-4f78-a9ce-9e32e806354a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:27.171674 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:27.248766 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 938/1883] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:27 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:27.278015 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f210d937-7e5f-4212-95d5-80f778a64e33 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:27.281182 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-f210d937-7e5f-4212-95d5-80f778a64e33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:27.316636 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc79c7-0567-4f78-a9ce-9e32e806354a None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:27.318150 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1cbc79c7-0567-4f78-a9ce-9e32e806354a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:27.399614 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f210d937-7e5f-4212-95d5-80f778a64e33 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:27.403829 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6723bb2-e5ec-4752-b49f-40a028dc7f58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:27.404478 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6723bb2-e5ec-4752-b49f-40a028dc7f58 service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:27.404763 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6723bb2-e5ec-4752-b49f-40a028dc7f58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:27.405070 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6723bb2-e5ec-4752-b49f-40a028dc7f58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:27.415584 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6723bb2-e5ec-4752-b49f-40a028dc7f58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:27.416969 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6723bb2-e5ec-4752-b49f-40a028dc7f58 service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:27.418547 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc79c7-0567-4f78-a9ce-9e32e806354a None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:27.424422 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f2e087-6502-4867-9f0e-db8edb59932a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:27.425472 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f2e087-6502-4867-9f0e-db8edb59932a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:27.425836 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f2e087-6502-4867-9f0e-db8edb59932a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:27.426183 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f2e087-6502-4867-9f0e-db8edb59932a admin admin] PATH_INFO: `/v3/users/d95f12edb3e3478a82e6a048b918239e` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:27.427606 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f2e087-6502-4867-9f0e-db8edb59932a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d95f12edb3e3478a82e6a048b918239e)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:27.429694 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 946/1884] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:35:27 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:35:27.429895 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f2e087-6502-4867-9f0e-db8edb59932a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:27.497628 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-01f2e087-6502-4867-9f0e-db8edb59932a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd95f12edb3e3478a82e6a048b918239e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:27.509393 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-01f2e087-6502-4867-9f0e-db8edb59932a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd95f12edb3e3478a82e6a048b918239e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:27.513258 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-01f2e087-6502-4867-9f0e-db8edb59932a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd95f12edb3e3478a82e6a048b918239e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:27.514070 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-01f2e087-6502-4867-9f0e-db8edb59932a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd95f12edb3e3478a82e6a048b918239e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:27.524171 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-01f2e087-6502-4867-9f0e-db8edb59932a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd95f12edb3e3478a82e6a048b918239e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:27.555796 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 939/1885] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:35:27 2022] DELETE /identity/v3/users/d95f12edb3e3478a82e6a048b918239e => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:35:27.556628 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6028249-c1e4-4780-ab41-df4b9276eae0 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:27.556972 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6028249-c1e4-4780-ab41-df4b9276eae0 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:27.557250 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6028249-c1e4-4780-ab41-df4b9276eae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:27.584811 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-e6028249-c1e4-4780-ab41-df4b9276eae0 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:27.592492 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-e6028249-c1e4-4780-ab41-df4b9276eae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:27.661617 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:27.681593 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 947/1886] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:35:27.688709 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f2e087-6502-4867-9f0e-db8edb59932a admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:27.690961 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-01f2e087-6502-4867-9f0e-db8edb59932a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:27.812157 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f2e087-6502-4867-9f0e-db8edb59932a admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:27.820388 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c103b-9515-46a0-b39a-21e3eafbcc92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:27.821488 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c103b-9515-46a0-b39a-21e3eafbcc92 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:27.821911 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c103b-9515-46a0-b39a-21e3eafbcc92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:27.822362 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c103b-9515-46a0-b39a-21e3eafbcc92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:27.831463 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:27.839612 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1c103b-9515-46a0-b39a-21e3eafbcc92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:27.841749 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1c103b-9515-46a0-b39a-21e3eafbcc92 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:27.854744 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 940/1887] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:35:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:35:28.146509 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6028249-c1e4-4780-ab41-df4b9276eae0 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:28.148482 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-e6028249-c1e4-4780-ab41-df4b9276eae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:28.169631 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6028249-c1e4-4780-ab41-df4b9276eae0 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:28.176309 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa9af2-7173-47b6-b5bb-805026d2c1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:28.177325 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa9af2-7173-47b6-b5bb-805026d2c1c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:28.177712 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa9af2-7173-47b6-b5bb-805026d2c1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:28.178093 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa9af2-7173-47b6-b5bb-805026d2c1c1 admin admin] PATH_INFO: `/v3/users/4ca3ed09a70e4bba9cd81f39d6f38c6a` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:28.179676 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfa9af2-7173-47b6-b5bb-805026d2c1c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ca3ed09a70e4bba9cd81f39d6f38c6a)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:28.181751 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfa9af2-7173-47b6-b5bb-805026d2c1c1 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:28.266990 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-ccfa9af2-7173-47b6-b5bb-805026d2c1c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ca3ed09a70e4bba9cd81f39d6f38c6a'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:28.268232 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-ccfa9af2-7173-47b6-b5bb-805026d2c1c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ca3ed09a70e4bba9cd81f39d6f38c6a'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:28.269129 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-ccfa9af2-7173-47b6-b5bb-805026d2c1c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ca3ed09a70e4bba9cd81f39d6f38c6a'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:28.284881 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-ccfa9af2-7173-47b6-b5bb-805026d2c1c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ca3ed09a70e4bba9cd81f39d6f38c6a'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:28.286662 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c103b-9515-46a0-b39a-21e3eafbcc92 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:28.288164 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1a1c103b-9515-46a0-b39a-21e3eafbcc92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:28.313194 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c103b-9515-46a0-b39a-21e3eafbcc92 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:28.335034 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0aa2da-2bef-4667-9079-d51a7aafeb9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:28.336608 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0aa2da-2bef-4667-9079-d51a7aafeb9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:28.337039 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0aa2da-2bef-4667-9079-d51a7aafeb9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:28.337437 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0aa2da-2bef-4667-9079-d51a7aafeb9c admin admin] PATH_INFO: `/v3/projects/1c595dc44a224a3a974dbbc2797e4525` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:28.338732 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0aa2da-2bef-4667-9079-d51a7aafeb9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c595dc44a224a3a974dbbc2797e4525)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:28.344789 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-ccfa9af2-7173-47b6-b5bb-805026d2c1c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ca3ed09a70e4bba9cd81f39d6f38c6a'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:28.362248 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 948/1888] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:35:28 2022] DELETE /identity/v3/users/4ca3ed09a70e4bba9cd81f39d6f38c6a => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:28.362976 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0aa2da-2bef-4667-9079-d51a7aafeb9c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:28.370229 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74eb1b-bc13-4961-bcfc-068285e76736 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:28.370520 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74eb1b-bc13-4961-bcfc-068285e76736 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:28.370807 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74eb1b-bc13-4961-bcfc-068285e76736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:28.407640 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-2e74eb1b-bc13-4961-bcfc-068285e76736 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:28.408874 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-2e74eb1b-bc13-4961-bcfc-068285e76736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:28.474624 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-1b0aa2da-2bef-4667-9079-d51a7aafeb9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c595dc44a224a3a974dbbc2797e4525', 'request_id': 'req-1b0aa2da-2bef-4667-9079-d51a7aafeb9c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:28.485706 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-1b0aa2da-2bef-4667-9079-d51a7aafeb9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c595dc44a224a3a974dbbc2797e4525', 'request_id': 'req-1b0aa2da-2bef-4667-9079-d51a7aafeb9c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:28.495021 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-1b0aa2da-2bef-4667-9079-d51a7aafeb9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c595dc44a224a3a974dbbc2797e4525', 'request_id': 'req-1b0aa2da-2bef-4667-9079-d51a7aafeb9c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:28.528193 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-1b0aa2da-2bef-4667-9079-d51a7aafeb9c admin admin] The token cache is being invalidate because project 1c595dc44a224a3a974dbbc2797e4525 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:35:28.528193 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-1b0aa2da-2bef-4667-9079-d51a7aafeb9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:28.528193 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-1b0aa2da-2bef-4667-9079-d51a7aafeb9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:28.528193 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 941/1889] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:35:28 2022] DELETE /identity/v3/projects/1c595dc44a224a3a974dbbc2797e4525 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:28.528581 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 949/1890] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:28.529859 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0aa2da-2bef-4667-9079-d51a7aafeb9c admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:28.531681 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1b0aa2da-2bef-4667-9079-d51a7aafeb9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:28.538392 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e74eb1b-bc13-4961-bcfc-068285e76736 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:28.540188 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-2e74eb1b-bc13-4961-bcfc-068285e76736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:28.642348 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0aa2da-2bef-4667-9079-d51a7aafeb9c admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:28.647320 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a015f6c0-881c-4cad-bf9c-50a9e434e65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:28.648496 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015f6c0-881c-4cad-bf9c-50a9e434e65d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:28.649682 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015f6c0-881c-4cad-bf9c-50a9e434e65d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:28.649682 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015f6c0-881c-4cad-bf9c-50a9e434e65d admin admin] PATH_INFO: `/v3/users/e4038a07f5d04c858acaa0c6e58274d5` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:28.651501 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a015f6c0-881c-4cad-bf9c-50a9e434e65d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4038a07f5d04c858acaa0c6e58274d5)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:28.654058 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a015f6c0-881c-4cad-bf9c-50a9e434e65d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:28.701310 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e74eb1b-bc13-4961-bcfc-068285e76736 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:28.729514 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:28.753374 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a015f6c0-881c-4cad-bf9c-50a9e434e65d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4038a07f5d04c858acaa0c6e58274d5'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:28.768401 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a015f6c0-881c-4cad-bf9c-50a9e434e65d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4038a07f5d04c858acaa0c6e58274d5'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:28.769323 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a015f6c0-881c-4cad-bf9c-50a9e434e65d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4038a07f5d04c858acaa0c6e58274d5'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:28.770297 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a015f6c0-881c-4cad-bf9c-50a9e434e65d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4038a07f5d04c858acaa0c6e58274d5'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:28.783554 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a015f6c0-881c-4cad-bf9c-50a9e434e65d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4038a07f5d04c858acaa0c6e58274d5'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:28.814553 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:28.821335 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f09dcf-ac1d-4335-a0c9-6eb815fa2b50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:28.823964 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f09dcf-ac1d-4335-a0c9-6eb815fa2b50 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:28.825198 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f09dcf-ac1d-4335-a0c9-6eb815fa2b50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:28.826567 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f09dcf-ac1d-4335-a0c9-6eb815fa2b50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:28.832237 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-a4f09dcf-ac1d-4335-a0c9-6eb815fa2b50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:28.834110 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 942/1891] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:35:28 2022] DELETE /identity/v3/users/e4038a07f5d04c858acaa0c6e58274d5 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:35:28.869782 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f09dcf-ac1d-4335-a0c9-6eb815fa2b50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:28.872698 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f09dcf-ac1d-4335-a0c9-6eb815fa2b50 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:28.889099 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 950/1892] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:35:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:35:29.291735 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a015f6c0-881c-4cad-bf9c-50a9e434e65d admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:29.293398 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a015f6c0-881c-4cad-bf9c-50a9e434e65d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:29.298529 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f09dcf-ac1d-4335-a0c9-6eb815fa2b50 service neutron] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:29.300530 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-a4f09dcf-ac1d-4335-a0c9-6eb815fa2b50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:29.315437 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f09dcf-ac1d-4335-a0c9-6eb815fa2b50 service neutron] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:29.388134 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03222588-037b-44e3-a288-d45e79501586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:29.389137 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03222588-037b-44e3-a288-d45e79501586 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:29.389473 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03222588-037b-44e3-a288-d45e79501586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:29.390478 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03222588-037b-44e3-a288-d45e79501586 admin admin] PATH_INFO: `/v3/projects/e6c45c1f918846a7a5eb289290bc59dd` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:29.390901 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a015f6c0-881c-4cad-bf9c-50a9e434e65d admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:29.392070 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03222588-037b-44e3-a288-d45e79501586 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6c45c1f918846a7a5eb289290bc59dd)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:29.394143 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03222588-037b-44e3-a288-d45e79501586 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:29.395639 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30903bcb-e6f6-4f67-a6cd-4c15d76da0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:29.396507 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30903bcb-e6f6-4f67-a6cd-4c15d76da0d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:29.396798 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30903bcb-e6f6-4f67-a6cd-4c15d76da0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:29.397119 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30903bcb-e6f6-4f67-a6cd-4c15d76da0d7 admin admin] PATH_INFO: `/v3/projects/c315d84953fa46768a04ce4e24d6fd88` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:29.398319 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30903bcb-e6f6-4f67-a6cd-4c15d76da0d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c315d84953fa46768a04ce4e24d6fd88)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:29.400668 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30903bcb-e6f6-4f67-a6cd-4c15d76da0d7 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:29.450956 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-03222588-037b-44e3-a288-d45e79501586 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6c45c1f918846a7a5eb289290bc59dd', 'request_id': 'req-03222588-037b-44e3-a288-d45e79501586'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:29.451156 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-30903bcb-e6f6-4f67-a6cd-4c15d76da0d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c315d84953fa46768a04ce4e24d6fd88', 'request_id': 'req-30903bcb-e6f6-4f67-a6cd-4c15d76da0d7'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:29.464257 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-03222588-037b-44e3-a288-d45e79501586 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6c45c1f918846a7a5eb289290bc59dd', 'request_id': 'req-03222588-037b-44e3-a288-d45e79501586'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:29.468325 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-30903bcb-e6f6-4f67-a6cd-4c15d76da0d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c315d84953fa46768a04ce4e24d6fd88', 'request_id': 'req-30903bcb-e6f6-4f67-a6cd-4c15d76da0d7'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:29.471504 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-03222588-037b-44e3-a288-d45e79501586 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6c45c1f918846a7a5eb289290bc59dd', 'request_id': 'req-03222588-037b-44e3-a288-d45e79501586'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:29.479121 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-30903bcb-e6f6-4f67-a6cd-4c15d76da0d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c315d84953fa46768a04ce4e24d6fd88', 'request_id': 'req-30903bcb-e6f6-4f67-a6cd-4c15d76da0d7'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:29.482420 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-03222588-037b-44e3-a288-d45e79501586 admin admin] The token cache is being invalidate because project e6c45c1f918846a7a5eb289290bc59dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:35:29.482692 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-03222588-037b-44e3-a288-d45e79501586 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:29.483687 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-03222588-037b-44e3-a288-d45e79501586 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:29.485381 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 951/1893] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:35:29 2022] DELETE /identity/v3/projects/e6c45c1f918846a7a5eb289290bc59dd => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:29.489255 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03222588-037b-44e3-a288-d45e79501586 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:29.490688 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-03222588-037b-44e3-a288-d45e79501586 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:29.499937 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-30903bcb-e6f6-4f67-a6cd-4c15d76da0d7 admin admin] The token cache is being invalidate because project c315d84953fa46768a04ce4e24d6fd88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:35:29.500525 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-30903bcb-e6f6-4f67-a6cd-4c15d76da0d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:29.501627 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-30903bcb-e6f6-4f67-a6cd-4c15d76da0d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:29.504253 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 943/1894] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:35:29 2022] DELETE /identity/v3/projects/c315d84953fa46768a04ce4e24d6fd88 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:29.508163 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30903bcb-e6f6-4f67-a6cd-4c15d76da0d7 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:29.509544 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-30903bcb-e6f6-4f67-a6cd-4c15d76da0d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:29.573614 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:29.582557 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03222588-037b-44e3-a288-d45e79501586 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:29.591110 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd4066d-8a63-48ae-8ead-1946c8e2f427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:29.592183 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd4066d-8a63-48ae-8ead-1946c8e2f427 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:29.592793 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd4066d-8a63-48ae-8ead-1946c8e2f427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:29.593457 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd4066d-8a63-48ae-8ead-1946c8e2f427 admin admin] PATH_INFO: `/v3/users/669e3bcaa0b54c019c006810f0256cfc` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:29.594958 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30903bcb-e6f6-4f67-a6cd-4c15d76da0d7 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:29.595754 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd4066d-8a63-48ae-8ead-1946c8e2f427 admin admin] RBAC: Authorizing `identity:delete_user(user_id=669e3bcaa0b54c019c006810f0256cfc)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:29.599648 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd4066d-8a63-48ae-8ead-1946c8e2f427 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:29.599780 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e85a329-178d-4d3b-8811-fbf9af9f6744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:29.600586 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85a329-178d-4d3b-8811-fbf9af9f6744 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:29.600900 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85a329-178d-4d3b-8811-fbf9af9f6744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:29.601184 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85a329-178d-4d3b-8811-fbf9af9f6744 admin admin] PATH_INFO: `/v3/users/92ea6303f36045349bb8db3af389cb28` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:29.602414 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e85a329-178d-4d3b-8811-fbf9af9f6744 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92ea6303f36045349bb8db3af389cb28)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:29.604351 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e85a329-178d-4d3b-8811-fbf9af9f6744 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:29.638480 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:29.660545 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0e85a329-178d-4d3b-8811-fbf9af9f6744 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92ea6303f36045349bb8db3af389cb28'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:29.668866 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0e85a329-178d-4d3b-8811-fbf9af9f6744 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92ea6303f36045349bb8db3af389cb28'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:29.669759 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0e85a329-178d-4d3b-8811-fbf9af9f6744 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92ea6303f36045349bb8db3af389cb28'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:29.670696 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0e85a329-178d-4d3b-8811-fbf9af9f6744 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92ea6303f36045349bb8db3af389cb28'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:29.680640 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-ebd4066d-8a63-48ae-8ead-1946c8e2f427 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '669e3bcaa0b54c019c006810f0256cfc'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:29.684012 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0e85a329-178d-4d3b-8811-fbf9af9f6744 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92ea6303f36045349bb8db3af389cb28'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:29.684236 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-ebd4066d-8a63-48ae-8ead-1946c8e2f427 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '669e3bcaa0b54c019c006810f0256cfc'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:29.685084 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-ebd4066d-8a63-48ae-8ead-1946c8e2f427 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '669e3bcaa0b54c019c006810f0256cfc'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:29.700803 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-ebd4066d-8a63-48ae-8ead-1946c8e2f427 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '669e3bcaa0b54c019c006810f0256cfc'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:29.731803 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 944/1895] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:35:29 2022] DELETE /identity/v3/users/92ea6303f36045349bb8db3af389cb28 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:35:29.739760 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-ebd4066d-8a63-48ae-8ead-1946c8e2f427 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '669e3bcaa0b54c019c006810f0256cfc'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:29.765850 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 952/1896] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:35:29 2022] DELETE /identity/v3/users/669e3bcaa0b54c019c006810f0256cfc => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:35:30.409228 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e85a329-178d-4d3b-8811-fbf9af9f6744 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:30.411462 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0e85a329-178d-4d3b-8811-fbf9af9f6744 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:30.494751 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e85a329-178d-4d3b-8811-fbf9af9f6744 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:30.567623 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd4066d-8a63-48ae-8ead-1946c8e2f427 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:30.571433 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-ebd4066d-8a63-48ae-8ead-1946c8e2f427 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:30.602783 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7559493e-bed0-4dec-873e-d4754dc13a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:30.604686 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559493e-bed0-4dec-873e-d4754dc13a47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:30.605757 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559493e-bed0-4dec-873e-d4754dc13a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:30.606932 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559493e-bed0-4dec-873e-d4754dc13a47 admin admin] PATH_INFO: `/v3/projects/684796dbe7ad45ce87075644c5747c27` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:30.612917 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7559493e-bed0-4dec-873e-d4754dc13a47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=684796dbe7ad45ce87075644c5747c27)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:30.620458 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7559493e-bed0-4dec-873e-d4754dc13a47 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:30.740442 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7559493e-bed0-4dec-873e-d4754dc13a47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '684796dbe7ad45ce87075644c5747c27', 'request_id': 'req-7559493e-bed0-4dec-873e-d4754dc13a47'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:30.756002 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:30.762131 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7559493e-bed0-4dec-873e-d4754dc13a47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '684796dbe7ad45ce87075644c5747c27', 'request_id': 'req-7559493e-bed0-4dec-873e-d4754dc13a47'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:30.773030 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7559493e-bed0-4dec-873e-d4754dc13a47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '684796dbe7ad45ce87075644c5747c27', 'request_id': 'req-7559493e-bed0-4dec-873e-d4754dc13a47'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:30.793602 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7559493e-bed0-4dec-873e-d4754dc13a47 admin admin] The token cache is being invalidate because project 684796dbe7ad45ce87075644c5747c27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:35:30.793602 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7559493e-bed0-4dec-873e-d4754dc13a47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:30.794214 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7559493e-bed0-4dec-873e-d4754dc13a47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:30.797105 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 945/1897] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:35:30 2022] DELETE /identity/v3/projects/684796dbe7ad45ce87075644c5747c27 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:30.803128 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eeaf7a-e05e-4654-add9-6d11bf19a403 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:30.803425 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eeaf7a-e05e-4654-add9-6d11bf19a403 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:30.803704 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eeaf7a-e05e-4654-add9-6d11bf19a403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:30.839127 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d4eeaf7a-e05e-4654-add9-6d11bf19a403 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:30.840462 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d4eeaf7a-e05e-4654-add9-6d11bf19a403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:30.856831 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd4066d-8a63-48ae-8ead-1946c8e2f427 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:30.926509 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 946/1898] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:35:30.937606 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09c864-b0e4-4b3b-8bfb-1c64acf6d343 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:30.937874 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09c864-b0e4-4b3b-8bfb-1c64acf6d343 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:30.938170 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09c864-b0e4-4b3b-8bfb-1c64acf6d343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:30.961081 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-ac09c864-b0e4-4b3b-8bfb-1c64acf6d343 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:30.962860 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ac09c864-b0e4-4b3b-8bfb-1c64acf6d343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:30.977466 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 947/1899] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:30.978934 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09c864-b0e4-4b3b-8bfb-1c64acf6d343 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:30.984742 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857f673-42c8-4fa7-9ad1-6670564de8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:30.986264 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857f673-42c8-4fa7-9ad1-6670564de8a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:30.986915 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857f673-42c8-4fa7-9ad1-6670564de8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:30.987381 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857f673-42c8-4fa7-9ad1-6670564de8a0 admin admin] PATH_INFO: `/v3/projects/a3e885fa1af4460d8c644db14c291027` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:30.989485 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c857f673-42c8-4fa7-9ad1-6670564de8a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3e885fa1af4460d8c644db14c291027)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:30.992882 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09c864-b0e4-4b3b-8bfb-1c64acf6d343 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:30.995001 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c857f673-42c8-4fa7-9ad1-6670564de8a0 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:30.999916 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ddf14-4141-4248-9feb-46a75ab257e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:31.000869 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ddf14-4141-4248-9feb-46a75ab257e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:31.001330 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ddf14-4141-4248-9feb-46a75ab257e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:31.001752 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ddf14-4141-4248-9feb-46a75ab257e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:31.002886 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ddf14-4141-4248-9feb-46a75ab257e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:35:31.003344 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ddf14-4141-4248-9feb-46a75ab257e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:31.005257 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ddf14-4141-4248-9feb-46a75ab257e4 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:31.026106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 948/1900] 10.222.0.16 () {58 vars in 1152 bytes} [Thu May 26 12:35:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:35:31.027152 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ddf14-4141-4248-9feb-46a75ab257e4 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:31.044774 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:31.052534 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ddf14-4141-4248-9feb-46a75ab257e4 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:31.062398 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d82c7-e41b-4073-8e51-14df476599fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:31.063340 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d82c7-e41b-4073-8e51-14df476599fe admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:31.063630 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d82c7-e41b-4073-8e51-14df476599fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:31.063912 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d82c7-e41b-4073-8e51-14df476599fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:31.064651 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d82c7-e41b-4073-8e51-14df476599fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:31.066813 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d82c7-e41b-4073-8e51-14df476599fe admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:31.090291 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-c857f673-42c8-4fa7-9ad1-6670564de8a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3e885fa1af4460d8c644db14c291027', 'request_id': 'req-c857f673-42c8-4fa7-9ad1-6670564de8a0'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:31.103123 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 949/1901] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:35:31 2022] POST /identity/v3/projects => generated 383 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:35:31.108447 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d82c7-e41b-4073-8e51-14df476599fe admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:31.113599 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-c857f673-42c8-4fa7-9ad1-6670564de8a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3e885fa1af4460d8c644db14c291027', 'request_id': 'req-c857f673-42c8-4fa7-9ad1-6670564de8a0'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:31.134302 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-c857f673-42c8-4fa7-9ad1-6670564de8a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3e885fa1af4460d8c644db14c291027', 'request_id': 'req-c857f673-42c8-4fa7-9ad1-6670564de8a0'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:31.163640 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-c857f673-42c8-4fa7-9ad1-6670564de8a0 admin admin] The token cache is being invalidate because project a3e885fa1af4460d8c644db14c291027 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:35:31.163929 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-c857f673-42c8-4fa7-9ad1-6670564de8a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:31.164603 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-c857f673-42c8-4fa7-9ad1-6670564de8a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:31.166491 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 953/1902] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:35:30 2022] DELETE /identity/v3/projects/a3e885fa1af4460d8c644db14c291027 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:31.171869 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3093e72-b952-4426-8cbf-a94f84143a8f None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:31.172358 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3093e72-b952-4426-8cbf-a94f84143a8f None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:31.172791 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3093e72-b952-4426-8cbf-a94f84143a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:31.192983 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-f3093e72-b952-4426-8cbf-a94f84143a8f None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:31.194212 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-f3093e72-b952-4426-8cbf-a94f84143a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:31.214281 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d82c7-e41b-4073-8e51-14df476599fe admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:31.220125 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6d5b7b-615f-499d-a244-285bc375a148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:31.220811 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d5b7b-615f-499d-a244-285bc375a148 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:31.221126 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d5b7b-615f-499d-a244-285bc375a148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:31.221797 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d5b7b-615f-499d-a244-285bc375a148 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:31.222526 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6d5b7b-615f-499d-a244-285bc375a148 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:31.224663 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6d5b7b-615f-499d-a244-285bc375a148 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:31.247018 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 950/1903] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:35:31 2022] POST /identity/v3/users => generated 292 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:35:31.251569 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6d5b7b-615f-499d-a244-285bc375a148 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:31.253745 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9e6d5b7b-615f-499d-a244-285bc375a148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:31.265793 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 954/1904] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:31.268227 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6d5b7b-615f-499d-a244-285bc375a148 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:31.276163 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c3345-5720-4ee9-8d14-9d50e8fad645 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:31.276665 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c3345-5720-4ee9-8d14-9d50e8fad645 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:31.277201 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c3345-5720-4ee9-8d14-9d50e8fad645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:31.279384 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71852ace-fc53-4fd6-bd8f-7e46c421f0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:31.280479 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71852ace-fc53-4fd6-bd8f-7e46c421f0fa admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:31.280983 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71852ace-fc53-4fd6-bd8f-7e46c421f0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:31.281461 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71852ace-fc53-4fd6-bd8f-7e46c421f0fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:31.282814 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71852ace-fc53-4fd6-bd8f-7e46c421f0fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:31.285711 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71852ace-fc53-4fd6-bd8f-7e46c421f0fa admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:31.300891 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-067c3345-5720-4ee9-8d14-9d50e8fad645 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:31.301111 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 951/1905] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:35:31.301801 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71852ace-fc53-4fd6-bd8f-7e46c421f0fa admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:31.302097 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-067c3345-5720-4ee9-8d14-9d50e8fad645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:31.310356 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 955/1906] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:35:31.314812 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71852ace-fc53-4fd6-bd8f-7e46c421f0fa admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:31.315081 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067c3345-5720-4ee9-8d14-9d50e8fad645 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:31.321688 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b763615-7fc0-4d24-ae1d-341cd3a93a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:31.322654 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b763615-7fc0-4d24-ae1d-341cd3a93a1a admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:31.323093 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b763615-7fc0-4d24-ae1d-341cd3a93a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:31.323508 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b763615-7fc0-4d24-ae1d-341cd3a93a1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:31.324278 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067c3345-5720-4ee9-8d14-9d50e8fad645 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:31.324626 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b763615-7fc0-4d24-ae1d-341cd3a93a1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:31.327208 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b763615-7fc0-4d24-ae1d-341cd3a93a1a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:31.329064 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141817fa-b336-4928-8c58-d24a51d4f9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:31.329709 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141817fa-b336-4928-8c58-d24a51d4f9f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:31.329992 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141817fa-b336-4928-8c58-d24a51d4f9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:31.330269 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141817fa-b336-4928-8c58-d24a51d4f9f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:31.330989 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141817fa-b336-4928-8c58-d24a51d4f9f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:35:31.331292 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141817fa-b336-4928-8c58-d24a51d4f9f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:31.332873 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141817fa-b336-4928-8c58-d24a51d4f9f4 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:31.340741 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 952/1907] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:35:31.344892 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 956/1908] 10.222.0.16 () {58 vars in 1152 bytes} [Thu May 26 12:35:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:35:31.349212 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141817fa-b336-4928-8c58-d24a51d4f9f4 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:31.349481 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b763615-7fc0-4d24-ae1d-341cd3a93a1a admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:31.360795 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141817fa-b336-4928-8c58-d24a51d4f9f4 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:31.362527 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b763615-7fc0-4d24-ae1d-341cd3a93a1a admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:31.366431 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f4a152-021d-4764-bd09-a70738131141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:31.367406 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4a152-021d-4764-bd09-a70738131141 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:31.367659 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1300b34e-92c0-423d-818e-62d74eb39927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:31.367852 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4a152-021d-4764-bd09-a70738131141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:31.367988 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4a152-021d-4764-bd09-a70738131141 admin admin] PATH_INFO: `/v3/projects/3d7b8d362a634ac7ba208772f3c25e4e/users/052547dbc35f4109a2fe0c3652573767/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:31.368310 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300b34e-92c0-423d-818e-62d74eb39927 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:31.368831 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300b34e-92c0-423d-818e-62d74eb39927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:31.369140 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300b34e-92c0-423d-818e-62d74eb39927 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:31.369853 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1300b34e-92c0-423d-818e-62d74eb39927 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:31.374904 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1300b34e-92c0-423d-818e-62d74eb39927 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:31.380055 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:DELETE=2,keystone:SELECT=93,keystone:INSERT=5 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:31.385873 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f4a152-021d-4764-bd09-a70738131141 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d7b8d362a634ac7ba208772f3c25e4e, user_id=052547dbc35f4109a2fe0c3652573767, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:31.388555 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f4a152-021d-4764-bd09-a70738131141 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:31.405765 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 957/1909] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:35:31 2022] PUT /identity/v3/projects/3d7b8d362a634ac7ba208772f3c25e4e/users/052547dbc35f4109a2fe0c3652573767/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:31.407865 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 953/1910] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:35:31 2022] POST /identity/v3/projects => generated 363 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:35:31.412571 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f4a152-021d-4764-bd09-a70738131141 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:31.425369 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434c343-fb5e-4c17-b003-1b390a9202d2 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:31.425915 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434c343-fb5e-4c17-b003-1b390a9202d2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:31.426160 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434c343-fb5e-4c17-b003-1b390a9202d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:31.469493 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-8434c343-fb5e-4c17-b003-1b390a9202d2 None None] MFA Rules not processed for user `052547dbc35f4109a2fe0c3652573767`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:31.471509 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8434c343-fb5e-4c17-b003-1b390a9202d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:31.532759 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f4a152-021d-4764-bd09-a70738131141 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:31.557912 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:31.580880 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 954/1911] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:35:31.593959 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434c343-fb5e-4c17-b003-1b390a9202d2 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:31.596572 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8434c343-fb5e-4c17-b003-1b390a9202d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:31.631556 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1018f60-a398-4d57-b094-aad2bcf5e6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:31.632499 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1018f60-a398-4d57-b094-aad2bcf5e6b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:31.632988 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1018f60-a398-4d57-b094-aad2bcf5e6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:31.633448 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1018f60-a398-4d57-b094-aad2bcf5e6b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:31.634649 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1018f60-a398-4d57-b094-aad2bcf5e6b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:31.638414 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1018f60-a398-4d57-b094-aad2bcf5e6b0 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:31.671256 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 958/1912] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:35:31 2022] POST /identity/v3/users => generated 282 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:35:31.672519 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1018f60-a398-4d57-b094-aad2bcf5e6b0 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:31.690219 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1018f60-a398-4d57-b094-aad2bcf5e6b0 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:31.697272 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434c343-fb5e-4c17-b003-1b390a9202d2 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:31.699068 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10e939c-e250-4d6b-b506-e571852a5c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:31.699743 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e939c-e250-4d6b-b506-e571852a5c9e admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:31.700256 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e939c-e250-4d6b-b506-e571852a5c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:31.700539 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e939c-e250-4d6b-b506-e571852a5c9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:31.701499 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10e939c-e250-4d6b-b506-e571852a5c9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:31.703823 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10e939c-e250-4d6b-b506-e571852a5c9e admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:31.703931 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a01b09-da9b-4f39-abcc-f0a9ac88480f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:31.705044 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a01b09-da9b-4f39-abcc-f0a9ac88480f service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:31.705736 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a01b09-da9b-4f39-abcc-f0a9ac88480f service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:31.705736 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a01b09-da9b-4f39-abcc-f0a9ac88480f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:31.719990 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 959/1913] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:35:31.722895 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a01b09-da9b-4f39-abcc-f0a9ac88480f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:31.725320 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a01b09-da9b-4f39-abcc-f0a9ac88480f service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:31.727074 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10e939c-e250-4d6b-b506-e571852a5c9e admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:31.740945 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10e939c-e250-4d6b-b506-e571852a5c9e admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:31.745809 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 955/1914] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:35:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:35:31.746698 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ecc473-e582-42d8-9638-f2fe41a9a1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:31.747371 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ecc473-e582-42d8-9638-f2fe41a9a1cd admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:31.747654 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ecc473-e582-42d8-9638-f2fe41a9a1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:31.747933 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ecc473-e582-42d8-9638-f2fe41a9a1cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:31.748671 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ecc473-e582-42d8-9638-f2fe41a9a1cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:31.751296 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ecc473-e582-42d8-9638-f2fe41a9a1cd admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:31.768405 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 960/1915] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:35:31.774353 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a01b09-da9b-4f39-abcc-f0a9ac88480f service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:31.782924 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ecc473-e582-42d8-9638-f2fe41a9a1cd admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:31.798638 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a01b09-da9b-4f39-abcc-f0a9ac88480f service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:31.799092 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ecc473-e582-42d8-9638-f2fe41a9a1cd admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:31.806387 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d02d319-8076-419a-9386-c4416f299432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:31.807579 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02d319-8076-419a-9386-c4416f299432 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:31.808042 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02d319-8076-419a-9386-c4416f299432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:31.808419 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02d319-8076-419a-9386-c4416f299432 admin admin] PATH_INFO: `/v3/users/052547dbc35f4109a2fe0c3652573767` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:31.810494 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d02d319-8076-419a-9386-c4416f299432 admin admin] RBAC: Authorizing `identity:delete_user(user_id=052547dbc35f4109a2fe0c3652573767)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:31.813652 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d02d319-8076-419a-9386-c4416f299432 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:31.820558 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca423b36-95b9-4596-95d9-c108988920dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:31.822075 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca423b36-95b9-4596-95d9-c108988920dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:31.822550 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca423b36-95b9-4596-95d9-c108988920dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:31.823021 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca423b36-95b9-4596-95d9-c108988920dc admin admin] PATH_INFO: `/v3/projects/b4ea12bdacb8489a9ecf2f77bf899763/users/19413231705941d9a98a620586a907ee/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:31.870046 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca423b36-95b9-4596-95d9-c108988920dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4ea12bdacb8489a9ecf2f77bf899763, user_id=19413231705941d9a98a620586a907ee, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:31.877074 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca423b36-95b9-4596-95d9-c108988920dc admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:31.927829 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-3d02d319-8076-419a-9386-c4416f299432 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '052547dbc35f4109a2fe0c3652573767'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:31.928746 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 956/1916] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:35:31 2022] PUT /identity/v3/projects/b4ea12bdacb8489a9ecf2f77bf899763/users/19413231705941d9a98a620586a907ee/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:35:31.928919 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-3d02d319-8076-419a-9386-c4416f299432 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '052547dbc35f4109a2fe0c3652573767'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:31.928919 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-3d02d319-8076-419a-9386-c4416f299432 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '052547dbc35f4109a2fe0c3652573767'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:31.928919 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-3d02d319-8076-419a-9386-c4416f299432 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '052547dbc35f4109a2fe0c3652573767'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:31.931318 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ccb72-7b3c-4f79-ba49-d3bb31afce1c None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:31.931637 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ccb72-7b3c-4f79-ba49-d3bb31afce1c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:31.931916 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ccb72-7b3c-4f79-ba49-d3bb31afce1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:31.977892 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-3d02d319-8076-419a-9386-c4416f299432 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '052547dbc35f4109a2fe0c3652573767'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:31.981880 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-473ccb72-7b3c-4f79-ba49-d3bb31afce1c None None] MFA Rules not processed for user `19413231705941d9a98a620586a907ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:31.983142 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-473ccb72-7b3c-4f79-ba49-d3bb31afce1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:32.030228 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 961/1917] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:35:31 2022] DELETE /identity/v3/users/052547dbc35f4109a2fe0c3652573767 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:35:32.036945 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f13c8f-9009-45af-90a2-47a043886d41 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:32.037453 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f13c8f-9009-45af-90a2-47a043886d41 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:32.040289 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f13c8f-9009-45af-90a2-47a043886d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:32.069045 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-f3f13c8f-9009-45af-90a2-47a043886d41 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:32.070465 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-f3f13c8f-9009-45af-90a2-47a043886d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:32.103753 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:32.161178 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:32.168555 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 957/1918] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:31 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:35:32.179525 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ccb72-7b3c-4f79-ba49-d3bb31afce1c None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:32.197367 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-473ccb72-7b3c-4f79-ba49-d3bb31afce1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:32.197596 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 962/1919] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:35:32.197596 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f13c8f-9009-45af-90a2-47a043886d41 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:32.197596 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-f3f13c8f-9009-45af-90a2-47a043886d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:32.307970 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f13c8f-9009-45af-90a2-47a043886d41 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:32.313020 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be60e7c-2398-43e7-aaf8-94b84f1cd0db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:32.313020 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be60e7c-2398-43e7-aaf8-94b84f1cd0db service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:32.313376 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be60e7c-2398-43e7-aaf8-94b84f1cd0db service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:32.313598 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be60e7c-2398-43e7-aaf8-94b84f1cd0db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:32.345975 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ccb72-7b3c-4f79-ba49-d3bb31afce1c None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:32.353371 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4fdf61-71e4-47ea-a7d8-783f27cd8155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:32.355765 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4fdf61-71e4-47ea-a7d8-783f27cd8155 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:32.356704 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4fdf61-71e4-47ea-a7d8-783f27cd8155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:32.357194 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4fdf61-71e4-47ea-a7d8-783f27cd8155 admin admin] PATH_INFO: `/v3/users/8a840973f0aa4c46b91a94c3e8d04893` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:32.360305 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4fdf61-71e4-47ea-a7d8-783f27cd8155 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a840973f0aa4c46b91a94c3e8d04893)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:32.364022 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4fdf61-71e4-47ea-a7d8-783f27cd8155 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:32.393323 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be60e7c-2398-43e7-aaf8-94b84f1cd0db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:32.395161 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be60e7c-2398-43e7-aaf8-94b84f1cd0db service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:32.407477 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 963/1920] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:35:32 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:35:32.408559 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be60e7c-2398-43e7-aaf8-94b84f1cd0db service cinder] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:32.411648 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-2be60e7c-2398-43e7-aaf8-94b84f1cd0db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:32.454573 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-2d4fdf61-71e4-47ea-a7d8-783f27cd8155 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a840973f0aa4c46b91a94c3e8d04893'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:32.467401 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-2d4fdf61-71e4-47ea-a7d8-783f27cd8155 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a840973f0aa4c46b91a94c3e8d04893'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:32.470753 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-2d4fdf61-71e4-47ea-a7d8-783f27cd8155 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a840973f0aa4c46b91a94c3e8d04893'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:32.472773 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-2d4fdf61-71e4-47ea-a7d8-783f27cd8155 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a840973f0aa4c46b91a94c3e8d04893'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:32.491962 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be60e7c-2398-43e7-aaf8-94b84f1cd0db service cinder] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:32.493197 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-2d4fdf61-71e4-47ea-a7d8-783f27cd8155 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a840973f0aa4c46b91a94c3e8d04893'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:32.496123 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e126ab49-616d-4067-976f-912c32afe3ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:32.496986 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126ab49-616d-4067-976f-912c32afe3ff service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:32.497273 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126ab49-616d-4067-976f-912c32afe3ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:32.497552 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126ab49-616d-4067-976f-912c32afe3ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:32.500093 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-e126ab49-616d-4067-976f-912c32afe3ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:32.518114 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e126ab49-616d-4067-976f-912c32afe3ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:32.519939 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e126ab49-616d-4067-976f-912c32afe3ff service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:32.533483 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 958/1921] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:35:32 2022] DELETE /identity/v3/users/8a840973f0aa4c46b91a94c3e8d04893 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:32.534958 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa2610-0386-46c3-9acf-082a70048528 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:32.535346 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa2610-0386-46c3-9acf-082a70048528 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:32.535702 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa2610-0386-46c3-9acf-082a70048528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:32.542655 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 964/1922] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:35:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:35:32.560726 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-3afa2610-0386-46c3-9acf-082a70048528 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:32.563066 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3afa2610-0386-46c3-9acf-082a70048528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:32.672175 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 959/1923] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:32.682047 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e126ab49-616d-4067-976f-912c32afe3ff service neutron] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:32.683777 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-e126ab49-616d-4067-976f-912c32afe3ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:32.703658 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e126ab49-616d-4067-976f-912c32afe3ff service neutron] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:32.825139 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0067b72c-e212-425d-b8f2-929c6f1ec84a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:32.825880 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067b72c-e212-425d-b8f2-929c6f1ec84a service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:32.838230 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067b72c-e212-425d-b8f2-929c6f1ec84a service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:32.838230 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067b72c-e212-425d-b8f2-929c6f1ec84a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:32.840439 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:32.845122 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0067b72c-e212-425d-b8f2-929c6f1ec84a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:32.847371 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0067b72c-e212-425d-b8f2-929c6f1ec84a service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:32.861434 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 965/1924] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:35:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:35:32.950538 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa2610-0386-46c3-9acf-082a70048528 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:32.952220 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3afa2610-0386-46c3-9acf-082a70048528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:32.962357 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:32.967419 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa2610-0386-46c3-9acf-082a70048528 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:32.981236 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b7070b-8593-40e5-8f02-2298ae283d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:32.982373 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7070b-8593-40e5-8f02-2298ae283d0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:32.985793 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7070b-8593-40e5-8f02-2298ae283d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:32.987069 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7070b-8593-40e5-8f02-2298ae283d0a admin admin] PATH_INFO: `/v3/projects/3d7b8d362a634ac7ba208772f3c25e4e` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:32.989299 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b7070b-8593-40e5-8f02-2298ae283d0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d7b8d362a634ac7ba208772f3c25e4e)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:32.992381 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b7070b-8593-40e5-8f02-2298ae283d0a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:33.046617 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-18b7070b-8593-40e5-8f02-2298ae283d0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d7b8d362a634ac7ba208772f3c25e4e', 'request_id': 'req-18b7070b-8593-40e5-8f02-2298ae283d0a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:33.060550 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-18b7070b-8593-40e5-8f02-2298ae283d0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d7b8d362a634ac7ba208772f3c25e4e', 'request_id': 'req-18b7070b-8593-40e5-8f02-2298ae283d0a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:33.068023 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-18b7070b-8593-40e5-8f02-2298ae283d0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d7b8d362a634ac7ba208772f3c25e4e', 'request_id': 'req-18b7070b-8593-40e5-8f02-2298ae283d0a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:33.082905 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-18b7070b-8593-40e5-8f02-2298ae283d0a admin admin] The token cache is being invalidate because project 3d7b8d362a634ac7ba208772f3c25e4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:35:33.083194 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-18b7070b-8593-40e5-8f02-2298ae283d0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:33.083868 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-18b7070b-8593-40e5-8f02-2298ae283d0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:33.085666 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 960/1925] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:35:32 2022] DELETE /identity/v3/projects/3d7b8d362a634ac7ba208772f3c25e4e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:33.092558 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c76dc-d788-49a8-88ee-b7fb63187a3e None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:33.093955 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c76dc-d788-49a8-88ee-b7fb63187a3e None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:33.094238 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c76dc-d788-49a8-88ee-b7fb63187a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:33.113639 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-d67c76dc-d788-49a8-88ee-b7fb63187a3e None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:33.114907 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-d67c76dc-d788-49a8-88ee-b7fb63187a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:33.192236 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 966/1926] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:35:33.193989 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c3402-9824-4f4d-9e20-3bd56c7fb12a None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:33.194438 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c3402-9824-4f4d-9e20-3bd56c7fb12a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:33.194825 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c3402-9824-4f4d-9e20-3bd56c7fb12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:33.206227 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c76dc-d788-49a8-88ee-b7fb63187a3e None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:33.207703 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-d67c76dc-d788-49a8-88ee-b7fb63187a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:33.221869 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c76dc-d788-49a8-88ee-b7fb63187a3e None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:33.227499 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea20c1f-3871-4bbc-9f6b-5d9f5f9c9ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:33.228367 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea20c1f-3871-4bbc-9f6b-5d9f5f9c9ab4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:33.228723 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea20c1f-3871-4bbc-9f6b-5d9f5f9c9ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:33.229037 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea20c1f-3871-4bbc-9f6b-5d9f5f9c9ab4 admin admin] PATH_INFO: `/v3/projects/aac9ac546b48497d9dea2c314b9b8744` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:33.230481 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea20c1f-3871-4bbc-9f6b-5d9f5f9c9ab4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aac9ac546b48497d9dea2c314b9b8744)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:33.232419 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea20c1f-3871-4bbc-9f6b-5d9f5f9c9ab4 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:33.238265 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-147c3402-9824-4f4d-9e20-3bd56c7fb12a None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:33.239824 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-147c3402-9824-4f4d-9e20-3bd56c7fb12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:33.249222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 961/1927] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:33.255756 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c3402-9824-4f4d-9e20-3bd56c7fb12a None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:33.270602 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c3402-9824-4f4d-9e20-3bd56c7fb12a None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:33.283432 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04967df9-6440-4af4-9791-ac4a84334a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:33.286028 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04967df9-6440-4af4-9791-ac4a84334a4d admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:33.286357 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04967df9-6440-4af4-9791-ac4a84334a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:33.286810 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04967df9-6440-4af4-9791-ac4a84334a4d admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:33.288398 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04967df9-6440-4af4-9791-ac4a84334a4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:35:33.288907 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04967df9-6440-4af4-9791-ac4a84334a4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:33.290922 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04967df9-6440-4af4-9791-ac4a84334a4d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:33.301590 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-7ea20c1f-3871-4bbc-9f6b-5d9f5f9c9ab4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aac9ac546b48497d9dea2c314b9b8744', 'request_id': 'req-7ea20c1f-3871-4bbc-9f6b-5d9f5f9c9ab4'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:33.310671 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-7ea20c1f-3871-4bbc-9f6b-5d9f5f9c9ab4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aac9ac546b48497d9dea2c314b9b8744', 'request_id': 'req-7ea20c1f-3871-4bbc-9f6b-5d9f5f9c9ab4'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:33.310920 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 962/1928] 10.222.0.16 () {58 vars in 1152 bytes} [Thu May 26 12:35:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:35:33.317841 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04967df9-6440-4af4-9791-ac4a84334a4d admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:33.320873 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-7ea20c1f-3871-4bbc-9f6b-5d9f5f9c9ab4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aac9ac546b48497d9dea2c314b9b8744', 'request_id': 'req-7ea20c1f-3871-4bbc-9f6b-5d9f5f9c9ab4'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:33.330753 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04967df9-6440-4af4-9791-ac4a84334a4d admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:33.335533 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-7ea20c1f-3871-4bbc-9f6b-5d9f5f9c9ab4 admin admin] The token cache is being invalidate because project aac9ac546b48497d9dea2c314b9b8744 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:35:33.336031 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-7ea20c1f-3871-4bbc-9f6b-5d9f5f9c9ab4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:33.336874 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-7ea20c1f-3871-4bbc-9f6b-5d9f5f9c9ab4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:33.339165 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 967/1929] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:35:33 2022] DELETE /identity/v3/projects/aac9ac546b48497d9dea2c314b9b8744 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:35:33.345071 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea20c1f-3871-4bbc-9f6b-5d9f5f9c9ab4 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:33.348279 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-7ea20c1f-3871-4bbc-9f6b-5d9f5f9c9ab4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:33.399096 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4821b66-757a-40ff-9d50-1383ab1b12ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:33.400044 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4821b66-757a-40ff-9d50-1383ab1b12ec admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:33.400044 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4821b66-757a-40ff-9d50-1383ab1b12ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:33.400334 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4821b66-757a-40ff-9d50-1383ab1b12ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:33.401120 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4821b66-757a-40ff-9d50-1383ab1b12ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:33.403919 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4821b66-757a-40ff-9d50-1383ab1b12ec admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:33.445094 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 963/1930] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:35:33 2022] POST /identity/v3/projects => generated 371 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:35:33.454534 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4821b66-757a-40ff-9d50-1383ab1b12ec admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:33.458144 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b4821b66-757a-40ff-9d50-1383ab1b12ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:33.543090 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea20c1f-3871-4bbc-9f6b-5d9f5f9c9ab4 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:33.591591 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:33.614830 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4821b66-757a-40ff-9d50-1383ab1b12ec admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:33.624826 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24349acc-0d11-49ba-9d3e-7739dc8a5690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:33.625537 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24349acc-0d11-49ba-9d3e-7739dc8a5690 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:33.627870 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24349acc-0d11-49ba-9d3e-7739dc8a5690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:33.628165 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24349acc-0d11-49ba-9d3e-7739dc8a5690 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:33.630833 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24349acc-0d11-49ba-9d3e-7739dc8a5690 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:33.633715 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24349acc-0d11-49ba-9d3e-7739dc8a5690 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:33.634625 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:33.684956 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 964/1931] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:35:33 2022] POST /identity/v3/users => generated 286 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:35:33.689528 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24349acc-0d11-49ba-9d3e-7739dc8a5690 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:33.714740 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24349acc-0d11-49ba-9d3e-7739dc8a5690 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:33.725825 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb631d9-e40f-49f1-bc47-8f7dae877cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:33.726591 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb631d9-e40f-49f1-bc47-8f7dae877cfb admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:33.726941 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb631d9-e40f-49f1-bc47-8f7dae877cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:33.727286 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb631d9-e40f-49f1-bc47-8f7dae877cfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:33.728331 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb631d9-e40f-49f1-bc47-8f7dae877cfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:33.730913 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb631d9-e40f-49f1-bc47-8f7dae877cfb admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:33.751183 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 965/1932] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:35:33 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:35:33.769718 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb631d9-e40f-49f1-bc47-8f7dae877cfb admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:33.794331 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce4e64-40d6-491c-b1d7-e4c38f09d314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:33.795874 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce4e64-40d6-491c-b1d7-e4c38f09d314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:33.796354 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce4e64-40d6-491c-b1d7-e4c38f09d314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:33.796828 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce4e64-40d6-491c-b1d7-e4c38f09d314 admin admin] PATH_INFO: `/v3/users/09dcb366a82d4bdc81c084da0da88a22` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:33.803042 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb631d9-e40f-49f1-bc47-8f7dae877cfb admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:33.803905 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ce4e64-40d6-491c-b1d7-e4c38f09d314 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09dcb366a82d4bdc81c084da0da88a22)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:33.808814 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ce4e64-40d6-491c-b1d7-e4c38f09d314 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:33.815661 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3140bfb7-1ed4-4a97-81e3-f474658b8841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:33.819123 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140bfb7-1ed4-4a97-81e3-f474658b8841 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:33.819607 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140bfb7-1ed4-4a97-81e3-f474658b8841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:33.820767 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140bfb7-1ed4-4a97-81e3-f474658b8841 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:33.821754 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3140bfb7-1ed4-4a97-81e3-f474658b8841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:33.829226 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3140bfb7-1ed4-4a97-81e3-f474658b8841 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:33.862127 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 966/1933] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:35:33 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:35:33.865943 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3140bfb7-1ed4-4a97-81e3-f474658b8841 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:33.887087 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3140bfb7-1ed4-4a97-81e3-f474658b8841 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:33.903401 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e527345-1f67-474b-9673-84a4d15308fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:33.904478 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e527345-1f67-474b-9673-84a4d15308fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:33.904904 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e527345-1f67-474b-9673-84a4d15308fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:33.906202 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e527345-1f67-474b-9673-84a4d15308fe admin admin] PATH_INFO: `/v3/projects/1e144510336a48f4aee0374204f929e3/users/7f3df0f19bad49af92cf6ce1edf7ee1f/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:33.965149 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e527345-1f67-474b-9673-84a4d15308fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e144510336a48f4aee0374204f929e3, user_id=7f3df0f19bad49af92cf6ce1edf7ee1f, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:33.969147 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-f1ce4e64-40d6-491c-b1d7-e4c38f09d314 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09dcb366a82d4bdc81c084da0da88a22'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:33.969624 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-f1ce4e64-40d6-491c-b1d7-e4c38f09d314 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09dcb366a82d4bdc81c084da0da88a22'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:33.970334 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-f1ce4e64-40d6-491c-b1d7-e4c38f09d314 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09dcb366a82d4bdc81c084da0da88a22'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:33.972544 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e527345-1f67-474b-9673-84a4d15308fe admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:33.990998 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-f1ce4e64-40d6-491c-b1d7-e4c38f09d314 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09dcb366a82d4bdc81c084da0da88a22'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:34.004398 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 967/1934] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:35:33 2022] PUT /identity/v3/projects/1e144510336a48f4aee0374204f929e3/users/7f3df0f19bad49af92cf6ce1edf7ee1f/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:34.023076 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b1e72-4e81-4cc2-8915-4424436cb310 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:34.023366 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b1e72-4e81-4cc2-8915-4424436cb310 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:34.023647 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b1e72-4e81-4cc2-8915-4424436cb310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:34.050025 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-f1ce4e64-40d6-491c-b1d7-e4c38f09d314 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09dcb366a82d4bdc81c084da0da88a22'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:34.105927 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 968/1935] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:35:33 2022] DELETE /identity/v3/users/09dcb366a82d4bdc81c084da0da88a22 => generated 0 bytes in 755 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:34.124566 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-968b1e72-4e81-4cc2-8915-4424436cb310 None None] MFA Rules not processed for user `7f3df0f19bad49af92cf6ce1edf7ee1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:34.127016 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-968b1e72-4e81-4cc2-8915-4424436cb310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:34.360282 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 968/1936] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:35:34.375941 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce4e64-40d6-491c-b1d7-e4c38f09d314 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:34.377496 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-f1ce4e64-40d6-491c-b1d7-e4c38f09d314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:34.470864 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce4e64-40d6-491c-b1d7-e4c38f09d314 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:34.483260 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c990a-d099-423a-a9f2-c144cadef74b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad8cfccd3a4d42d381ce62ea90849f19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:34.483260 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c990a-d099-423a-a9f2-c144cadef74b service glance] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:34.483260 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c990a-d099-423a-a9f2-c144cadef74b service glance] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:34.483260 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c990a-d099-423a-a9f2-c144cadef74b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:34.487822 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2c990a-d099-423a-a9f2-c144cadef74b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:34.489428 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2c990a-d099-423a-a9f2-c144cadef74b service glance] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:34.511280 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 969/1937] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:35:34 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:35:34.872691 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b1e72-4e81-4cc2-8915-4424436cb310 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:34.874290 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-968b1e72-4e81-4cc2-8915-4424436cb310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:35.060621 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b1e72-4e81-4cc2-8915-4424436cb310 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:35.067624 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973ecb00-4aaa-4e39-98e0-8e6211032d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:35.068598 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ecb00-4aaa-4e39-98e0-8e6211032d62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:35.068776 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ecb00-4aaa-4e39-98e0-8e6211032d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:35.069083 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ecb00-4aaa-4e39-98e0-8e6211032d62 admin admin] PATH_INFO: `/v3/projects/ccd69e93c4aa4687b40f63a8d50ada01` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:35.070329 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973ecb00-4aaa-4e39-98e0-8e6211032d62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccd69e93c4aa4687b40f63a8d50ada01)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:35.072294 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973ecb00-4aaa-4e39-98e0-8e6211032d62 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:35.175420 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:35.262534 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-973ecb00-4aaa-4e39-98e0-8e6211032d62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccd69e93c4aa4687b40f63a8d50ada01', 'request_id': 'req-973ecb00-4aaa-4e39-98e0-8e6211032d62'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:35.294477 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-973ecb00-4aaa-4e39-98e0-8e6211032d62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccd69e93c4aa4687b40f63a8d50ada01', 'request_id': 'req-973ecb00-4aaa-4e39-98e0-8e6211032d62'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:35.307111 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-973ecb00-4aaa-4e39-98e0-8e6211032d62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccd69e93c4aa4687b40f63a8d50ada01', 'request_id': 'req-973ecb00-4aaa-4e39-98e0-8e6211032d62'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:35.345416 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-973ecb00-4aaa-4e39-98e0-8e6211032d62 admin admin] The token cache is being invalidate because project ccd69e93c4aa4687b40f63a8d50ada01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:35:35.345940 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-973ecb00-4aaa-4e39-98e0-8e6211032d62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:35.346723 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-973ecb00-4aaa-4e39-98e0-8e6211032d62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:35.348571 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 969/1938] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:35:34 2022] DELETE /identity/v3/projects/ccd69e93c4aa4687b40f63a8d50ada01 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:35.354337 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65df867-fa26-40d5-8d55-4cd926cfa659 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:35.354820 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65df867-fa26-40d5-8d55-4cd926cfa659 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:35.355284 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65df867-fa26-40d5-8d55-4cd926cfa659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:35.383097 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-d65df867-fa26-40d5-8d55-4cd926cfa659 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:35.384936 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-d65df867-fa26-40d5-8d55-4cd926cfa659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:35.481394 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:35.508891 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 970/1939] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:35.514032 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad9634-8b53-4b69-9d42-8c563e909336 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:35.514715 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad9634-8b53-4b69-9d42-8c563e909336 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:35.515190 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad9634-8b53-4b69-9d42-8c563e909336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:35.542351 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b9ad9634-8b53-4b69-9d42-8c563e909336 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:35.543614 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b9ad9634-8b53-4b69-9d42-8c563e909336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:35.552473 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 970/1940] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:35.556910 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65df867-fa26-40d5-8d55-4cd926cfa659 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:35.575559 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65df867-fa26-40d5-8d55-4cd926cfa659 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:35.590666 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9fe281-c00b-4629-b7a6-0664fb2c4c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:35.591718 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9fe281-c00b-4629-b7a6-0664fb2c4c55 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:35.591718 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9fe281-c00b-4629-b7a6-0664fb2c4c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:35.591992 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9fe281-c00b-4629-b7a6-0664fb2c4c55 admin admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:35.593453 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9fe281-c00b-4629-b7a6-0664fb2c4c55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:35:35.593795 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9fe281-c00b-4629-b7a6-0664fb2c4c55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:35.595628 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9fe281-c00b-4629-b7a6-0664fb2c4c55 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:35.614913 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 971/1941] 10.222.0.16 () {58 vars in 1152 bytes} [Thu May 26 12:35:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:35:35.618088 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad9634-8b53-4b69-9d42-8c563e909336 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:35.637934 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad9634-8b53-4b69-9d42-8c563e909336 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:35.646342 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a941de7f-d8d0-4e7b-9c71-b5995ec6229b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:35.647414 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941de7f-d8d0-4e7b-9c71-b5995ec6229b admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:35.647980 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941de7f-d8d0-4e7b-9c71-b5995ec6229b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:35.648426 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941de7f-d8d0-4e7b-9c71-b5995ec6229b admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:35.649453 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a941de7f-d8d0-4e7b-9c71-b5995ec6229b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:35.652533 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a941de7f-d8d0-4e7b-9c71-b5995ec6229b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:35.693055 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 971/1942] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:35:35 2022] POST /identity/v3/projects => generated 377 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:35:35.697795 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9fe281-c00b-4629-b7a6-0664fb2c4c55 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:35.717625 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9fe281-c00b-4629-b7a6-0664fb2c4c55 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:35.817584 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae02da-e396-4715-943f-0bfc6c37c6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:35.818375 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae02da-e396-4715-943f-0bfc6c37c6ec admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:35.818861 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae02da-e396-4715-943f-0bfc6c37c6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:35.819229 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae02da-e396-4715-943f-0bfc6c37c6ec admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:35.820096 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ae02da-e396-4715-943f-0bfc6c37c6ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:35.822502 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ae02da-e396-4715-943f-0bfc6c37c6ec admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:35.844986 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 972/1943] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:35:35 2022] POST /identity/v3/users => generated 289 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:35:35.849167 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a941de7f-d8d0-4e7b-9c71-b5995ec6229b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:35.870211 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a941de7f-d8d0-4e7b-9c71-b5995ec6229b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:35.879908 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95097041-73bd-469c-907c-e801130deca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:35.880790 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95097041-73bd-469c-907c-e801130deca6 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:35.881345 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95097041-73bd-469c-907c-e801130deca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:35.881839 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95097041-73bd-469c-907c-e801130deca6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:35.883698 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95097041-73bd-469c-907c-e801130deca6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:35.887236 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95097041-73bd-469c-907c-e801130deca6 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:35.916241 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 972/1944] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:35:35.918398 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae02da-e396-4715-943f-0bfc6c37c6ec admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:35.934911 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae02da-e396-4715-943f-0bfc6c37c6ec admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:35.951165 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c1531-ae14-478c-b795-8db8d08ac2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:35.961522 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c1531-ae14-478c-b795-8db8d08ac2b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:35.961522 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c1531-ae14-478c-b795-8db8d08ac2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:35.961522 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c1531-ae14-478c-b795-8db8d08ac2b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:35.961522 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7c1531-ae14-478c-b795-8db8d08ac2b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:35.961522 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7c1531-ae14-478c-b795-8db8d08ac2b4 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:35.966831 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 973/1945] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:35:35.977325 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95097041-73bd-469c-907c-e801130deca6 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:36.028419 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95097041-73bd-469c-907c-e801130deca6 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:36.043750 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4899b33-33ef-4a71-a6d0-07fd93a668ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:36.047704 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4899b33-33ef-4a71-a6d0-07fd93a668ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:36.048171 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4899b33-33ef-4a71-a6d0-07fd93a668ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:36.050079 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4899b33-33ef-4a71-a6d0-07fd93a668ef admin admin] PATH_INFO: `/v3/projects/593d91cccc6e4ad194d0cd6c5f112b21/users/6afa72b5ed454827886d36261cbef7b7/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:36.117168 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4899b33-33ef-4a71-a6d0-07fd93a668ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=593d91cccc6e4ad194d0cd6c5f112b21, user_id=6afa72b5ed454827886d36261cbef7b7, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:36.122137 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4899b33-33ef-4a71-a6d0-07fd93a668ef admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:36.146048 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 973/1946] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:35:35 2022] PUT /identity/v3/projects/593d91cccc6e4ad194d0cd6c5f112b21/users/6afa72b5ed454827886d36261cbef7b7/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:36.166415 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7072111-c976-4279-8188-d91698bcfb53 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:36.166783 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7072111-c976-4279-8188-d91698bcfb53 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:36.167197 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7072111-c976-4279-8188-d91698bcfb53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:36.207578 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-c7072111-c976-4279-8188-d91698bcfb53 None None] MFA Rules not processed for user `6afa72b5ed454827886d36261cbef7b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:36.207578 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-c7072111-c976-4279-8188-d91698bcfb53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:36.369403 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 974/1947] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:36.373639 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4899b33-33ef-4a71-a6d0-07fd93a668ef admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:36.475367 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4899b33-33ef-4a71-a6d0-07fd93a668ef admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:36.480504 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42758a54-15b9-4ff6-95c3-02e250f136b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:36.481532 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42758a54-15b9-4ff6-95c3-02e250f136b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:36.482257 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42758a54-15b9-4ff6-95c3-02e250f136b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:36.482866 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42758a54-15b9-4ff6-95c3-02e250f136b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:36.484488 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42758a54-15b9-4ff6-95c3-02e250f136b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:36.487039 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42758a54-15b9-4ff6-95c3-02e250f136b7 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:36.524422 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 974/1948] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:35:36 2022] POST /identity/v3/projects => generated 379 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:35:36.526093 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7072111-c976-4279-8188-d91698bcfb53 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:36.548656 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7072111-c976-4279-8188-d91698bcfb53 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:36.634688 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:36.658348 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c5e0bf-7c8b-4a30-87a9-f0adeaa8f57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:36.659839 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5e0bf-7c8b-4a30-87a9-f0adeaa8f57b admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:36.660055 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5e0bf-7c8b-4a30-87a9-f0adeaa8f57b admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:36.660569 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5e0bf-7c8b-4a30-87a9-f0adeaa8f57b admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:36.662039 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c5e0bf-7c8b-4a30-87a9-f0adeaa8f57b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:36.666865 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c5e0bf-7c8b-4a30-87a9-f0adeaa8f57b admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:36.706191 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 975/1949] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:35:36 2022] POST /identity/v3/users => generated 296 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:35:36.706955 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42758a54-15b9-4ff6-95c3-02e250f136b7 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:36.726225 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42758a54-15b9-4ff6-95c3-02e250f136b7 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:36.732877 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ce37d-f4ca-4574-bdff-af98f73cb4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:36.734817 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ce37d-f4ca-4574-bdff-af98f73cb4df admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:36.735375 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ce37d-f4ca-4574-bdff-af98f73cb4df admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:36.735962 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ce37d-f4ca-4574-bdff-af98f73cb4df admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:36.737594 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ce37d-f4ca-4574-bdff-af98f73cb4df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:36.741123 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ce37d-f4ca-4574-bdff-af98f73cb4df admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:36.763649 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 975/1950] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:35:36 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:35:36.768774 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c5e0bf-7c8b-4a30-87a9-f0adeaa8f57b admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:36.780022 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c5e0bf-7c8b-4a30-87a9-f0adeaa8f57b admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:36.786248 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b026c6-d80e-46db-831d-1113d199c023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:36.787699 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b026c6-d80e-46db-831d-1113d199c023 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:36.788128 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b026c6-d80e-46db-831d-1113d199c023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:36.788492 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b026c6-d80e-46db-831d-1113d199c023 admin admin] PATH_INFO: `/v3/projects/469fc05acb8f4f1c8b753f0c9daa0aee/users/bed4665805a547949cd22984d340b5e3/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:36.813497 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b026c6-d80e-46db-831d-1113d199c023 admin admin] RBAC: Authorizing `identity:create_grant(project_id=469fc05acb8f4f1c8b753f0c9daa0aee, user_id=bed4665805a547949cd22984d340b5e3, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:36.816763 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b026c6-d80e-46db-831d-1113d199c023 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:36.842053 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 976/1951] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:35:36 2022] PUT /identity/v3/projects/469fc05acb8f4f1c8b753f0c9daa0aee/users/bed4665805a547949cd22984d340b5e3/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:35:36.847017 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ce37d-f4ca-4574-bdff-af98f73cb4df admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:36.859809 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ce37d-f4ca-4574-bdff-af98f73cb4df admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:36.890731 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:36.985629 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2dd076-30c1-40ae-aec7-bed54fc3fa23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:36.987948 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2dd076-30c1-40ae-aec7-bed54fc3fa23 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:36.988449 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2dd076-30c1-40ae-aec7-bed54fc3fa23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:36.988724 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2dd076-30c1-40ae-aec7-bed54fc3fa23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:36.989511 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2dd076-30c1-40ae-aec7-bed54fc3fa23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:36.991749 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2dd076-30c1-40ae-aec7-bed54fc3fa23 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:37.008343 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 976/1952] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:35:36 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:35:37.012727 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b026c6-d80e-46db-831d-1113d199c023 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:37.029352 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b026c6-d80e-46db-831d-1113d199c023 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:37.035174 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b2c1e-8d8a-468f-8ef0-303302188dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:37.036103 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b2c1e-8d8a-468f-8ef0-303302188dc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:37.036393 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b2c1e-8d8a-468f-8ef0-303302188dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:37.036706 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b2c1e-8d8a-468f-8ef0-303302188dc1 admin admin] PATH_INFO: `/v3/projects/469fc05acb8f4f1c8b753f0c9daa0aee/users/bed4665805a547949cd22984d340b5e3/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:37.039134 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7b2c1e-8d8a-468f-8ef0-303302188dc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=469fc05acb8f4f1c8b753f0c9daa0aee, user_id=bed4665805a547949cd22984d340b5e3, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:37.042301 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7b2c1e-8d8a-468f-8ef0-303302188dc1 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:37.068516 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 977/1953] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:35:37 2022] PUT /identity/v3/projects/469fc05acb8f4f1c8b753f0c9daa0aee/users/bed4665805a547949cd22984d340b5e3/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:37.081857 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ec05e-d744-4cd8-8a26-5a4ab27ef572 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:37.082460 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ec05e-d744-4cd8-8a26-5a4ab27ef572 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:37.082995 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ec05e-d744-4cd8-8a26-5a4ab27ef572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:37.117233 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-3a1ec05e-d744-4cd8-8a26-5a4ab27ef572 None None] MFA Rules not processed for user `bed4665805a547949cd22984d340b5e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:37.119250 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3a1ec05e-d744-4cd8-8a26-5a4ab27ef572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:37.266357 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 977/1954] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:37 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:37.291660 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b2c1e-8d8a-468f-8ef0-303302188dc1 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:37.294730 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-fd7b2c1e-8d8a-468f-8ef0-303302188dc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:37.411847 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b2c1e-8d8a-468f-8ef0-303302188dc1 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:37.429509 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eed593-4c02-4097-ac06-3683f5b8c9ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:37.430377 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eed593-4c02-4097-ac06-3683f5b8c9ee service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:37.431112 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eed593-4c02-4097-ac06-3683f5b8c9ee service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:37.431469 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eed593-4c02-4097-ac06-3683f5b8c9ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:37.522660 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eed593-4c02-4097-ac06-3683f5b8c9ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:37.524124 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eed593-4c02-4097-ac06-3683f5b8c9ee service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:37.535589 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 978/1955] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:35:37 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:35:39.087927 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1ec05e-d744-4cd8-8a26-5a4ab27ef572 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:39.091210 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3a1ec05e-d744-4cd8-8a26-5a4ab27ef572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:39.287701 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eed593-4c02-4097-ac06-3683f5b8c9ee service cinder] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:39.307425 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eed593-4c02-4097-ac06-3683f5b8c9ee service cinder] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:39.313999 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1ec05e-d744-4cd8-8a26-5a4ab27ef572 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:39.316124 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b44af9e-3364-4a0c-a94b-711f82ea5b13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:39.318079 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b44af9e-3364-4a0c-a94b-711f82ea5b13 service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:39.318878 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b44af9e-3364-4a0c-a94b-711f82ea5b13 service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:39.319658 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b44af9e-3364-4a0c-a94b-711f82ea5b13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:39.333666 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ee9d53-53d0-4e0f-afc2-7f3506a8ddce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:39.335719 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee9d53-53d0-4e0f-afc2-7f3506a8ddce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:39.336538 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee9d53-53d0-4e0f-afc2-7f3506a8ddce admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:39.337507 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee9d53-53d0-4e0f-afc2-7f3506a8ddce admin admin] PATH_INFO: `/v3/users/4fbaa6b231994fb4bebc045b5f581b74` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:39.341638 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ee9d53-53d0-4e0f-afc2-7f3506a8ddce admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fbaa6b231994fb4bebc045b5f581b74)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:39.352643 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ee9d53-53d0-4e0f-afc2-7f3506a8ddce admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:39.358470 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b44af9e-3364-4a0c-a94b-711f82ea5b13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:39.367864 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b44af9e-3364-4a0c-a94b-711f82ea5b13 service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:39.428643 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 979/1956] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:35:39 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:35:39.544265 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-26ee9d53-53d0-4e0f-afc2-7f3506a8ddce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fbaa6b231994fb4bebc045b5f581b74'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:39.549125 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:39.563116 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-26ee9d53-53d0-4e0f-afc2-7f3506a8ddce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fbaa6b231994fb4bebc045b5f581b74'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:39.563807 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-26ee9d53-53d0-4e0f-afc2-7f3506a8ddce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fbaa6b231994fb4bebc045b5f581b74'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:39.564659 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-26ee9d53-53d0-4e0f-afc2-7f3506a8ddce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fbaa6b231994fb4bebc045b5f581b74'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:39.589327 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-26ee9d53-53d0-4e0f-afc2-7f3506a8ddce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fbaa6b231994fb4bebc045b5f581b74'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:39.633351 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 978/1957] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:35:39 2022] DELETE /identity/v3/users/4fbaa6b231994fb4bebc045b5f581b74 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:39.640232 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc914530-3ce2-4e23-93c0-b9b4522bca92 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:39.641318 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc914530-3ce2-4e23-93c0-b9b4522bca92 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:39.642124 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc914530-3ce2-4e23-93c0-b9b4522bca92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:39.672578 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-dc914530-3ce2-4e23-93c0-b9b4522bca92 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:39.674775 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-dc914530-3ce2-4e23-93c0-b9b4522bca92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:39.746317 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:39.783662 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 980/1958] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:39.793713 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ee9d53-53d0-4e0f-afc2-7f3506a8ddce admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:39.795262 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-26ee9d53-53d0-4e0f-afc2-7f3506a8ddce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:39.869922 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ee9d53-53d0-4e0f-afc2-7f3506a8ddce admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:39.874724 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731387f1-6631-4c1b-bdf4-42d86f58f87a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:39.875501 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731387f1-6631-4c1b-bdf4-42d86f58f87a service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:39.875858 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731387f1-6631-4c1b-bdf4-42d86f58f87a service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:39.876213 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731387f1-6631-4c1b-bdf4-42d86f58f87a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:39.886797 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731387f1-6631-4c1b-bdf4-42d86f58f87a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:39.888388 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731387f1-6631-4c1b-bdf4-42d86f58f87a service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:39.899737 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 979/1959] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:35:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:35:40.227535 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc914530-3ce2-4e23-93c0-b9b4522bca92 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:40.231599 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-dc914530-3ce2-4e23-93c0-b9b4522bca92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:40.248389 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc914530-3ce2-4e23-93c0-b9b4522bca92 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:40.254764 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937229e8-106f-4e0e-bda2-6531553bf462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:40.255667 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937229e8-106f-4e0e-bda2-6531553bf462 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:40.256019 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937229e8-106f-4e0e-bda2-6531553bf462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:40.256212 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937229e8-106f-4e0e-bda2-6531553bf462 admin admin] PATH_INFO: `/v3/projects/896dcea7331d41808d26c7ef8a14775b` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:40.258904 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937229e8-106f-4e0e-bda2-6531553bf462 admin admin] RBAC: Authorizing `identity:delete_project(project_id=896dcea7331d41808d26c7ef8a14775b)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:40.267186 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937229e8-106f-4e0e-bda2-6531553bf462 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:40.329784 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-937229e8-106f-4e0e-bda2-6531553bf462 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '896dcea7331d41808d26c7ef8a14775b', 'request_id': 'req-937229e8-106f-4e0e-bda2-6531553bf462'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:40.338978 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-937229e8-106f-4e0e-bda2-6531553bf462 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '896dcea7331d41808d26c7ef8a14775b', 'request_id': 'req-937229e8-106f-4e0e-bda2-6531553bf462'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:40.348626 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-937229e8-106f-4e0e-bda2-6531553bf462 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '896dcea7331d41808d26c7ef8a14775b', 'request_id': 'req-937229e8-106f-4e0e-bda2-6531553bf462'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:40.370525 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-937229e8-106f-4e0e-bda2-6531553bf462 admin admin] The token cache is being invalidate because project 896dcea7331d41808d26c7ef8a14775b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:35:40.371607 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-937229e8-106f-4e0e-bda2-6531553bf462 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:40.373109 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-937229e8-106f-4e0e-bda2-6531553bf462 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:40.375609 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 981/1960] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:35:40 2022] DELETE /identity/v3/projects/896dcea7331d41808d26c7ef8a14775b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:40.380937 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731387f1-6631-4c1b-bdf4-42d86f58f87a service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:40.392658 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731387f1-6631-4c1b-bdf4-42d86f58f87a service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:40.460915 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7fed01-3f7e-4735-940d-2911c36a0f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:40.463236 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7fed01-3f7e-4735-940d-2911c36a0f02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:40.463735 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7fed01-3f7e-4735-940d-2911c36a0f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:40.464542 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7fed01-3f7e-4735-940d-2911c36a0f02 admin admin] PATH_INFO: `/v3/users/4940c990045f4adab9a17db94864d429` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:40.466245 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7fed01-3f7e-4735-940d-2911c36a0f02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4940c990045f4adab9a17db94864d429)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:40.468593 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7fed01-3f7e-4735-940d-2911c36a0f02 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:40.539300 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0d7fed01-3f7e-4735-940d-2911c36a0f02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4940c990045f4adab9a17db94864d429'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:40.551286 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0d7fed01-3f7e-4735-940d-2911c36a0f02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4940c990045f4adab9a17db94864d429'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:40.552095 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0d7fed01-3f7e-4735-940d-2911c36a0f02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4940c990045f4adab9a17db94864d429'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:40.552752 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0d7fed01-3f7e-4735-940d-2911c36a0f02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4940c990045f4adab9a17db94864d429'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:40.562723 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0d7fed01-3f7e-4735-940d-2911c36a0f02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4940c990045f4adab9a17db94864d429'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:40.574898 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:40.592333 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 980/1961] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:35:40 2022] DELETE /identity/v3/users/4940c990045f4adab9a17db94864d429 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:41.141440 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937229e8-106f-4e0e-bda2-6531553bf462 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:41.144218 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-937229e8-106f-4e0e-bda2-6531553bf462 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:41.183858 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937229e8-106f-4e0e-bda2-6531553bf462 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:41.367946 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f56c2-2e00-421e-8228-d33af3a4cabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:41.369774 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f56c2-2e00-421e-8228-d33af3a4cabb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:41.370300 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f56c2-2e00-421e-8228-d33af3a4cabb admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:41.370839 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f56c2-2e00-421e-8228-d33af3a4cabb admin admin] PATH_INFO: `/v3/projects/54f8304f58924590a5dca48d2579a752` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:41.374480 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f56c2-2e00-421e-8228-d33af3a4cabb admin admin] RBAC: Authorizing `identity:delete_project(project_id=54f8304f58924590a5dca48d2579a752)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:41.391810 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f56c2-2e00-421e-8228-d33af3a4cabb admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:41.464245 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-546f56c2-2e00-421e-8228-d33af3a4cabb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54f8304f58924590a5dca48d2579a752', 'request_id': 'req-546f56c2-2e00-421e-8228-d33af3a4cabb'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:41.481338 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-546f56c2-2e00-421e-8228-d33af3a4cabb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54f8304f58924590a5dca48d2579a752', 'request_id': 'req-546f56c2-2e00-421e-8228-d33af3a4cabb'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:41.492377 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-546f56c2-2e00-421e-8228-d33af3a4cabb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54f8304f58924590a5dca48d2579a752', 'request_id': 'req-546f56c2-2e00-421e-8228-d33af3a4cabb'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:41.497099 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:41.515318 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-546f56c2-2e00-421e-8228-d33af3a4cabb admin admin] The token cache is being invalidate because project 54f8304f58924590a5dca48d2579a752 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:35:41.515645 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-546f56c2-2e00-421e-8228-d33af3a4cabb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:41.516262 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-546f56c2-2e00-421e-8228-d33af3a4cabb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:41.517898 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 982/1962] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:35:41 2022] DELETE /identity/v3/projects/54f8304f58924590a5dca48d2579a752 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:41.523276 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1c4e8-eed3-4951-88c9-087e6c8c7830 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:41.523796 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1c4e8-eed3-4951-88c9-087e6c8c7830 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:41.523963 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1c4e8-eed3-4951-88c9-087e6c8c7830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:41.542845 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-09f1c4e8-eed3-4951-88c9-087e6c8c7830 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:41.543997 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-09f1c4e8-eed3-4951-88c9-087e6c8c7830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:41.606721 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 981/1963] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:35:41.615032 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ebbaa4-9c87-4489-94aa-2f8b0841d2f9 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:41.615318 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ebbaa4-9c87-4489-94aa-2f8b0841d2f9 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:41.615633 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ebbaa4-9c87-4489-94aa-2f8b0841d2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:41.633938 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-44ebbaa4-9c87-4489-94aa-2f8b0841d2f9 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:41.635153 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-44ebbaa4-9c87-4489-94aa-2f8b0841d2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:41.643259 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 983/1964] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:41.647631 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f1c4e8-eed3-4951-88c9-087e6c8c7830 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:41.658076 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f1c4e8-eed3-4951-88c9-087e6c8c7830 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:41.662612 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e9301-006a-47b0-aeed-49da697d2983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:41.663287 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e9301-006a-47b0-aeed-49da697d2983 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:41.663578 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e9301-006a-47b0-aeed-49da697d2983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:41.663855 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e9301-006a-47b0-aeed-49da697d2983 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:41.664582 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0e9301-006a-47b0-aeed-49da697d2983 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:35:41.664918 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0e9301-006a-47b0-aeed-49da697d2983 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:41.666535 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0e9301-006a-47b0-aeed-49da697d2983 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:41.678613 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 982/1965] 10.222.0.16 () {58 vars in 1152 bytes} [Thu May 26 12:35:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:35:41.683131 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ebbaa4-9c87-4489-94aa-2f8b0841d2f9 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:41.692667 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ebbaa4-9c87-4489-94aa-2f8b0841d2f9 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:41.697824 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c2a90d-c6a9-4943-9aaf-41840d99844c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:41.698586 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2a90d-c6a9-4943-9aaf-41840d99844c admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:41.698918 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2a90d-c6a9-4943-9aaf-41840d99844c admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:41.699233 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2a90d-c6a9-4943-9aaf-41840d99844c admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:41.700046 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c2a90d-c6a9-4943-9aaf-41840d99844c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:41.702167 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c2a90d-c6a9-4943-9aaf-41840d99844c admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:41.728710 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 984/1966] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:35:41 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:35:41.733146 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e9301-006a-47b0-aeed-49da697d2983 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:41.744158 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e9301-006a-47b0-aeed-49da697d2983 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:41.824350 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe88b5-1ab8-4bc0-a771-d1f9c4716be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:41.825559 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe88b5-1ab8-4bc0-a771-d1f9c4716be6 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:41.826051 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe88b5-1ab8-4bc0-a771-d1f9c4716be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:41.826721 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe88b5-1ab8-4bc0-a771-d1f9c4716be6 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:41.828392 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffe88b5-1ab8-4bc0-a771-d1f9c4716be6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:41.832131 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffe88b5-1ab8-4bc0-a771-d1f9c4716be6 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:41.868370 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 983/1967] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:35:41 2022] POST /identity/v3/users => generated 290 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:35:41.872356 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c2a90d-c6a9-4943-9aaf-41840d99844c admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:41.887734 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c2a90d-c6a9-4943-9aaf-41840d99844c admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:41.892524 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b8c5ea-73a3-4205-bf2e-5839b27440e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:41.893242 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b8c5ea-73a3-4205-bf2e-5839b27440e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:41.893528 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b8c5ea-73a3-4205-bf2e-5839b27440e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:41.893860 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b8c5ea-73a3-4205-bf2e-5839b27440e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:41.894598 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b8c5ea-73a3-4205-bf2e-5839b27440e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:41.896245 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b8c5ea-73a3-4205-bf2e-5839b27440e9 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:41.912706 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 985/1968] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:35:41 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:35:41.916809 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe88b5-1ab8-4bc0-a771-d1f9c4716be6 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:41.933579 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe88b5-1ab8-4bc0-a771-d1f9c4716be6 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:41.942325 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5637798a-6c7f-431d-ac01-f3c48f50f960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:41.943096 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637798a-6c7f-431d-ac01-f3c48f50f960 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:41.943524 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637798a-6c7f-431d-ac01-f3c48f50f960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:41.943863 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637798a-6c7f-431d-ac01-f3c48f50f960 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:41.944714 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5637798a-6c7f-431d-ac01-f3c48f50f960 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:41.946745 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5637798a-6c7f-431d-ac01-f3c48f50f960 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:41.968862 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 984/1969] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:35:41 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:35:41.970156 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b8c5ea-73a3-4205-bf2e-5839b27440e9 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:41.987762 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b8c5ea-73a3-4205-bf2e-5839b27440e9 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:42.000464 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5619106-08a6-4cad-a30f-7526ed9e1c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:42.001582 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5619106-08a6-4cad-a30f-7526ed9e1c53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:42.001969 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5619106-08a6-4cad-a30f-7526ed9e1c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:42.002345 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5619106-08a6-4cad-a30f-7526ed9e1c53 admin admin] PATH_INFO: `/v3/projects/4d2582fb428d471687d3c31b61f331a7/users/11dcf49559ac47a89535d2836c14a18c/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:42.025823 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5619106-08a6-4cad-a30f-7526ed9e1c53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d2582fb428d471687d3c31b61f331a7, user_id=11dcf49559ac47a89535d2836c14a18c, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:42.033159 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5619106-08a6-4cad-a30f-7526ed9e1c53 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:42.056275 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 986/1970] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:35:41 2022] PUT /identity/v3/projects/4d2582fb428d471687d3c31b61f331a7/users/11dcf49559ac47a89535d2836c14a18c/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:35:42.074558 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a5197-93a2-4933-95cf-945d20146eb1 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:42.075047 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a5197-93a2-4933-95cf-945d20146eb1 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:42.075544 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a5197-93a2-4933-95cf-945d20146eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:42.121660 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-430a5197-93a2-4933-95cf-945d20146eb1 None None] MFA Rules not processed for user `11dcf49559ac47a89535d2836c14a18c`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:42.123769 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-430a5197-93a2-4933-95cf-945d20146eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:42.180432 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:42.209431 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 985/1971] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:42.214025 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5619106-08a6-4cad-a30f-7526ed9e1c53 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:42.297796 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5619106-08a6-4cad-a30f-7526ed9e1c53 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:42.303722 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d85008-20ca-4202-b8f3-67a2ea6c0f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:42.304601 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d85008-20ca-4202-b8f3-67a2ea6c0f9e admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:42.305156 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d85008-20ca-4202-b8f3-67a2ea6c0f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:42.305459 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d85008-20ca-4202-b8f3-67a2ea6c0f9e admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:42.307696 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d85008-20ca-4202-b8f3-67a2ea6c0f9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:42.310243 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d85008-20ca-4202-b8f3-67a2ea6c0f9e admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:42.356594 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 987/1972] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:35:42 2022] POST /identity/v3/projects => generated 379 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:35:42.361561 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a5197-93a2-4933-95cf-945d20146eb1 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:42.375595 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a5197-93a2-4933-95cf-945d20146eb1 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:42.468700 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad061af-e1e2-4e42-80ae-750903d7bc42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:42.469427 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad061af-e1e2-4e42-80ae-750903d7bc42 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:42.469711 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad061af-e1e2-4e42-80ae-750903d7bc42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:42.469991 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad061af-e1e2-4e42-80ae-750903d7bc42 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:42.470921 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad061af-e1e2-4e42-80ae-750903d7bc42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:42.472860 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad061af-e1e2-4e42-80ae-750903d7bc42 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:42.505472 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 986/1973] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:35:42 2022] POST /identity/v3/users => generated 296 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:35:42.509475 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d85008-20ca-4202-b8f3-67a2ea6c0f9e admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:42.527563 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d85008-20ca-4202-b8f3-67a2ea6c0f9e admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:42.532868 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f436ec2-4e3a-4e32-8053-52fc954de9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:42.533624 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f436ec2-4e3a-4e32-8053-52fc954de9e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:42.533920 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f436ec2-4e3a-4e32-8053-52fc954de9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:42.534206 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f436ec2-4e3a-4e32-8053-52fc954de9e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:42.534947 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f436ec2-4e3a-4e32-8053-52fc954de9e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:42.536678 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f436ec2-4e3a-4e32-8053-52fc954de9e1 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:42.550127 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 988/1974] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:35:42 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:35:42.554309 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad061af-e1e2-4e42-80ae-750903d7bc42 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:42.569894 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad061af-e1e2-4e42-80ae-750903d7bc42 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:42.579431 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06731697-5ce3-45f0-bb27-72b2ca3126f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:42.580368 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06731697-5ce3-45f0-bb27-72b2ca3126f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:42.580656 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06731697-5ce3-45f0-bb27-72b2ca3126f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:42.581056 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06731697-5ce3-45f0-bb27-72b2ca3126f9 admin admin] PATH_INFO: `/v3/projects/a8c3ed1c671c4254bd01db9320a5fb57/users/05e4a041eea4416bad903cce24e795c8/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:42.599702 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06731697-5ce3-45f0-bb27-72b2ca3126f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8c3ed1c671c4254bd01db9320a5fb57, user_id=05e4a041eea4416bad903cce24e795c8, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:42.602499 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06731697-5ce3-45f0-bb27-72b2ca3126f9 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:42.620083 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 987/1975] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:35:42 2022] PUT /identity/v3/projects/a8c3ed1c671c4254bd01db9320a5fb57/users/05e4a041eea4416bad903cce24e795c8/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:42.638314 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f436ec2-4e3a-4e32-8053-52fc954de9e1 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:42.646138 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f436ec2-4e3a-4e32-8053-52fc954de9e1 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:42.735729 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e1459-5a99-41eb-99a6-1011efdadfaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:42.736710 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e1459-5a99-41eb-99a6-1011efdadfaa admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:42.737165 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e1459-5a99-41eb-99a6-1011efdadfaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:42.737587 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e1459-5a99-41eb-99a6-1011efdadfaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:42.738753 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6e1459-5a99-41eb-99a6-1011efdadfaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:42.740756 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6e1459-5a99-41eb-99a6-1011efdadfaa admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:42.745532 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:42.773149 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 989/1976] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:35:42 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:35:42.776943 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06731697-5ce3-45f0-bb27-72b2ca3126f9 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:42.795353 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06731697-5ce3-45f0-bb27-72b2ca3126f9 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:42.804303 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4626806d-b508-495c-9103-825cf8ba90d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:42.806045 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626806d-b508-495c-9103-825cf8ba90d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:42.806618 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626806d-b508-495c-9103-825cf8ba90d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:42.807253 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626806d-b508-495c-9103-825cf8ba90d3 admin admin] PATH_INFO: `/v3/projects/a8c3ed1c671c4254bd01db9320a5fb57/users/05e4a041eea4416bad903cce24e795c8/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:42.811125 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4626806d-b508-495c-9103-825cf8ba90d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8c3ed1c671c4254bd01db9320a5fb57, user_id=05e4a041eea4416bad903cce24e795c8, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:42.817744 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4626806d-b508-495c-9103-825cf8ba90d3 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:42.836938 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 988/1977] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:35:42 2022] PUT /identity/v3/projects/a8c3ed1c671c4254bd01db9320a5fb57/users/05e4a041eea4416bad903cce24e795c8/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:42.849977 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc244da-42f1-406e-962b-7f2fc9900e97 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:42.850495 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc244da-42f1-406e-962b-7f2fc9900e97 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:42.851020 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc244da-42f1-406e-962b-7f2fc9900e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:42.928024 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-4fc244da-42f1-406e-962b-7f2fc9900e97 None None] MFA Rules not processed for user `05e4a041eea4416bad903cce24e795c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:42.930389 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-4fc244da-42f1-406e-962b-7f2fc9900e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:43.068394 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 990/1978] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:42 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:35:43.081653 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4626806d-b508-495c-9103-825cf8ba90d3 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:43.083905 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4626806d-b508-495c-9103-825cf8ba90d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:43.166374 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4626806d-b508-495c-9103-825cf8ba90d3 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:43.172983 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f0d7da-9832-407d-b3a9-d088a55f7d5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:43.174129 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0d7da-9832-407d-b3a9-d088a55f7d5d service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:43.174717 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0d7da-9832-407d-b3a9-d088a55f7d5d service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:43.175268 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0d7da-9832-407d-b3a9-d088a55f7d5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:43.190772 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f0d7da-9832-407d-b3a9-d088a55f7d5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:43.193868 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f0d7da-9832-407d-b3a9-d088a55f7d5d service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:43.216978 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 989/1979] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:35:43 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:35:43.303249 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc244da-42f1-406e-962b-7f2fc9900e97 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:43.313838 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc244da-42f1-406e-962b-7f2fc9900e97 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:43.317445 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e60ed-6d66-4bb8-b917-25fb04f36c4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:43.318082 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e60ed-6d66-4bb8-b917-25fb04f36c4f service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:43.318545 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e60ed-6d66-4bb8-b917-25fb04f36c4f service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:43.318824 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e60ed-6d66-4bb8-b917-25fb04f36c4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:43.417798 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402e60ed-6d66-4bb8-b917-25fb04f36c4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:43.419413 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402e60ed-6d66-4bb8-b917-25fb04f36c4f service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:43.437475 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 991/1980] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:35:43 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:35:44.910019 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f0d7da-9832-407d-b3a9-d088a55f7d5d service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:44.911395 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f0f0d7da-9832-407d-b3a9-d088a55f7d5d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:44.973372 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:45.006359 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f0d7da-9832-407d-b3a9-d088a55f7d5d service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:45.013150 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6252ab41-8a9b-46ce-8379-6519b8b6318f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:45.014114 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252ab41-8a9b-46ce-8379-6519b8b6318f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:45.014476 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252ab41-8a9b-46ce-8379-6519b8b6318f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:45.015430 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252ab41-8a9b-46ce-8379-6519b8b6318f admin admin] PATH_INFO: `/v3/users/6afa72b5ed454827886d36261cbef7b7` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:45.016798 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6252ab41-8a9b-46ce-8379-6519b8b6318f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6afa72b5ed454827886d36261cbef7b7)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:45.019199 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6252ab41-8a9b-46ce-8379-6519b8b6318f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:45.087844 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6252ab41-8a9b-46ce-8379-6519b8b6318f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6afa72b5ed454827886d36261cbef7b7'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:45.099722 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6252ab41-8a9b-46ce-8379-6519b8b6318f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6afa72b5ed454827886d36261cbef7b7'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:45.100230 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6252ab41-8a9b-46ce-8379-6519b8b6318f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6afa72b5ed454827886d36261cbef7b7'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:45.101755 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6252ab41-8a9b-46ce-8379-6519b8b6318f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6afa72b5ed454827886d36261cbef7b7'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:45.113986 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6252ab41-8a9b-46ce-8379-6519b8b6318f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6afa72b5ed454827886d36261cbef7b7'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:45.148103 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 990/1981] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:35:44 2022] DELETE /identity/v3/users/6afa72b5ed454827886d36261cbef7b7 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:45.149542 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd626d2c-d1e4-4137-873d-af029ea10df9 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:45.150068 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd626d2c-d1e4-4137-873d-af029ea10df9 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:45.150176 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd626d2c-d1e4-4137-873d-af029ea10df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:45.175591 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-bd626d2c-d1e4-4137-873d-af029ea10df9 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:45.177132 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-bd626d2c-d1e4-4137-873d-af029ea10df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:45.276206 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 992/1982] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:45.284158 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6252ab41-8a9b-46ce-8379-6519b8b6318f admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:45.285697 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6252ab41-8a9b-46ce-8379-6519b8b6318f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:45.364677 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6252ab41-8a9b-46ce-8379-6519b8b6318f admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:45.368603 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af949908-e9eb-4ced-b9d9-9c4262ba990e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:45.369367 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af949908-e9eb-4ced-b9d9-9c4262ba990e service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:45.369663 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af949908-e9eb-4ced-b9d9-9c4262ba990e service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:45.369942 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af949908-e9eb-4ced-b9d9-9c4262ba990e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:45.382370 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af949908-e9eb-4ced-b9d9-9c4262ba990e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:45.384065 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af949908-e9eb-4ced-b9d9-9c4262ba990e service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:45.399633 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 991/1983] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:35:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:35:45.802217 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd626d2c-d1e4-4137-873d-af029ea10df9 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:45.803872 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-bd626d2c-d1e4-4137-873d-af029ea10df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:45.821066 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd626d2c-d1e4-4137-873d-af029ea10df9 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:45.828706 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832ea6af-441a-4657-a1f8-1c3a46eb4445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:45.829663 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ea6af-441a-4657-a1f8-1c3a46eb4445 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:45.829901 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ea6af-441a-4657-a1f8-1c3a46eb4445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:45.830242 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ea6af-441a-4657-a1f8-1c3a46eb4445 admin admin] PATH_INFO: `/v3/projects/593d91cccc6e4ad194d0cd6c5f112b21` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:45.831622 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832ea6af-441a-4657-a1f8-1c3a46eb4445 admin admin] RBAC: Authorizing `identity:delete_project(project_id=593d91cccc6e4ad194d0cd6c5f112b21)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:45.833617 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832ea6af-441a-4657-a1f8-1c3a46eb4445 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:45.852217 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:45.884807 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-832ea6af-441a-4657-a1f8-1c3a46eb4445 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '593d91cccc6e4ad194d0cd6c5f112b21', 'request_id': 'req-832ea6af-441a-4657-a1f8-1c3a46eb4445'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:45.894777 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-832ea6af-441a-4657-a1f8-1c3a46eb4445 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '593d91cccc6e4ad194d0cd6c5f112b21', 'request_id': 'req-832ea6af-441a-4657-a1f8-1c3a46eb4445'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:45.902777 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-832ea6af-441a-4657-a1f8-1c3a46eb4445 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '593d91cccc6e4ad194d0cd6c5f112b21', 'request_id': 'req-832ea6af-441a-4657-a1f8-1c3a46eb4445'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:45.915539 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-832ea6af-441a-4657-a1f8-1c3a46eb4445 admin admin] The token cache is being invalidate because project 593d91cccc6e4ad194d0cd6c5f112b21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:35:45.915539 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-832ea6af-441a-4657-a1f8-1c3a46eb4445 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:45.916127 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-832ea6af-441a-4657-a1f8-1c3a46eb4445 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:45.917756 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 993/1984] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:35:45 2022] DELETE /identity/v3/projects/593d91cccc6e4ad194d0cd6c5f112b21 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:45.922414 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af949908-e9eb-4ced-b9d9-9c4262ba990e service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:45.932511 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af949908-e9eb-4ced-b9d9-9c4262ba990e service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:45.999539 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e9cc1-a5d6-48a1-87f8-b76aebcc33f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:46.000444 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e9cc1-a5d6-48a1-87f8-b76aebcc33f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:46.000735 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e9cc1-a5d6-48a1-87f8-b76aebcc33f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:46.001153 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e9cc1-a5d6-48a1-87f8-b76aebcc33f6 admin admin] PATH_INFO: `/v3/users/bed4665805a547949cd22984d340b5e3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:46.002750 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851e9cc1-a5d6-48a1-87f8-b76aebcc33f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bed4665805a547949cd22984d340b5e3)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:46.005224 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851e9cc1-a5d6-48a1-87f8-b76aebcc33f6 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:46.012708 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:46.064822 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-851e9cc1-a5d6-48a1-87f8-b76aebcc33f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bed4665805a547949cd22984d340b5e3'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:46.074013 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-851e9cc1-a5d6-48a1-87f8-b76aebcc33f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bed4665805a547949cd22984d340b5e3'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:46.074806 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-851e9cc1-a5d6-48a1-87f8-b76aebcc33f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bed4665805a547949cd22984d340b5e3'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:46.075640 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-851e9cc1-a5d6-48a1-87f8-b76aebcc33f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bed4665805a547949cd22984d340b5e3'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:46.085653 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-851e9cc1-a5d6-48a1-87f8-b76aebcc33f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bed4665805a547949cd22984d340b5e3'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:46.115797 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 992/1985] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:35:45 2022] DELETE /identity/v3/users/bed4665805a547949cd22984d340b5e3 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:46.785273 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832ea6af-441a-4657-a1f8-1c3a46eb4445 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:46.786925 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-832ea6af-441a-4657-a1f8-1c3a46eb4445 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:46.802139 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832ea6af-441a-4657-a1f8-1c3a46eb4445 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:46.866572 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea42e2-ba95-4701-a5ff-5e79e6a7ab6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:46.867402 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea42e2-ba95-4701-a5ff-5e79e6a7ab6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:46.867681 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea42e2-ba95-4701-a5ff-5e79e6a7ab6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:46.867962 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea42e2-ba95-4701-a5ff-5e79e6a7ab6c admin admin] PATH_INFO: `/v3/projects/469fc05acb8f4f1c8b753f0c9daa0aee` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:46.869237 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbea42e2-ba95-4701-a5ff-5e79e6a7ab6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=469fc05acb8f4f1c8b753f0c9daa0aee)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:46.871237 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbea42e2-ba95-4701-a5ff-5e79e6a7ab6c admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:46.921900 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-fbea42e2-ba95-4701-a5ff-5e79e6a7ab6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '469fc05acb8f4f1c8b753f0c9daa0aee', 'request_id': 'req-fbea42e2-ba95-4701-a5ff-5e79e6a7ab6c'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:46.932253 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-fbea42e2-ba95-4701-a5ff-5e79e6a7ab6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '469fc05acb8f4f1c8b753f0c9daa0aee', 'request_id': 'req-fbea42e2-ba95-4701-a5ff-5e79e6a7ab6c'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:46.939865 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-fbea42e2-ba95-4701-a5ff-5e79e6a7ab6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '469fc05acb8f4f1c8b753f0c9daa0aee', 'request_id': 'req-fbea42e2-ba95-4701-a5ff-5e79e6a7ab6c'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:46.952665 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-fbea42e2-ba95-4701-a5ff-5e79e6a7ab6c admin admin] The token cache is being invalidate because project 469fc05acb8f4f1c8b753f0c9daa0aee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:35:46.952978 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-fbea42e2-ba95-4701-a5ff-5e79e6a7ab6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:46.953883 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-fbea42e2-ba95-4701-a5ff-5e79e6a7ab6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:46.955554 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 994/1986] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:35:46 2022] DELETE /identity/v3/projects/469fc05acb8f4f1c8b753f0c9daa0aee => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:46.960755 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8bbdd-3df6-4516-b294-0c1b8dec59ac None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:46.961327 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8bbdd-3df6-4516-b294-0c1b8dec59ac None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:46.961522 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8bbdd-3df6-4516-b294-0c1b8dec59ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:46.982543 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-e9f8bbdd-3df6-4516-b294-0c1b8dec59ac None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:46.984359 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e9f8bbdd-3df6-4516-b294-0c1b8dec59ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:47.048666 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 993/1987] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:35:47.057205 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee5e2d-0f36-4b0e-a9af-960dbd05b069 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:47.057500 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee5e2d-0f36-4b0e-a9af-960dbd05b069 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:47.057821 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee5e2d-0f36-4b0e-a9af-960dbd05b069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:47.078555 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-24ee5e2d-0f36-4b0e-a9af-960dbd05b069 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:47.079950 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-24ee5e2d-0f36-4b0e-a9af-960dbd05b069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:47.088586 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 995/1988] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:47.093499 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8bbdd-3df6-4516-b294-0c1b8dec59ac None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:47.104456 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8bbdd-3df6-4516-b294-0c1b8dec59ac None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:47.109704 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30514b99-bd36-4904-abc4-022d8cb307f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:47.110360 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30514b99-bd36-4904-abc4-022d8cb307f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:47.110642 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30514b99-bd36-4904-abc4-022d8cb307f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:47.110916 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30514b99-bd36-4904-abc4-022d8cb307f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:47.111636 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30514b99-bd36-4904-abc4-022d8cb307f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:35:47.111992 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30514b99-bd36-4904-abc4-022d8cb307f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:47.113638 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30514b99-bd36-4904-abc4-022d8cb307f3 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:47.129226 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 994/1989] 10.222.0.16 () {58 vars in 1152 bytes} [Thu May 26 12:35:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:35:47.130409 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee5e2d-0f36-4b0e-a9af-960dbd05b069 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:47.140273 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee5e2d-0f36-4b0e-a9af-960dbd05b069 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:47.145173 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a638eb-2a00-4235-bc9c-31e841f24da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:47.145824 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a638eb-2a00-4235-bc9c-31e841f24da4 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:47.146109 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a638eb-2a00-4235-bc9c-31e841f24da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:47.146386 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a638eb-2a00-4235-bc9c-31e841f24da4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:47.147076 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a638eb-2a00-4235-bc9c-31e841f24da4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:47.149059 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a638eb-2a00-4235-bc9c-31e841f24da4 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:47.180812 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30514b99-bd36-4904-abc4-022d8cb307f3 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:47.181524 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 996/1990] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:35:47 2022] POST /identity/v3/projects => generated 387 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:35:47.192689 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30514b99-bd36-4904-abc4-022d8cb307f3 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:47.270359 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8a1b0-ca83-4b8b-9f51-da2b2d948f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:47.275692 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8a1b0-ca83-4b8b-9f51-da2b2d948f12 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:47.276164 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8a1b0-ca83-4b8b-9f51-da2b2d948f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:47.276606 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8a1b0-ca83-4b8b-9f51-da2b2d948f12 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:47.277569 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da8a1b0-ca83-4b8b-9f51-da2b2d948f12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:47.280148 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da8a1b0-ca83-4b8b-9f51-da2b2d948f12 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:47.303833 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:47.317601 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 995/1991] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:35:47 2022] POST /identity/v3/users => generated 294 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:35:47.321485 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a638eb-2a00-4235-bc9c-31e841f24da4 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:47.332303 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a638eb-2a00-4235-bc9c-31e841f24da4 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:47.338211 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f705f38-9bb6-456c-85bc-730d6741ef1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:47.338869 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f705f38-9bb6-456c-85bc-730d6741ef1d admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:47.339358 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f705f38-9bb6-456c-85bc-730d6741ef1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:47.339639 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f705f38-9bb6-456c-85bc-730d6741ef1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:47.340367 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f705f38-9bb6-456c-85bc-730d6741ef1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:47.342586 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f705f38-9bb6-456c-85bc-730d6741ef1d admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:47.345015 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:47.359931 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 997/1992] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:35:47.363611 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8a1b0-ca83-4b8b-9f51-da2b2d948f12 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:47.374488 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8a1b0-ca83-4b8b-9f51-da2b2d948f12 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:47.383150 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e7a310-7ecd-45f6-a430-8d8f6ede2efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:47.383907 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e7a310-7ecd-45f6-a430-8d8f6ede2efa admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:47.384198 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e7a310-7ecd-45f6-a430-8d8f6ede2efa admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:47.384480 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e7a310-7ecd-45f6-a430-8d8f6ede2efa admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:47.385331 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e7a310-7ecd-45f6-a430-8d8f6ede2efa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:47.387010 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e7a310-7ecd-45f6-a430-8d8f6ede2efa admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:47.398563 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 996/1993] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:35:47.402948 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f705f38-9bb6-456c-85bc-730d6741ef1d admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:47.415018 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f705f38-9bb6-456c-85bc-730d6741ef1d admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:47.419945 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401066c3-18ac-4387-a7a5-a79bea0f7fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:47.421516 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401066c3-18ac-4387-a7a5-a79bea0f7fe0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:47.421873 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401066c3-18ac-4387-a7a5-a79bea0f7fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:47.422214 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401066c3-18ac-4387-a7a5-a79bea0f7fe0 admin admin] PATH_INFO: `/v3/projects/c5e1d0403a7a468390b7fdacba35dcf4/users/39a09721236e457ca23f276a3e936002/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:47.441277 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401066c3-18ac-4387-a7a5-a79bea0f7fe0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5e1d0403a7a468390b7fdacba35dcf4, user_id=39a09721236e457ca23f276a3e936002, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:47.447179 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401066c3-18ac-4387-a7a5-a79bea0f7fe0 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:47.462559 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 998/1994] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:35:47 2022] PUT /identity/v3/projects/c5e1d0403a7a468390b7fdacba35dcf4/users/39a09721236e457ca23f276a3e936002/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:47.474528 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894bce7-7804-4ae3-8487-43c2b7944011 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:47.474946 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894bce7-7804-4ae3-8487-43c2b7944011 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:47.475303 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894bce7-7804-4ae3-8487-43c2b7944011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:47.508049 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d894bce7-7804-4ae3-8487-43c2b7944011 None None] MFA Rules not processed for user `39a09721236e457ca23f276a3e936002`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:47.509675 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d894bce7-7804-4ae3-8487-43c2b7944011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:47.598252 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 997/1995] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:47.601714 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401066c3-18ac-4387-a7a5-a79bea0f7fe0 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:47.765490 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401066c3-18ac-4387-a7a5-a79bea0f7fe0 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:47.780493 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa162d17-ca2c-4320-b2ca-4248be2b03d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:47.781271 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa162d17-ca2c-4320-b2ca-4248be2b03d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:47.781683 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa162d17-ca2c-4320-b2ca-4248be2b03d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:47.782068 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa162d17-ca2c-4320-b2ca-4248be2b03d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:47.782890 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa162d17-ca2c-4320-b2ca-4248be2b03d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:47.786585 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa162d17-ca2c-4320-b2ca-4248be2b03d2 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:47.833053 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 999/1996] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:35:47 2022] POST /identity/v3/projects => generated 387 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:35:47.834470 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894bce7-7804-4ae3-8487-43c2b7944011 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:47.848823 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894bce7-7804-4ae3-8487-43c2b7944011 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:48.011023 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f519046e-c80e-44d2-87d3-fa1085b7ceaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:48.011847 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519046e-c80e-44d2-87d3-fa1085b7ceaa admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:48.012134 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519046e-c80e-44d2-87d3-fa1085b7ceaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:48.012411 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519046e-c80e-44d2-87d3-fa1085b7ceaa admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:48.013140 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f519046e-c80e-44d2-87d3-fa1085b7ceaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:48.019953 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f519046e-c80e-44d2-87d3-fa1085b7ceaa admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:48.059358 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 998/1997] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:35:47 2022] POST /identity/v3/users => generated 300 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:35:48.063979 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa162d17-ca2c-4320-b2ca-4248be2b03d2 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:48.082016 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa162d17-ca2c-4320-b2ca-4248be2b03d2 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:48.098505 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0058118b-57c6-4f9c-8473-ec253b5a3acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:48.099328 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0058118b-57c6-4f9c-8473-ec253b5a3acc admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:48.099712 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0058118b-57c6-4f9c-8473-ec253b5a3acc admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:48.100160 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0058118b-57c6-4f9c-8473-ec253b5a3acc admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:48.101600 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0058118b-57c6-4f9c-8473-ec253b5a3acc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:48.104967 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0058118b-57c6-4f9c-8473-ec253b5a3acc admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:48.129768 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1000/1998] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:35:48.134150 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f519046e-c80e-44d2-87d3-fa1085b7ceaa admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:48.153531 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f519046e-c80e-44d2-87d3-fa1085b7ceaa admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:48.163884 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ac8f3-a0cf-4d26-8c0e-17a4c1298e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:48.165553 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ac8f3-a0cf-4d26-8c0e-17a4c1298e3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:48.166088 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ac8f3-a0cf-4d26-8c0e-17a4c1298e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:48.167498 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ac8f3-a0cf-4d26-8c0e-17a4c1298e3b admin admin] PATH_INFO: `/v3/projects/d6b5871331aa4efbb1e75480c03e20ba/users/76e6b332a6d04e5fa72c5b9512cf9757/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:48.197974 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8ac8f3-a0cf-4d26-8c0e-17a4c1298e3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6b5871331aa4efbb1e75480c03e20ba, user_id=76e6b332a6d04e5fa72c5b9512cf9757, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:48.200716 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8ac8f3-a0cf-4d26-8c0e-17a4c1298e3b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:48.237882 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 999/1999] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:35:48 2022] PUT /identity/v3/projects/d6b5871331aa4efbb1e75480c03e20ba/users/76e6b332a6d04e5fa72c5b9512cf9757/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:35:48.242259 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0058118b-57c6-4f9c-8473-ec253b5a3acc admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:48.258888 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0058118b-57c6-4f9c-8473-ec253b5a3acc admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:48.433693 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be257226-ada0-47b2-9049-9872300b9289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:48.434728 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be257226-ada0-47b2-9049-9872300b9289 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:48.435301 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be257226-ada0-47b2-9049-9872300b9289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:48.435828 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be257226-ada0-47b2-9049-9872300b9289 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:48.437111 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be257226-ada0-47b2-9049-9872300b9289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:48.440203 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be257226-ada0-47b2-9049-9872300b9289 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:48.459772 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1001/2000] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:35:48.465286 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ac8f3-a0cf-4d26-8c0e-17a4c1298e3b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:48.495993 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ac8f3-a0cf-4d26-8c0e-17a4c1298e3b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:48.507561 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe28f6e-b2a2-45a0-80cb-ad682d2df0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:48.508545 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe28f6e-b2a2-45a0-80cb-ad682d2df0b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:48.508866 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe28f6e-b2a2-45a0-80cb-ad682d2df0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:48.509209 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe28f6e-b2a2-45a0-80cb-ad682d2df0b6 admin admin] PATH_INFO: `/v3/projects/d6b5871331aa4efbb1e75480c03e20ba/users/76e6b332a6d04e5fa72c5b9512cf9757/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:48.511501 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe28f6e-b2a2-45a0-80cb-ad682d2df0b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6b5871331aa4efbb1e75480c03e20ba, user_id=76e6b332a6d04e5fa72c5b9512cf9757, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:48.514542 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe28f6e-b2a2-45a0-80cb-ad682d2df0b6 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:48.536967 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1000/2001] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:35:48 2022] PUT /identity/v3/projects/d6b5871331aa4efbb1e75480c03e20ba/users/76e6b332a6d04e5fa72c5b9512cf9757/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:48.545593 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb6928-dca5-42fc-a4b6-a7bbaf3a38f8 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:48.546492 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb6928-dca5-42fc-a4b6-a7bbaf3a38f8 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:48.546863 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb6928-dca5-42fc-a4b6-a7bbaf3a38f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:48.599099 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-18bb6928-dca5-42fc-a4b6-a7bbaf3a38f8 None None] MFA Rules not processed for user `76e6b332a6d04e5fa72c5b9512cf9757`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:48.601342 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-18bb6928-dca5-42fc-a4b6-a7bbaf3a38f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:48.648780 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:48.697647 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1002/2002] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:48 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:48.709753 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe28f6e-b2a2-45a0-80cb-ad682d2df0b6 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:48.711435 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5fe28f6e-b2a2-45a0-80cb-ad682d2df0b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:48.752890 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:48.783191 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe28f6e-b2a2-45a0-80cb-ad682d2df0b6 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:48.786932 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e63c51-022b-4b81-ba72-26697b58efb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:48.787652 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e63c51-022b-4b81-ba72-26697b58efb6 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:48.788010 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e63c51-022b-4b81-ba72-26697b58efb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:48.788356 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e63c51-022b-4b81-ba72-26697b58efb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:48.798680 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e63c51-022b-4b81-ba72-26697b58efb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:48.800326 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e63c51-022b-4b81-ba72-26697b58efb6 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:48.810581 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1001/2003] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:35:48 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:35:48.885888 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb6928-dca5-42fc-a4b6-a7bbaf3a38f8 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:48.898766 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45447e42-6714-474f-970c-b61d0c51db0c None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:48.899690 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45447e42-6714-474f-970c-b61d0c51db0c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:48.900543 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45447e42-6714-474f-970c-b61d0c51db0c None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:48.903050 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1002/2004] 10.222.0.16 () {54 vars in 921 bytes} [Thu May 26 12:35:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:35:48.914185 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937d707-09f3-4103-814a-e87b5605ae2a None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:48.914589 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937d707-09f3-4103-814a-e87b5605ae2a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:48.914796 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937d707-09f3-4103-814a-e87b5605ae2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:48.945607 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-0937d707-09f3-4103-814a-e87b5605ae2a None None] MFA Rules not processed for user `4327435c97834afeb7e6806ef02349a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:48.945607 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0937d707-09f3-4103-814a-e87b5605ae2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:49.000255 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb6928-dca5-42fc-a4b6-a7bbaf3a38f8 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:49.005758 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330ee9b5-b6f1-4baf-ba5f-67d48ac2744b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:49.008294 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ee9b5-b6f1-4baf-ba5f-67d48ac2744b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:49.008879 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ee9b5-b6f1-4baf-ba5f-67d48ac2744b admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:49.009302 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ee9b5-b6f1-4baf-ba5f-67d48ac2744b admin admin] PATH_INFO: `/v3/users/39a09721236e457ca23f276a3e936002` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:49.010758 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330ee9b5-b6f1-4baf-ba5f-67d48ac2744b admin admin] RBAC: Authorizing `identity:delete_user(user_id=39a09721236e457ca23f276a3e936002)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:49.013342 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330ee9b5-b6f1-4baf-ba5f-67d48ac2744b admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:49.031615 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1003/2005] 10.222.0.16 () {58 vars in 1018 bytes} [Thu May 26 12:35:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:49.032479 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937d707-09f3-4103-814a-e87b5605ae2a None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:49.034026 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0937d707-09f3-4103-814a-e87b5605ae2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:49.047903 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937d707-09f3-4103-814a-e87b5605ae2a None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:49.052989 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d643f9d1-b010-412d-a0ea-1561f8822d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:49.054039 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643f9d1-b010-412d-a0ea-1561f8822d3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:49.054609 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643f9d1-b010-412d-a0ea-1561f8822d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:49.054891 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643f9d1-b010-412d-a0ea-1561f8822d3d admin admin] PATH_INFO: `/v3/users/5c584ad0964543cd87c4a0b06bda428f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:49.056375 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d643f9d1-b010-412d-a0ea-1561f8822d3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c584ad0964543cd87c4a0b06bda428f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:49.058365 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d643f9d1-b010-412d-a0ea-1561f8822d3d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:49.069775 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-330ee9b5-b6f1-4baf-ba5f-67d48ac2744b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39a09721236e457ca23f276a3e936002'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:49.070527 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-330ee9b5-b6f1-4baf-ba5f-67d48ac2744b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39a09721236e457ca23f276a3e936002'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:49.071219 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-330ee9b5-b6f1-4baf-ba5f-67d48ac2744b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39a09721236e457ca23f276a3e936002'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:49.079310 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-330ee9b5-b6f1-4baf-ba5f-67d48ac2744b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39a09721236e457ca23f276a3e936002'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:49.092175 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-330ee9b5-b6f1-4baf-ba5f-67d48ac2744b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39a09721236e457ca23f276a3e936002'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:49.107988 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1003/2006] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:35:48 2022] DELETE /identity/v3/users/39a09721236e457ca23f276a3e936002 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:49.110107 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d643f9d1-b010-412d-a0ea-1561f8822d3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c584ad0964543cd87c4a0b06bda428f'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:49.112103 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330ee9b5-b6f1-4baf-ba5f-67d48ac2744b admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:49.113525 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-330ee9b5-b6f1-4baf-ba5f-67d48ac2744b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:49.119650 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d643f9d1-b010-412d-a0ea-1561f8822d3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c584ad0964543cd87c4a0b06bda428f'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:49.120297 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d643f9d1-b010-412d-a0ea-1561f8822d3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c584ad0964543cd87c4a0b06bda428f'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:49.120947 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d643f9d1-b010-412d-a0ea-1561f8822d3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c584ad0964543cd87c4a0b06bda428f'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:49.128589 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d643f9d1-b010-412d-a0ea-1561f8822d3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c584ad0964543cd87c4a0b06bda428f'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:49.154225 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1004/2007] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:35:49 2022] DELETE /identity/v3/users/5c584ad0964543cd87c4a0b06bda428f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:49.171570 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51b8c9-b069-4940-bbf1-99f741ea3d5c None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:49.171570 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51b8c9-b069-4940-bbf1-99f741ea3d5c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:49.171570 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51b8c9-b069-4940-bbf1-99f741ea3d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:49.199426 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:49.200383 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-0f51b8c9-b069-4940-bbf1-99f741ea3d5c None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:49.201971 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0f51b8c9-b069-4940-bbf1-99f741ea3d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:49.232124 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330ee9b5-b6f1-4baf-ba5f-67d48ac2744b admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:49.262768 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:49.301037 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1005/2008] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:49.309778 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51b8c9-b069-4940-bbf1-99f741ea3d5c None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:49.312427 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0f51b8c9-b069-4940-bbf1-99f741ea3d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:49.328109 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf26ed5-f7c4-4e75-a904-33328cda298c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4327435c97834afeb7e6806ef02349a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:49.329075 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf26ed5-f7c4-4e75-a904-33328cda298c service placement] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:49.329530 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf26ed5-f7c4-4e75-a904-33328cda298c service placement] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:49.329954 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf26ed5-f7c4-4e75-a904-33328cda298c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:49.332126 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-9cf26ed5-f7c4-4e75-a904-33328cda298c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:49.346701 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf26ed5-f7c4-4e75-a904-33328cda298c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:49.348731 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf26ed5-f7c4-4e75-a904-33328cda298c service placement] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:49.360242 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1004/2009] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:35:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:35:49.386272 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51b8c9-b069-4940-bbf1-99f741ea3d5c None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:49.394387 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c21ca64-8262-499b-bb9e-6dd70163fe39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:49.395085 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21ca64-8262-499b-bb9e-6dd70163fe39 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:49.395362 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21ca64-8262-499b-bb9e-6dd70163fe39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:49.395634 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21ca64-8262-499b-bb9e-6dd70163fe39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:49.410037 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c21ca64-8262-499b-bb9e-6dd70163fe39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:49.410037 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c21ca64-8262-499b-bb9e-6dd70163fe39 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:49.424790 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1006/2010] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:35:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:35:49.475901 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf26ed5-f7c4-4e75-a904-33328cda298c service placement] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:49.477613 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-9cf26ed5-f7c4-4e75-a904-33328cda298c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:49.493620 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf26ed5-f7c4-4e75-a904-33328cda298c service placement] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:49.501256 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9bd0a-0595-4440-a0e5-953a71a2b1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:49.502221 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9bd0a-0595-4440-a0e5-953a71a2b1bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:49.503954 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9bd0a-0595-4440-a0e5-953a71a2b1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:49.504261 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9bd0a-0595-4440-a0e5-953a71a2b1bf admin admin] PATH_INFO: `/v3/projects/d2884d300c214cf5b73eecf63296373e` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:49.514140 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf9bd0a-0595-4440-a0e5-953a71a2b1bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2884d300c214cf5b73eecf63296373e)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:49.523116 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf9bd0a-0595-4440-a0e5-953a71a2b1bf admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:49.596451 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-adf9bd0a-0595-4440-a0e5-953a71a2b1bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2884d300c214cf5b73eecf63296373e', 'request_id': 'req-adf9bd0a-0595-4440-a0e5-953a71a2b1bf'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:49.606841 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-adf9bd0a-0595-4440-a0e5-953a71a2b1bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2884d300c214cf5b73eecf63296373e', 'request_id': 'req-adf9bd0a-0595-4440-a0e5-953a71a2b1bf'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:49.615195 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-adf9bd0a-0595-4440-a0e5-953a71a2b1bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2884d300c214cf5b73eecf63296373e', 'request_id': 'req-adf9bd0a-0595-4440-a0e5-953a71a2b1bf'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:49.629245 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-adf9bd0a-0595-4440-a0e5-953a71a2b1bf admin admin] The token cache is being invalidate because project d2884d300c214cf5b73eecf63296373e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:35:49.629603 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-adf9bd0a-0595-4440-a0e5-953a71a2b1bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:49.630424 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-adf9bd0a-0595-4440-a0e5-953a71a2b1bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:49.632489 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1005/2011] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:35:49 2022] DELETE /identity/v3/projects/d2884d300c214cf5b73eecf63296373e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:49.637286 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2f7d4-4674-42a2-899b-1fcdd029d796 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:49.637767 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2f7d4-4674-42a2-899b-1fcdd029d796 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:49.638188 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2f7d4-4674-42a2-899b-1fcdd029d796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:49.662137 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-aea2f7d4-4674-42a2-899b-1fcdd029d796 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:49.663363 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-aea2f7d4-4674-42a2-899b-1fcdd029d796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:49.729122 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1007/2012] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:49.737778 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22349ea5-c1d8-4d33-8fbc-42baea78be1c None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:49.738090 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22349ea5-c1d8-4d33-8fbc-42baea78be1c None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:49.738370 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22349ea5-c1d8-4d33-8fbc-42baea78be1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:49.763322 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-22349ea5-c1d8-4d33-8fbc-42baea78be1c None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:49.764143 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-22349ea5-c1d8-4d33-8fbc-42baea78be1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:49.774719 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1006/2013] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:49.779204 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2f7d4-4674-42a2-899b-1fcdd029d796 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:49.795915 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2f7d4-4674-42a2-899b-1fcdd029d796 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:49.804207 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7009eab1-6f48-4131-9ec1-bae609212562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:49.805266 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22349ea5-c1d8-4d33-8fbc-42baea78be1c None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:49.805897 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009eab1-6f48-4131-9ec1-bae609212562 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:49.806548 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009eab1-6f48-4131-9ec1-bae609212562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:49.806947 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-22349ea5-c1d8-4d33-8fbc-42baea78be1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:49.807121 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009eab1-6f48-4131-9ec1-bae609212562 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:49.808158 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7009eab1-6f48-4131-9ec1-bae609212562 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:35:49.808551 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7009eab1-6f48-4131-9ec1-bae609212562 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:49.811818 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7009eab1-6f48-4131-9ec1-bae609212562 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:49.830760 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22349ea5-c1d8-4d33-8fbc-42baea78be1c None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:49.845591 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1008/2014] 10.222.0.16 () {58 vars in 1152 bytes} [Thu May 26 12:35:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:35:49.847591 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823344d-777a-4551-a63c-8ce83d0c175b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:49.848700 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823344d-777a-4551-a63c-8ce83d0c175b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:49.849896 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823344d-777a-4551-a63c-8ce83d0c175b admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:49.850157 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823344d-777a-4551-a63c-8ce83d0c175b admin admin] PATH_INFO: `/v3/projects/c5e1d0403a7a468390b7fdacba35dcf4` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:49.852980 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7009eab1-6f48-4131-9ec1-bae609212562 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:49.853113 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7823344d-777a-4551-a63c-8ce83d0c175b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5e1d0403a7a468390b7fdacba35dcf4)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:49.854155 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7823344d-777a-4551-a63c-8ce83d0c175b admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:49.865515 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7009eab1-6f48-4131-9ec1-bae609212562 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:49.870964 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d29f8-6ce5-472f-8564-60b115e38fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:49.871716 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d29f8-6ce5-472f-8564-60b115e38fc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:49.872001 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d29f8-6ce5-472f-8564-60b115e38fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:49.872274 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d29f8-6ce5-472f-8564-60b115e38fc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:49.873004 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56d29f8-6ce5-472f-8564-60b115e38fc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:49.879195 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56d29f8-6ce5-472f-8564-60b115e38fc9 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:49.912753 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-7823344d-777a-4551-a63c-8ce83d0c175b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5e1d0403a7a468390b7fdacba35dcf4', 'request_id': 'req-7823344d-777a-4551-a63c-8ce83d0c175b'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:49.914019 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1009/2015] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:35:49 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:35:49.914522 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:49.918383 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d29f8-6ce5-472f-8564-60b115e38fc9 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:49.922274 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-7823344d-777a-4551-a63c-8ce83d0c175b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5e1d0403a7a468390b7fdacba35dcf4', 'request_id': 'req-7823344d-777a-4551-a63c-8ce83d0c175b'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:49.930280 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-7823344d-777a-4551-a63c-8ce83d0c175b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5e1d0403a7a468390b7fdacba35dcf4', 'request_id': 'req-7823344d-777a-4551-a63c-8ce83d0c175b'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:49.942701 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-7823344d-777a-4551-a63c-8ce83d0c175b admin admin] The token cache is being invalidate because project c5e1d0403a7a468390b7fdacba35dcf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:35:49.943158 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-7823344d-777a-4551-a63c-8ce83d0c175b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:49.944522 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-7823344d-777a-4551-a63c-8ce83d0c175b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:49.947984 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1007/2016] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:35:49 2022] DELETE /identity/v3/projects/c5e1d0403a7a468390b7fdacba35dcf4 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:35:49.951079 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823344d-777a-4551-a63c-8ce83d0c175b admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:49.952461 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-7823344d-777a-4551-a63c-8ce83d0c175b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:49.983543 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:50.000793 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d29f8-6ce5-472f-8564-60b115e38fc9 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:50.005775 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f93fb-6456-4901-869c-3485efbec0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:50.006579 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f93fb-6456-4901-869c-3485efbec0ca admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:50.006924 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f93fb-6456-4901-869c-3485efbec0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:50.007276 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f93fb-6456-4901-869c-3485efbec0ca admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:50.008046 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06f93fb-6456-4901-869c-3485efbec0ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:50.010092 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06f93fb-6456-4901-869c-3485efbec0ca admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:50.032787 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1010/2017] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:35:49 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:35:50.034023 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823344d-777a-4551-a63c-8ce83d0c175b admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:50.036831 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f93fb-6456-4901-869c-3485efbec0ca admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:50.038450 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f06f93fb-6456-4901-869c-3485efbec0ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:50.040994 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6706aea9-924d-4ca3-a5f1-6ef9adbd3da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:50.042205 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706aea9-924d-4ca3-a5f1-6ef9adbd3da1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:50.042545 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706aea9-924d-4ca3-a5f1-6ef9adbd3da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:50.042899 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706aea9-924d-4ca3-a5f1-6ef9adbd3da1 admin admin] PATH_INFO: `/v3/users/76e6b332a6d04e5fa72c5b9512cf9757` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:50.044442 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6706aea9-924d-4ca3-a5f1-6ef9adbd3da1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76e6b332a6d04e5fa72c5b9512cf9757)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:50.047291 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6706aea9-924d-4ca3-a5f1-6ef9adbd3da1 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:50.053001 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f93fb-6456-4901-869c-3485efbec0ca admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:50.056411 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27441faf-5bd8-472f-a371-7121069a8395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:50.057130 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27441faf-5bd8-472f-a371-7121069a8395 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:50.057486 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27441faf-5bd8-472f-a371-7121069a8395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:50.057756 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27441faf-5bd8-472f-a371-7121069a8395 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:50.058488 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27441faf-5bd8-472f-a371-7121069a8395 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:50.060141 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27441faf-5bd8-472f-a371-7121069a8395 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:50.071022 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1011/2018] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:35:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:35:50.075390 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27441faf-5bd8-472f-a371-7121069a8395 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:50.087471 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27441faf-5bd8-472f-a371-7121069a8395 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:50.092257 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d7116-7fce-4827-a2d1-d73bc9007eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:50.093508 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d7116-7fce-4827-a2d1-d73bc9007eff admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:50.093940 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d7116-7fce-4827-a2d1-d73bc9007eff admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:50.094192 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d7116-7fce-4827-a2d1-d73bc9007eff admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:50.094928 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57d7116-7fce-4827-a2d1-d73bc9007eff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:50.096861 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57d7116-7fce-4827-a2d1-d73bc9007eff admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:50.100325 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-6706aea9-924d-4ca3-a5f1-6ef9adbd3da1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76e6b332a6d04e5fa72c5b9512cf9757'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:50.101045 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-6706aea9-924d-4ca3-a5f1-6ef9adbd3da1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76e6b332a6d04e5fa72c5b9512cf9757'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:50.101665 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-6706aea9-924d-4ca3-a5f1-6ef9adbd3da1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76e6b332a6d04e5fa72c5b9512cf9757'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:50.108618 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1012/2019] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:35:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:35:50.109343 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-6706aea9-924d-4ca3-a5f1-6ef9adbd3da1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76e6b332a6d04e5fa72c5b9512cf9757'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:50.113039 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d7116-7fce-4827-a2d1-d73bc9007eff admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:50.114740 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b57d7116-7fce-4827-a2d1-d73bc9007eff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:50.122483 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-6706aea9-924d-4ca3-a5f1-6ef9adbd3da1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76e6b332a6d04e5fa72c5b9512cf9757'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:50.130936 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d7116-7fce-4827-a2d1-d73bc9007eff admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:50.135979 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f3974-882e-485a-9f5a-928a9eed31d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:50.136896 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f3974-882e-485a-9f5a-928a9eed31d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:50.137182 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f3974-882e-485a-9f5a-928a9eed31d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:50.137468 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f3974-882e-485a-9f5a-928a9eed31d1 admin admin] PATH_INFO: `/v3/projects/b6f92db85a5441ff9182abc900060193/users/41661c29981b4667a1621e894e3f3d29/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:50.138781 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1008/2020] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:35:49 2022] DELETE /identity/v3/users/76e6b332a6d04e5fa72c5b9512cf9757 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:35:50.154040 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11f3974-882e-485a-9f5a-928a9eed31d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6f92db85a5441ff9182abc900060193, user_id=41661c29981b4667a1621e894e3f3d29, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:50.157378 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11f3974-882e-485a-9f5a-928a9eed31d1 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:50.172127 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1013/2021] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:35:50 2022] PUT /identity/v3/projects/b6f92db85a5441ff9182abc900060193/users/41661c29981b4667a1621e894e3f3d29/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:50.177389 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456733b3-1178-4f77-9e2d-ce52d829f6f2 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:50.177905 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456733b3-1178-4f77-9e2d-ce52d829f6f2 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:50.178341 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456733b3-1178-4f77-9e2d-ce52d829f6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:50.200043 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-456733b3-1178-4f77-9e2d-ce52d829f6f2 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:50.201375 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-456733b3-1178-4f77-9e2d-ce52d829f6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:50.265578 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:50.281160 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1009/2022] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:50.290822 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f3974-882e-485a-9f5a-928a9eed31d1 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:50.292641 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e11f3974-882e-485a-9f5a-928a9eed31d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:50.355391 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f3974-882e-485a-9f5a-928a9eed31d1 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:50.359500 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7978b1-7ff9-4ca6-b7c7-64ea8267d128 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:50.360160 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7978b1-7ff9-4ca6-b7c7-64ea8267d128 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:50.360442 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7978b1-7ff9-4ca6-b7c7-64ea8267d128 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:50.360720 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7978b1-7ff9-4ca6-b7c7-64ea8267d128 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:50.371063 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7978b1-7ff9-4ca6-b7c7-64ea8267d128 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:50.372583 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7978b1-7ff9-4ca6-b7c7-64ea8267d128 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:50.383073 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1014/2023] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:35:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:35:50.480886 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456733b3-1178-4f77-9e2d-ce52d829f6f2 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:50.482371 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-456733b3-1178-4f77-9e2d-ce52d829f6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:50.495717 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456733b3-1178-4f77-9e2d-ce52d829f6f2 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:50.501809 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b0c6a-67f3-4cba-95a6-6c8072d50536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:50.502760 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b0c6a-67f3-4cba-95a6-6c8072d50536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:50.503108 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b0c6a-67f3-4cba-95a6-6c8072d50536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:50.503635 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b0c6a-67f3-4cba-95a6-6c8072d50536 admin admin] PATH_INFO: `/v3/projects/d6b5871331aa4efbb1e75480c03e20ba` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:50.504789 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b0c6a-67f3-4cba-95a6-6c8072d50536 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6b5871331aa4efbb1e75480c03e20ba)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:50.506848 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b0c6a-67f3-4cba-95a6-6c8072d50536 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:50.575836 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-849b0c6a-67f3-4cba-95a6-6c8072d50536 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6b5871331aa4efbb1e75480c03e20ba', 'request_id': 'req-849b0c6a-67f3-4cba-95a6-6c8072d50536'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:50.589657 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-849b0c6a-67f3-4cba-95a6-6c8072d50536 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6b5871331aa4efbb1e75480c03e20ba', 'request_id': 'req-849b0c6a-67f3-4cba-95a6-6c8072d50536'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:50.597461 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-849b0c6a-67f3-4cba-95a6-6c8072d50536 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6b5871331aa4efbb1e75480c03e20ba', 'request_id': 'req-849b0c6a-67f3-4cba-95a6-6c8072d50536'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:50.608274 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-849b0c6a-67f3-4cba-95a6-6c8072d50536 admin admin] The token cache is being invalidate because project d6b5871331aa4efbb1e75480c03e20ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:35:50.609515 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-849b0c6a-67f3-4cba-95a6-6c8072d50536 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:50.610184 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-849b0c6a-67f3-4cba-95a6-6c8072d50536 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:50.611852 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1010/2024] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:35:50 2022] DELETE /identity/v3/projects/d6b5871331aa4efbb1e75480c03e20ba => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:35:50.616941 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c74f17-38e9-42ac-8de9-404a94924174 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:50.617223 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c74f17-38e9-42ac-8de9-404a94924174 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:50.617495 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c74f17-38e9-42ac-8de9-404a94924174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:50.637589 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-30c74f17-38e9-42ac-8de9-404a94924174 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:50.638922 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-30c74f17-38e9-42ac-8de9-404a94924174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:50.779974 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1015/2025] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:35:50.788081 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9aec40-84e1-4c21-a0a9-a433bec3ea3b None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:50.788414 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9aec40-84e1-4c21-a0a9-a433bec3ea3b None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:50.788744 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9aec40-84e1-4c21-a0a9-a433bec3ea3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:50.821047 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-7b9aec40-84e1-4c21-a0a9-a433bec3ea3b None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:50.823577 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-7b9aec40-84e1-4c21-a0a9-a433bec3ea3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:50.846622 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1011/2026] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:50.851156 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c74f17-38e9-42ac-8de9-404a94924174 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:50.868432 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c74f17-38e9-42ac-8de9-404a94924174 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:50.873468 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca712b9-26bc-4258-a15a-76f1a5ad432b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:50.874206 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca712b9-26bc-4258-a15a-76f1a5ad432b admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:50.874491 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca712b9-26bc-4258-a15a-76f1a5ad432b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:50.874808 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca712b9-26bc-4258-a15a-76f1a5ad432b admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:50.875573 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca712b9-26bc-4258-a15a-76f1a5ad432b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:35:50.875864 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca712b9-26bc-4258-a15a-76f1a5ad432b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:50.877518 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca712b9-26bc-4258-a15a-76f1a5ad432b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:50.896042 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1016/2027] 10.222.0.16 () {58 vars in 1152 bytes} [Thu May 26 12:35:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:35:50.900613 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9aec40-84e1-4c21-a0a9-a433bec3ea3b None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:50.925089 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9aec40-84e1-4c21-a0a9-a433bec3ea3b None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:50.934682 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe950aa4-8a1c-4a43-923f-3b1a0fbe3a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:50.935387 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe950aa4-8a1c-4a43-923f-3b1a0fbe3a22 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:50.935689 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe950aa4-8a1c-4a43-923f-3b1a0fbe3a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:50.935962 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe950aa4-8a1c-4a43-923f-3b1a0fbe3a22 admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:50.937269 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe950aa4-8a1c-4a43-923f-3b1a0fbe3a22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:50.939517 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe950aa4-8a1c-4a43-923f-3b1a0fbe3a22 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:50.975390 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1012/2028] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:35:50 2022] POST /identity/v3/projects => generated 391 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:35:50.977963 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca712b9-26bc-4258-a15a-76f1a5ad432b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:50.989278 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca712b9-26bc-4258-a15a-76f1a5ad432b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:51.034955 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:51.140630 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ed828-2017-408d-aff8-59e081038586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:51.144083 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ed828-2017-408d-aff8-59e081038586 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:51.144654 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ed828-2017-408d-aff8-59e081038586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:51.145163 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ed828-2017-408d-aff8-59e081038586 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:51.146057 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ed828-2017-408d-aff8-59e081038586 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:51.148048 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ed828-2017-408d-aff8-59e081038586 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:51.173523 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1017/2029] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:35:50 2022] POST /identity/v3/users => generated 296 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:35:51.178385 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe950aa4-8a1c-4a43-923f-3b1a0fbe3a22 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:51.190173 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe950aa4-8a1c-4a43-923f-3b1a0fbe3a22 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:51.195327 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ed828-2017-408d-aff8-59e081038586 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:51.197563 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9ddfb-e48e-4118-83e9-4b36d269e2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:51.197929 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2e4ed828-2017-408d-aff8-59e081038586 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:51.198238 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9ddfb-e48e-4118-83e9-4b36d269e2fb admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:51.198520 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9ddfb-e48e-4118-83e9-4b36d269e2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:51.198795 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9ddfb-e48e-4118-83e9-4b36d269e2fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:51.199532 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d9ddfb-e48e-4118-83e9-4b36d269e2fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:51.201167 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d9ddfb-e48e-4118-83e9-4b36d269e2fb admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:51.213509 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1013/2030] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:35:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:35:51.216929 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ed828-2017-408d-aff8-59e081038586 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:51.218351 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9ddfb-e48e-4118-83e9-4b36d269e2fb admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:51.222911 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea1d55-d6bb-4b6e-89b1-21c4def4bdb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:51.224098 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea1d55-d6bb-4b6e-89b1-21c4def4bdb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:51.224452 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea1d55-d6bb-4b6e-89b1-21c4def4bdb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:51.224798 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea1d55-d6bb-4b6e-89b1-21c4def4bdb7 admin admin] PATH_INFO: `/v3/users/11dcf49559ac47a89535d2836c14a18c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:51.226772 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ea1d55-d6bb-4b6e-89b1-21c4def4bdb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11dcf49559ac47a89535d2836c14a18c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:51.230313 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9ddfb-e48e-4118-83e9-4b36d269e2fb admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:51.231282 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ea1d55-d6bb-4b6e-89b1-21c4def4bdb7 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:51.236612 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a6460-4cdd-4eb2-b97b-48cfc404a556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:51.237343 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a6460-4cdd-4eb2-b97b-48cfc404a556 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:51.237631 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a6460-4cdd-4eb2-b97b-48cfc404a556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:51.237910 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a6460-4cdd-4eb2-b97b-48cfc404a556 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:51.238839 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803a6460-4cdd-4eb2-b97b-48cfc404a556 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:51.240437 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803a6460-4cdd-4eb2-b97b-48cfc404a556 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:51.252894 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1014/2031] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:35:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:35:51.257068 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a6460-4cdd-4eb2-b97b-48cfc404a556 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:51.272952 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a6460-4cdd-4eb2-b97b-48cfc404a556 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:51.283057 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc80ccab-a3fa-4339-a5fe-9c2ecfadd458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:51.284262 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc80ccab-a3fa-4339-a5fe-9c2ecfadd458 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:51.284862 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc80ccab-a3fa-4339-a5fe-9c2ecfadd458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:51.285717 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc80ccab-a3fa-4339-a5fe-9c2ecfadd458 admin admin] PATH_INFO: `/v3/projects/8991e0209e7247fca2dc3a45804b281a/users/9f4116b50688471b805bd3837a4cc689/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:51.305903 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc80ccab-a3fa-4339-a5fe-9c2ecfadd458 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8991e0209e7247fca2dc3a45804b281a, user_id=9f4116b50688471b805bd3837a4cc689, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:51.306524 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-58ea1d55-d6bb-4b6e-89b1-21c4def4bdb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11dcf49559ac47a89535d2836c14a18c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:51.309501 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc80ccab-a3fa-4339-a5fe-9c2ecfadd458 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:51.317198 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-58ea1d55-d6bb-4b6e-89b1-21c4def4bdb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11dcf49559ac47a89535d2836c14a18c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:51.317926 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-58ea1d55-d6bb-4b6e-89b1-21c4def4bdb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11dcf49559ac47a89535d2836c14a18c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:51.318546 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-58ea1d55-d6bb-4b6e-89b1-21c4def4bdb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11dcf49559ac47a89535d2836c14a18c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:51.328213 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-58ea1d55-d6bb-4b6e-89b1-21c4def4bdb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11dcf49559ac47a89535d2836c14a18c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:51.332611 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1015/2032] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:35:51 2022] PUT /identity/v3/projects/8991e0209e7247fca2dc3a45804b281a/users/9f4116b50688471b805bd3837a4cc689/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:51.350262 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d6f69-ad45-4aae-b96a-23362b003347 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:51.350934 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d6f69-ad45-4aae-b96a-23362b003347 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:51.351459 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d6f69-ad45-4aae-b96a-23362b003347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:51.383662 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1018/2033] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:35:51 2022] DELETE /identity/v3/users/11dcf49559ac47a89535d2836c14a18c => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:35:51.386027 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1cdfe5-77ab-4923-abef-62190cfd9f12 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:51.386440 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1cdfe5-77ab-4923-abef-62190cfd9f12 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:51.387086 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1cdfe5-77ab-4923-abef-62190cfd9f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:51.395089 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-ce3d6f69-ad45-4aae-b96a-23362b003347 None None] MFA Rules not processed for user `9f4116b50688471b805bd3837a4cc689`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:51.398382 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-ce3d6f69-ad45-4aae-b96a-23362b003347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:51.408616 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-2e1cdfe5-77ab-4923-abef-62190cfd9f12 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:51.410529 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2e1cdfe5-77ab-4923-abef-62190cfd9f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:51.493788 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1019/2034] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:51.505286 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1cdfe5-77ab-4923-abef-62190cfd9f12 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:51.507051 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2e1cdfe5-77ab-4923-abef-62190cfd9f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:51.509593 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:51.523899 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1016/2035] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:51.528038 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d6f69-ad45-4aae-b96a-23362b003347 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:51.529579 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-ce3d6f69-ad45-4aae-b96a-23362b003347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:51.547903 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d6f69-ad45-4aae-b96a-23362b003347 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:51.556881 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:51.581718 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2550b49-5011-4eec-b042-978afd6a7ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:51.584117 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2550b49-5011-4eec-b042-978afd6a7ac9 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:51.586228 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2550b49-5011-4eec-b042-978afd6a7ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:51.586228 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2550b49-5011-4eec-b042-978afd6a7ac9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:51.588394 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2550b49-5011-4eec-b042-978afd6a7ac9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:51.593329 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2550b49-5011-4eec-b042-978afd6a7ac9 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:51.616761 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1cdfe5-77ab-4923-abef-62190cfd9f12 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:51.623710 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb72088-e686-428f-9f34-a669e19fab00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:51.625610 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb72088-e686-428f-9f34-a669e19fab00 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:51.626560 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb72088-e686-428f-9f34-a669e19fab00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:51.627467 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb72088-e686-428f-9f34-a669e19fab00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:51.642588 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb72088-e686-428f-9f34-a669e19fab00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:51.644649 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb72088-e686-428f-9f34-a669e19fab00 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:51.648075 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1017/2036] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:35:51 2022] POST /identity/v3/projects => generated 391 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:35:51.652268 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2550b49-5011-4eec-b042-978afd6a7ac9 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:51.670768 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1020/2037] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:35:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:35:51.765309 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2550b49-5011-4eec-b042-978afd6a7ac9 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:51.783077 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb6bce3-ecc5-4f68-9ccd-1fedb872470d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:51.785920 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6bce3-ecc5-4f68-9ccd-1fedb872470d admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:51.786221 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6bce3-ecc5-4f68-9ccd-1fedb872470d admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:51.786500 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6bce3-ecc5-4f68-9ccd-1fedb872470d admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:51.788585 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb6bce3-ecc5-4f68-9ccd-1fedb872470d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:51.793043 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb6bce3-ecc5-4f68-9ccd-1fedb872470d admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:51.845116 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1018/2038] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:35:51 2022] POST /identity/v3/users => generated 302 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:35:51.850140 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb72088-e686-428f-9f34-a669e19fab00 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:51.873055 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb72088-e686-428f-9f34-a669e19fab00 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:51.886058 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88471c4b-942b-4a11-8cce-3c9e1a841992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:51.887416 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88471c4b-942b-4a11-8cce-3c9e1a841992 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:51.887799 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88471c4b-942b-4a11-8cce-3c9e1a841992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:51.888156 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88471c4b-942b-4a11-8cce-3c9e1a841992 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:51.889465 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88471c4b-942b-4a11-8cce-3c9e1a841992 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:51.892811 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88471c4b-942b-4a11-8cce-3c9e1a841992 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:51.909269 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1021/2039] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:35:51 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:35:51.913932 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb6bce3-ecc5-4f68-9ccd-1fedb872470d admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:51.939979 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb6bce3-ecc5-4f68-9ccd-1fedb872470d admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:51.945970 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5227f6-435b-44c6-9952-54f117fb5bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:51.958906 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5227f6-435b-44c6-9952-54f117fb5bbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:51.959250 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5227f6-435b-44c6-9952-54f117fb5bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:51.959464 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5227f6-435b-44c6-9952-54f117fb5bbc admin admin] PATH_INFO: `/v3/projects/b3cdc6e4fd71467da8756279b14e0347/users/f753755775cc42118bbafd67cfc07657/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:51.995113 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5227f6-435b-44c6-9952-54f117fb5bbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3cdc6e4fd71467da8756279b14e0347, user_id=f753755775cc42118bbafd67cfc07657, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:52.009927 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5227f6-435b-44c6-9952-54f117fb5bbc admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:52.033599 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1019/2040] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:35:51 2022] PUT /identity/v3/projects/b3cdc6e4fd71467da8756279b14e0347/users/f753755775cc42118bbafd67cfc07657/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:52.037600 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88471c4b-942b-4a11-8cce-3c9e1a841992 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:52.048975 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88471c4b-942b-4a11-8cce-3c9e1a841992 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:52.118491 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab7fbc-c325-437e-9201-58382432b290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:52.119237 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab7fbc-c325-437e-9201-58382432b290 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:52.119523 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab7fbc-c325-437e-9201-58382432b290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:52.120008 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab7fbc-c325-437e-9201-58382432b290 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:52.120793 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ab7fbc-c325-437e-9201-58382432b290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:52.124785 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ab7fbc-c325-437e-9201-58382432b290 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:52.135926 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1022/2041] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:35:52 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:35:52.139768 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5227f6-435b-44c6-9952-54f117fb5bbc admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:52.150778 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5227f6-435b-44c6-9952-54f117fb5bbc admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:52.155808 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49791369-7fdb-4962-a76d-366549009f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:52.156784 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49791369-7fdb-4962-a76d-366549009f17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:52.157005 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49791369-7fdb-4962-a76d-366549009f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:52.157286 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49791369-7fdb-4962-a76d-366549009f17 admin admin] PATH_INFO: `/v3/projects/b3cdc6e4fd71467da8756279b14e0347/users/f753755775cc42118bbafd67cfc07657/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:52.159387 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49791369-7fdb-4962-a76d-366549009f17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3cdc6e4fd71467da8756279b14e0347, user_id=f753755775cc42118bbafd67cfc07657, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:52.162419 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49791369-7fdb-4962-a76d-366549009f17 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:52.177204 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1020/2042] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:35:52 2022] PUT /identity/v3/projects/b3cdc6e4fd71467da8756279b14e0347/users/f753755775cc42118bbafd67cfc07657/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:52.188595 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66151068-ff03-45b4-9e46-88753dae6353 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:52.189215 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66151068-ff03-45b4-9e46-88753dae6353 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:52.189501 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66151068-ff03-45b4-9e46-88753dae6353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:52.219245 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-66151068-ff03-45b4-9e46-88753dae6353 None None] MFA Rules not processed for user `f753755775cc42118bbafd67cfc07657`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:52.220177 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-66151068-ff03-45b4-9e46-88753dae6353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:52.329461 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49791369-7fdb-4962-a76d-366549009f17 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:52.331883 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1023/2043] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:52 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:52.343702 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-49791369-7fdb-4962-a76d-366549009f17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:52.354371 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66151068-ff03-45b4-9e46-88753dae6353 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:52.356153 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-66151068-ff03-45b4-9e46-88753dae6353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:52.418476 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:52.449961 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66151068-ff03-45b4-9e46-88753dae6353 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:52.458071 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e819c2c-9908-4241-a3b9-090a4f6aaaad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:52.458772 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e819c2c-9908-4241-a3b9-090a4f6aaaad service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:52.459737 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e819c2c-9908-4241-a3b9-090a4f6aaaad service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:52.460027 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e819c2c-9908-4241-a3b9-090a4f6aaaad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:52.472203 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e819c2c-9908-4241-a3b9-090a4f6aaaad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:52.474239 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e819c2c-9908-4241-a3b9-090a4f6aaaad service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:52.481795 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49791369-7fdb-4962-a76d-366549009f17 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:52.489215 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391724de-ea8d-4aaf-a6ed-46677bb99809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:52.490612 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391724de-ea8d-4aaf-a6ed-46677bb99809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:52.490729 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391724de-ea8d-4aaf-a6ed-46677bb99809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:52.491153 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391724de-ea8d-4aaf-a6ed-46677bb99809 admin admin] PATH_INFO: `/v3/projects/4d2582fb428d471687d3c31b61f331a7` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:52.494642 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391724de-ea8d-4aaf-a6ed-46677bb99809 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d2582fb428d471687d3c31b61f331a7)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:52.495436 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1024/2044] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:35:52 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:35:52.498734 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391724de-ea8d-4aaf-a6ed-46677bb99809 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:52.588203 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e819c2c-9908-4241-a3b9-090a4f6aaaad service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:52.594593 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8e819c2c-9908-4241-a3b9-090a4f6aaaad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:52.607062 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=92,keystone:INSERT=6,keystone:DELETE=2 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:52.617689 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e819c2c-9908-4241-a3b9-090a4f6aaaad service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:52.637039 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-391724de-ea8d-4aaf-a6ed-46677bb99809 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d2582fb428d471687d3c31b61f331a7', 'request_id': 'req-391724de-ea8d-4aaf-a6ed-46677bb99809'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:52.649560 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-391724de-ea8d-4aaf-a6ed-46677bb99809 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d2582fb428d471687d3c31b61f331a7', 'request_id': 'req-391724de-ea8d-4aaf-a6ed-46677bb99809'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:52.661040 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-391724de-ea8d-4aaf-a6ed-46677bb99809 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d2582fb428d471687d3c31b61f331a7', 'request_id': 'req-391724de-ea8d-4aaf-a6ed-46677bb99809'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:52.684100 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-391724de-ea8d-4aaf-a6ed-46677bb99809 admin admin] The token cache is being invalidate because project 4d2582fb428d471687d3c31b61f331a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:35:52.684402 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-391724de-ea8d-4aaf-a6ed-46677bb99809 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:52.686372 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-391724de-ea8d-4aaf-a6ed-46677bb99809 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:52.695235 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1021/2045] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:35:52 2022] DELETE /identity/v3/projects/4d2582fb428d471687d3c31b61f331a7 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:35:52.699405 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391724de-ea8d-4aaf-a6ed-46677bb99809 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:52.701561 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-391724de-ea8d-4aaf-a6ed-46677bb99809 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:52.727929 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89095cbb-4e59-4a24-a271-ed9f9a365e22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:52.728597 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89095cbb-4e59-4a24-a271-ed9f9a365e22 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:52.728932 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89095cbb-4e59-4a24-a271-ed9f9a365e22 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:52.729189 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89095cbb-4e59-4a24-a271-ed9f9a365e22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:52.731493 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-89095cbb-4e59-4a24-a271-ed9f9a365e22 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:52.803233 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391724de-ea8d-4aaf-a6ed-46677bb99809 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:52.809763 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfbef49-7d95-4675-a4b8-098b2ad19e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:52.810733 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfbef49-7d95-4675-a4b8-098b2ad19e45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:52.811636 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfbef49-7d95-4675-a4b8-098b2ad19e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:52.811636 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfbef49-7d95-4675-a4b8-098b2ad19e45 admin admin] PATH_INFO: `/v3/users/05e4a041eea4416bad903cce24e795c8` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:52.813009 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfbef49-7d95-4675-a4b8-098b2ad19e45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05e4a041eea4416bad903cce24e795c8)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:52.815059 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfbef49-7d95-4675-a4b8-098b2ad19e45 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:52.840696 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89095cbb-4e59-4a24-a271-ed9f9a365e22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:52.843979 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89095cbb-4e59-4a24-a271-ed9f9a365e22 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:52.854365 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1025/2046] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:35:52 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:35:52.901124 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-fcfbef49-7d95-4675-a4b8-098b2ad19e45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05e4a041eea4416bad903cce24e795c8'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:52.902127 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-fcfbef49-7d95-4675-a4b8-098b2ad19e45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05e4a041eea4416bad903cce24e795c8'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:52.902930 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-fcfbef49-7d95-4675-a4b8-098b2ad19e45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05e4a041eea4416bad903cce24e795c8'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:52.917333 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-fcfbef49-7d95-4675-a4b8-098b2ad19e45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05e4a041eea4416bad903cce24e795c8'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:52.936512 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-fcfbef49-7d95-4675-a4b8-098b2ad19e45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05e4a041eea4416bad903cce24e795c8'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:52.958121 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1022/2047] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:35:52 2022] DELETE /identity/v3/users/05e4a041eea4416bad903cce24e795c8 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:53.568968 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89095cbb-4e59-4a24-a271-ed9f9a365e22 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:53.586541 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89095cbb-4e59-4a24-a271-ed9f9a365e22 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:53.657492 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0710fe-680d-4109-9e74-468d82194720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:53.658597 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0710fe-680d-4109-9e74-468d82194720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:53.658778 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0710fe-680d-4109-9e74-468d82194720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:53.659167 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0710fe-680d-4109-9e74-468d82194720 admin admin] PATH_INFO: `/v3/projects/a8c3ed1c671c4254bd01db9320a5fb57` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:53.664364 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0710fe-680d-4109-9e74-468d82194720 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8c3ed1c671c4254bd01db9320a5fb57)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:53.664364 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0710fe-680d-4109-9e74-468d82194720 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:53.724373 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:53.741688 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0f0710fe-680d-4109-9e74-468d82194720 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8c3ed1c671c4254bd01db9320a5fb57', 'request_id': 'req-0f0710fe-680d-4109-9e74-468d82194720'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:53.778403 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0f0710fe-680d-4109-9e74-468d82194720 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8c3ed1c671c4254bd01db9320a5fb57', 'request_id': 'req-0f0710fe-680d-4109-9e74-468d82194720'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:53.810254 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0f0710fe-680d-4109-9e74-468d82194720 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8c3ed1c671c4254bd01db9320a5fb57', 'request_id': 'req-0f0710fe-680d-4109-9e74-468d82194720'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:53.831410 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0f0710fe-680d-4109-9e74-468d82194720 admin admin] The token cache is being invalidate because project a8c3ed1c671c4254bd01db9320a5fb57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:35:53.838376 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0f0710fe-680d-4109-9e74-468d82194720 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:53.839595 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0f0710fe-680d-4109-9e74-468d82194720 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:53.844881 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1026/2048] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:35:53 2022] DELETE /identity/v3/projects/a8c3ed1c671c4254bd01db9320a5fb57 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:53.848473 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b575c1-2a2d-4fb7-b52e-ccb87e98d684 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:53.848759 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b575c1-2a2d-4fb7-b52e-ccb87e98d684 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:53.849057 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b575c1-2a2d-4fb7-b52e-ccb87e98d684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:53.879789 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-91b575c1-2a2d-4fb7-b52e-ccb87e98d684 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:53.882145 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-91b575c1-2a2d-4fb7-b52e-ccb87e98d684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:53.946074 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:53.996123 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1023/2049] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:54.004618 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be298d-d4ff-496e-8c4e-a47add6e7f90 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:54.004938 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be298d-d4ff-496e-8c4e-a47add6e7f90 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:54.005229 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be298d-d4ff-496e-8c4e-a47add6e7f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:54.045812 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c7be298d-d4ff-496e-8c4e-a47add6e7f90 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:54.047482 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c7be298d-d4ff-496e-8c4e-a47add6e7f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:54.060931 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1027/2050] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:54.062234 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b575c1-2a2d-4fb7-b52e-ccb87e98d684 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:54.073408 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b575c1-2a2d-4fb7-b52e-ccb87e98d684 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:54.083073 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addaae65-c1e2-42cf-a129-90e32ae54232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:54.083764 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addaae65-c1e2-42cf-a129-90e32ae54232 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:54.084046 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addaae65-c1e2-42cf-a129-90e32ae54232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:54.084317 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addaae65-c1e2-42cf-a129-90e32ae54232 admin admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:54.085091 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addaae65-c1e2-42cf-a129-90e32ae54232 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:35:54.085397 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addaae65-c1e2-42cf-a129-90e32ae54232 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:54.087005 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addaae65-c1e2-42cf-a129-90e32ae54232 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:54.102641 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1024/2051] 10.222.0.16 () {58 vars in 1152 bytes} [Thu May 26 12:35:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:35:54.106877 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be298d-d4ff-496e-8c4e-a47add6e7f90 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:54.120573 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be298d-d4ff-496e-8c4e-a47add6e7f90 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:54.128036 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f3151a-b799-45de-927e-f2b505e34181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:54.129159 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3151a-b799-45de-927e-f2b505e34181 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:54.129661 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3151a-b799-45de-927e-f2b505e34181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:54.130131 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3151a-b799-45de-927e-f2b505e34181 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:54.131035 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f3151a-b799-45de-927e-f2b505e34181 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:54.133692 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f3151a-b799-45de-927e-f2b505e34181 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:54.169545 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1028/2052] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:35:54 2022] POST /identity/v3/projects => generated 365 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:35:54.174193 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addaae65-c1e2-42cf-a129-90e32ae54232 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:54.186146 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addaae65-c1e2-42cf-a129-90e32ae54232 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:54.292323 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00379467-e162-45ef-b02e-603c3a215c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:54.292641 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00379467-e162-45ef-b02e-603c3a215c19 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:54.293571 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00379467-e162-45ef-b02e-603c3a215c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:54.293872 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00379467-e162-45ef-b02e-603c3a215c19 admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:54.295078 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00379467-e162-45ef-b02e-603c3a215c19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:54.297731 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00379467-e162-45ef-b02e-603c3a215c19 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:54.348863 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1025/2053] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:35:54 2022] POST /identity/v3/users => generated 283 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:35:54.354798 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f3151a-b799-45de-927e-f2b505e34181 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:54.367877 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f3151a-b799-45de-927e-f2b505e34181 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:54.374790 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13923702-fb9a-496e-83b7-c40602a5c7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:54.376024 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13923702-fb9a-496e-83b7-c40602a5c7a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:54.376316 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13923702-fb9a-496e-83b7-c40602a5c7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:54.376601 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13923702-fb9a-496e-83b7-c40602a5c7a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:54.377400 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13923702-fb9a-496e-83b7-c40602a5c7a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:54.379458 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13923702-fb9a-496e-83b7-c40602a5c7a0 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:54.402920 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1029/2054] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:35:54.404040 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00379467-e162-45ef-b02e-603c3a215c19 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:54.419294 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00379467-e162-45ef-b02e-603c3a215c19 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:54.426120 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7475633-a097-4861-bb52-acd23b802615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:54.426876 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7475633-a097-4861-bb52-acd23b802615 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:54.427379 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7475633-a097-4861-bb52-acd23b802615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:54.427836 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7475633-a097-4861-bb52-acd23b802615 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:54.428693 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7475633-a097-4861-bb52-acd23b802615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:54.430716 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7475633-a097-4861-bb52-acd23b802615 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:54.444525 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1026/2055] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:35:54.448471 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13923702-fb9a-496e-83b7-c40602a5c7a0 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:54.469562 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13923702-fb9a-496e-83b7-c40602a5c7a0 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:54.482438 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ac893-f248-4310-bbaa-323410f8d5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:54.483949 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ac893-f248-4310-bbaa-323410f8d5b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:54.484504 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ac893-f248-4310-bbaa-323410f8d5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:54.484777 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ac893-f248-4310-bbaa-323410f8d5b3 admin admin] PATH_INFO: `/v3/projects/38fec4d2a68f4ab7b70ebcaabbc63bb0/users/c8d728dc06ef4a799a23db40c74c9860/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:54.502730 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4ac893-f248-4310-bbaa-323410f8d5b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38fec4d2a68f4ab7b70ebcaabbc63bb0, user_id=c8d728dc06ef4a799a23db40c74c9860, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:54.505757 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4ac893-f248-4310-bbaa-323410f8d5b3 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:54.532132 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1030/2056] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:35:54 2022] PUT /identity/v3/projects/38fec4d2a68f4ab7b70ebcaabbc63bb0/users/c8d728dc06ef4a799a23db40c74c9860/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:54.533889 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f97024-ca61-4f29-a7bc-7790e00e320a None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:54.534180 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f97024-ca61-4f29-a7bc-7790e00e320a None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:54.534463 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f97024-ca61-4f29-a7bc-7790e00e320a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:54.572611 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-45f97024-ca61-4f29-a7bc-7790e00e320a None None] MFA Rules not processed for user `c8d728dc06ef4a799a23db40c74c9860`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:54.574650 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-45f97024-ca61-4f29-a7bc-7790e00e320a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:54.679866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1027/2057] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:54 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:35:54.685283 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ac893-f248-4310-bbaa-323410f8d5b3 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:54.801999 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ac893-f248-4310-bbaa-323410f8d5b3 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:54.812062 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d32adf-cad9-4f59-a178-0b1c23864e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:54.815680 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d32adf-cad9-4f59-a178-0b1c23864e5f admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:54.816012 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d32adf-cad9-4f59-a178-0b1c23864e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:54.816294 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d32adf-cad9-4f59-a178-0b1c23864e5f admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:54.817122 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d32adf-cad9-4f59-a178-0b1c23864e5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:54.819981 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d32adf-cad9-4f59-a178-0b1c23864e5f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:54.875301 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1031/2058] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:35:54 2022] POST /identity/v3/projects => generated 363 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:35:54.880967 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f97024-ca61-4f29-a7bc-7790e00e320a None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:54.902909 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f97024-ca61-4f29-a7bc-7790e00e320a None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:54.935287 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:54.980673 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff95fe7-7939-4f84-9615-21f8bca9c721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:54.981466 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff95fe7-7939-4f84-9615-21f8bca9c721 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:54.981761 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff95fe7-7939-4f84-9615-21f8bca9c721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:54.982037 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff95fe7-7939-4f84-9615-21f8bca9c721 admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:54.983795 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff95fe7-7939-4f84-9615-21f8bca9c721 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:54.986687 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff95fe7-7939-4f84-9615-21f8bca9c721 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:55.031626 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1028/2059] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:35:54 2022] POST /identity/v3/users => generated 288 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:35:55.034518 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d32adf-cad9-4f59-a178-0b1c23864e5f admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:55.051126 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d32adf-cad9-4f59-a178-0b1c23864e5f admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:55.063835 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036fd11f-b790-4824-8737-44a29b79cd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:55.064455 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036fd11f-b790-4824-8737-44a29b79cd85 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:55.064757 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036fd11f-b790-4824-8737-44a29b79cd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:55.065066 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036fd11f-b790-4824-8737-44a29b79cd85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:55.065835 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036fd11f-b790-4824-8737-44a29b79cd85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:55.067619 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036fd11f-b790-4824-8737-44a29b79cd85 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:55.096667 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1032/2060] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:35:55 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:35:55.101306 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff95fe7-7939-4f84-9615-21f8bca9c721 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:55.120309 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff95fe7-7939-4f84-9615-21f8bca9c721 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:55.130233 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1158c437-ec02-4d3f-a11b-1a54aea2392c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:55.131403 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158c437-ec02-4d3f-a11b-1a54aea2392c admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:55.131940 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158c437-ec02-4d3f-a11b-1a54aea2392c admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:55.132430 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158c437-ec02-4d3f-a11b-1a54aea2392c admin admin] PATH_INFO: `/v3/projects/11c8b73179574ff9b4105fd2df8beb56/users/4a12aba1bfad4fcbb6bb34bf5c1ba7d1/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:55.172242 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1158c437-ec02-4d3f-a11b-1a54aea2392c admin admin] RBAC: Authorizing `identity:create_grant(project_id=11c8b73179574ff9b4105fd2df8beb56, user_id=4a12aba1bfad4fcbb6bb34bf5c1ba7d1, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:55.182274 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1158c437-ec02-4d3f-a11b-1a54aea2392c admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:55.218427 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1029/2061] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:35:55 2022] PUT /identity/v3/projects/11c8b73179574ff9b4105fd2df8beb56/users/4a12aba1bfad4fcbb6bb34bf5c1ba7d1/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:55.222516 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036fd11f-b790-4824-8737-44a29b79cd85 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:55.246569 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036fd11f-b790-4824-8737-44a29b79cd85 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:55.311310 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:55.345059 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b6e6cc-27e6-4a28-a0ec-374ab8396db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:55.345842 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6e6cc-27e6-4a28-a0ec-374ab8396db4 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:55.346268 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6e6cc-27e6-4a28-a0ec-374ab8396db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:55.346606 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6e6cc-27e6-4a28-a0ec-374ab8396db4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:55.347449 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b6e6cc-27e6-4a28-a0ec-374ab8396db4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:55.349306 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b6e6cc-27e6-4a28-a0ec-374ab8396db4 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:55.363624 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1033/2062] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:35:55 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:35:55.367443 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1158c437-ec02-4d3f-a11b-1a54aea2392c admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:55.382061 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1158c437-ec02-4d3f-a11b-1a54aea2392c admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:55.391419 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9cd2d8-a535-4081-9ec8-2c1028805fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:55.392479 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9cd2d8-a535-4081-9ec8-2c1028805fd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:55.392831 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9cd2d8-a535-4081-9ec8-2c1028805fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:55.400523 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9cd2d8-a535-4081-9ec8-2c1028805fd8 admin admin] PATH_INFO: `/v3/projects/11c8b73179574ff9b4105fd2df8beb56/users/4a12aba1bfad4fcbb6bb34bf5c1ba7d1/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:55.403097 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9cd2d8-a535-4081-9ec8-2c1028805fd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11c8b73179574ff9b4105fd2df8beb56, user_id=4a12aba1bfad4fcbb6bb34bf5c1ba7d1, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:55.406985 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9cd2d8-a535-4081-9ec8-2c1028805fd8 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:55.419765 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1030/2063] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:35:55 2022] PUT /identity/v3/projects/11c8b73179574ff9b4105fd2df8beb56/users/4a12aba1bfad4fcbb6bb34bf5c1ba7d1/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:55.430042 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fefbd0f-94ae-42fd-ba31-704cf45496d0 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:55.430431 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fefbd0f-94ae-42fd-ba31-704cf45496d0 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:55.430776 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fefbd0f-94ae-42fd-ba31-704cf45496d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:55.466935 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-8fefbd0f-94ae-42fd-ba31-704cf45496d0 None None] MFA Rules not processed for user `4a12aba1bfad4fcbb6bb34bf5c1ba7d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:55.469060 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8fefbd0f-94ae-42fd-ba31-704cf45496d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:55.653068 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1034/2064] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:55 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:55.669177 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9cd2d8-a535-4081-9ec8-2c1028805fd8 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:55.671793 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-9f9cd2d8-a535-4081-9ec8-2c1028805fd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:55.738141 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9cd2d8-a535-4081-9ec8-2c1028805fd8 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:55.742678 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa09cb54-7b57-4179-8d73-40f51174e566 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:55.743337 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09cb54-7b57-4179-8d73-40f51174e566 service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:55.743626 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09cb54-7b57-4179-8d73-40f51174e566 service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:55.743906 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09cb54-7b57-4179-8d73-40f51174e566 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:55.760479 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa09cb54-7b57-4179-8d73-40f51174e566 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:55.762272 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa09cb54-7b57-4179-8d73-40f51174e566 service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:55.776158 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1031/2065] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:35:55 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:35:56.416460 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fefbd0f-94ae-42fd-ba31-704cf45496d0 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:56.499335 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58d6e8-d028-42c2-85e9-3ffc7567d5a0 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:56.499847 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58d6e8-d028-42c2-85e9-3ffc7567d5a0 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:56.499847 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58d6e8-d028-42c2-85e9-3ffc7567d5a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:56.503778 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fefbd0f-94ae-42fd-ba31-704cf45496d0 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:56.510369 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095ad25c-a5a0-45ad-ab79-3cb915a4aba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:56.511369 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ad25c-a5a0-45ad-ab79-3cb915a4aba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:56.512276 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ad25c-a5a0-45ad-ab79-3cb915a4aba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:56.512658 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ad25c-a5a0-45ad-ab79-3cb915a4aba6 admin admin] PATH_INFO: `/v3/users/c8d728dc06ef4a799a23db40c74c9860` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:56.514120 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095ad25c-a5a0-45ad-ab79-3cb915a4aba6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8d728dc06ef4a799a23db40c74c9860)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:56.516255 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095ad25c-a5a0-45ad-ab79-3cb915a4aba6 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:56.528397 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-dd58d6e8-d028-42c2-85e9-3ffc7567d5a0 None None] MFA Rules not processed for user `41661c29981b4667a1621e894e3f3d29`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:56.529660 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-dd58d6e8-d028-42c2-85e9-3ffc7567d5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:56.586864 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-095ad25c-a5a0-45ad-ab79-3cb915a4aba6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8d728dc06ef4a799a23db40c74c9860'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:56.595143 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-095ad25c-a5a0-45ad-ab79-3cb915a4aba6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8d728dc06ef4a799a23db40c74c9860'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:56.595766 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-095ad25c-a5a0-45ad-ab79-3cb915a4aba6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8d728dc06ef4a799a23db40c74c9860'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:56.596357 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-095ad25c-a5a0-45ad-ab79-3cb915a4aba6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8d728dc06ef4a799a23db40c74c9860'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:56.601348 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:56.604975 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-095ad25c-a5a0-45ad-ab79-3cb915a4aba6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8d728dc06ef4a799a23db40c74c9860'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:56.609466 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1032/2066] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:35:56.624371 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd58d6e8-d028-42c2-85e9-3ffc7567d5a0 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:56.625734 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-dd58d6e8-d028-42c2-85e9-3ffc7567d5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:56.632376 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1035/2067] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:35:56 2022] DELETE /identity/v3/users/c8d728dc06ef4a799a23db40c74c9860 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:56.633992 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f72e18-83a7-4996-a127-70defe6a8225 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:56.634337 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f72e18-83a7-4996-a127-70defe6a8225 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:56.634729 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f72e18-83a7-4996-a127-70defe6a8225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:56.647219 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:56.652958 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b2f72e18-83a7-4996-a127-70defe6a8225 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:56.654166 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b2f72e18-83a7-4996-a127-70defe6a8225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:56.714642 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd58d6e8-d028-42c2-85e9-3ffc7567d5a0 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:56.725498 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1036/2068] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:56.736220 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f72e18-83a7-4996-a127-70defe6a8225 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:56.741006 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b2f72e18-83a7-4996-a127-70defe6a8225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:56.808257 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f72e18-83a7-4996-a127-70defe6a8225 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:56.812477 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d16e0bc-3c63-4253-a7b0-556e15c2827b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:56.813026 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f450c-5afb-4f7d-9c9e-93fe4fc24410 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536f68ff77794352adf41aaacdc0645c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:56.813291 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16e0bc-3c63-4253-a7b0-556e15c2827b service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:56.813589 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16e0bc-3c63-4253-a7b0-556e15c2827b service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:56.813696 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f450c-5afb-4f7d-9c9e-93fe4fc24410 service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:56.813868 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16e0bc-3c63-4253-a7b0-556e15c2827b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:56.813985 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f450c-5afb-4f7d-9c9e-93fe4fc24410 service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:56.814232 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f450c-5afb-4f7d-9c9e-93fe4fc24410 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:56.816059 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-1c5f450c-5afb-4f7d-9c9e-93fe4fc24410 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:56.825936 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d16e0bc-3c63-4253-a7b0-556e15c2827b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:56.828573 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d16e0bc-3c63-4253-a7b0-556e15c2827b service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:56.840572 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1037/2069] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:35:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:35:56.888640 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5f450c-5afb-4f7d-9c9e-93fe4fc24410 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:56.891692 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5f450c-5afb-4f7d-9c9e-93fe4fc24410 service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:56.900281 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d16e0bc-3c63-4253-a7b0-556e15c2827b service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:56.902495 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4d16e0bc-3c63-4253-a7b0-556e15c2827b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:56.917223 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1033/2070] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:35:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:35:56.921285 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d16e0bc-3c63-4253-a7b0-556e15c2827b service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:56.926847 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8b1cc-4d51-4c11-a01e-0b08ff32db8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:56.927920 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8b1cc-4d51-4c11-a01e-0b08ff32db8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:56.928507 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8b1cc-4d51-4c11-a01e-0b08ff32db8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:56.928756 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8b1cc-4d51-4c11-a01e-0b08ff32db8f admin admin] PATH_INFO: `/v3/users/9f4116b50688471b805bd3837a4cc689` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:56.930271 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f8b1cc-4d51-4c11-a01e-0b08ff32db8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f4116b50688471b805bd3837a4cc689)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:56.932386 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f8b1cc-4d51-4c11-a01e-0b08ff32db8f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:57.004017 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e9f8b1cc-4d51-4c11-a01e-0b08ff32db8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f4116b50688471b805bd3837a4cc689'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:57.013145 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e9f8b1cc-4d51-4c11-a01e-0b08ff32db8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f4116b50688471b805bd3837a4cc689'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:57.013743 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e9f8b1cc-4d51-4c11-a01e-0b08ff32db8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f4116b50688471b805bd3837a4cc689'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:57.014366 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e9f8b1cc-4d51-4c11-a01e-0b08ff32db8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f4116b50688471b805bd3837a4cc689'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:57.023233 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e9f8b1cc-4d51-4c11-a01e-0b08ff32db8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f4116b50688471b805bd3837a4cc689'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:57.035069 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:57.073933 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115f1e1-876d-4426-b189-d66abe6689e0 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:57.074230 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115f1e1-876d-4426-b189-d66abe6689e0 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:57.075230 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115f1e1-876d-4426-b189-d66abe6689e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:57.076964 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1038/2071] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:35:56 2022] DELETE /identity/v3/users/9f4116b50688471b805bd3837a4cc689 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:35:57.116791 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-d115f1e1-876d-4426-b189-d66abe6689e0 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:57.118470 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-d115f1e1-876d-4426-b189-d66abe6689e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:57.203724 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:57.228106 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1034/2072] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:57.240044 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8b1cc-4d51-4c11-a01e-0b08ff32db8f admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:57.244418 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e9f8b1cc-4d51-4c11-a01e-0b08ff32db8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:57.262380 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d115f1e1-876d-4426-b189-d66abe6689e0 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:57.264049 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-d115f1e1-876d-4426-b189-d66abe6689e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:57.284527 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d115f1e1-876d-4426-b189-d66abe6689e0 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:57.292786 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9f13a-c3e5-4806-9abf-f3035b2db3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:57.293623 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9f13a-c3e5-4806-9abf-f3035b2db3df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:57.293905 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9f13a-c3e5-4806-9abf-f3035b2db3df admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:57.294177 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9f13a-c3e5-4806-9abf-f3035b2db3df admin admin] PATH_INFO: `/v3/projects/38fec4d2a68f4ab7b70ebcaabbc63bb0` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:57.295643 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a9f13a-c3e5-4806-9abf-f3035b2db3df admin admin] RBAC: Authorizing `identity:delete_project(project_id=38fec4d2a68f4ab7b70ebcaabbc63bb0)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:57.307163 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a9f13a-c3e5-4806-9abf-f3035b2db3df admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:57.371725 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8b1cc-4d51-4c11-a01e-0b08ff32db8f admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:57.419273 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-a0a9f13a-c3e5-4806-9abf-f3035b2db3df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38fec4d2a68f4ab7b70ebcaabbc63bb0', 'request_id': 'req-a0a9f13a-c3e5-4806-9abf-f3035b2db3df'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:57.434205 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-a0a9f13a-c3e5-4806-9abf-f3035b2db3df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38fec4d2a68f4ab7b70ebcaabbc63bb0', 'request_id': 'req-a0a9f13a-c3e5-4806-9abf-f3035b2db3df'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:57.458440 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-a0a9f13a-c3e5-4806-9abf-f3035b2db3df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38fec4d2a68f4ab7b70ebcaabbc63bb0', 'request_id': 'req-a0a9f13a-c3e5-4806-9abf-f3035b2db3df'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:57.485340 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-a0a9f13a-c3e5-4806-9abf-f3035b2db3df admin admin] The token cache is being invalidate because project 38fec4d2a68f4ab7b70ebcaabbc63bb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:35:57.485340 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-a0a9f13a-c3e5-4806-9abf-f3035b2db3df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:57.486120 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-a0a9f13a-c3e5-4806-9abf-f3035b2db3df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:57.492501 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1035/2073] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:35:57 2022] DELETE /identity/v3/projects/38fec4d2a68f4ab7b70ebcaabbc63bb0 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:57.492708 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658023d5-f9a9-43da-87e2-13e7fb4110ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:57.492708 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658023d5-f9a9-43da-87e2-13e7fb4110ff service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:57.493943 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9f13a-c3e5-4806-9abf-f3035b2db3df admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:57.495403 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-a0a9f13a-c3e5-4806-9abf-f3035b2db3df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:57.495832 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658023d5-f9a9-43da-87e2-13e7fb4110ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:57.496204 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658023d5-f9a9-43da-87e2-13e7fb4110ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:57.499666 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-658023d5-f9a9-43da-87e2-13e7fb4110ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:57.612994 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658023d5-f9a9-43da-87e2-13e7fb4110ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:57.614708 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658023d5-f9a9-43da-87e2-13e7fb4110ff service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:57.629009 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1039/2074] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:35:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:35:57.629358 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9f13a-c3e5-4806-9abf-f3035b2db3df admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:57.642906 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe9f10e-e165-4840-8c6a-66adfc09d8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:57.643821 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe9f10e-e165-4840-8c6a-66adfc09d8b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:57.644141 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe9f10e-e165-4840-8c6a-66adfc09d8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:57.644376 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe9f10e-e165-4840-8c6a-66adfc09d8b1 admin admin] PATH_INFO: `/v3/users/4a12aba1bfad4fcbb6bb34bf5c1ba7d1` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:57.645732 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe9f10e-e165-4840-8c6a-66adfc09d8b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a12aba1bfad4fcbb6bb34bf5c1ba7d1)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:57.650669 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe9f10e-e165-4840-8c6a-66adfc09d8b1 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:57.751327 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-5fe9f10e-e165-4840-8c6a-66adfc09d8b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a12aba1bfad4fcbb6bb34bf5c1ba7d1'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:57.752754 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-5fe9f10e-e165-4840-8c6a-66adfc09d8b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a12aba1bfad4fcbb6bb34bf5c1ba7d1'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:57.754926 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-5fe9f10e-e165-4840-8c6a-66adfc09d8b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a12aba1bfad4fcbb6bb34bf5c1ba7d1'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:57.768459 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-5fe9f10e-e165-4840-8c6a-66adfc09d8b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a12aba1bfad4fcbb6bb34bf5c1ba7d1'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:57.787506 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-5fe9f10e-e165-4840-8c6a-66adfc09d8b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a12aba1bfad4fcbb6bb34bf5c1ba7d1'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:57.793783 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:57.807547 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1036/2075] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:35:57 2022] DELETE /identity/v3/users/4a12aba1bfad4fcbb6bb34bf5c1ba7d1 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:58.054108 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658023d5-f9a9-43da-87e2-13e7fb4110ff service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:58.057070 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-658023d5-f9a9-43da-87e2-13e7fb4110ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:58.079815 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658023d5-f9a9-43da-87e2-13e7fb4110ff service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:58.153260 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:58.160103 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f7ea9-e25e-4162-a21d-6e26d0b37f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:58.160827 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f7ea9-e25e-4162-a21d-6e26d0b37f62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:58.161654 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f7ea9-e25e-4162-a21d-6e26d0b37f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:58.162326 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f7ea9-e25e-4162-a21d-6e26d0b37f62 admin admin] PATH_INFO: `/v3/projects/8991e0209e7247fca2dc3a45804b281a` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:58.163842 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6f7ea9-e25e-4162-a21d-6e26d0b37f62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8991e0209e7247fca2dc3a45804b281a)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:58.166513 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6f7ea9-e25e-4162-a21d-6e26d0b37f62 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:58.224945 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5c6f7ea9-e25e-4162-a21d-6e26d0b37f62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8991e0209e7247fca2dc3a45804b281a', 'request_id': 'req-5c6f7ea9-e25e-4162-a21d-6e26d0b37f62'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:58.231752 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5c6f7ea9-e25e-4162-a21d-6e26d0b37f62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8991e0209e7247fca2dc3a45804b281a', 'request_id': 'req-5c6f7ea9-e25e-4162-a21d-6e26d0b37f62'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:58.239608 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5c6f7ea9-e25e-4162-a21d-6e26d0b37f62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8991e0209e7247fca2dc3a45804b281a', 'request_id': 'req-5c6f7ea9-e25e-4162-a21d-6e26d0b37f62'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:58.256775 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5c6f7ea9-e25e-4162-a21d-6e26d0b37f62 admin admin] The token cache is being invalidate because project 8991e0209e7247fca2dc3a45804b281a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:35:58.257164 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5c6f7ea9-e25e-4162-a21d-6e26d0b37f62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:58.258084 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5c6f7ea9-e25e-4162-a21d-6e26d0b37f62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:58.263046 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1040/2076] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:35:58 2022] DELETE /identity/v3/projects/8991e0209e7247fca2dc3a45804b281a => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:58.265186 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe9f10e-e165-4840-8c6a-66adfc09d8b1 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:58.266454 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-5fe9f10e-e165-4840-8c6a-66adfc09d8b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:58.280646 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe9f10e-e165-4840-8c6a-66adfc09d8b1 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:58.421747 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1358aeb-cea7-402b-ac3a-e5a3d645fb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:58.422899 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1358aeb-cea7-402b-ac3a-e5a3d645fb73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:58.423340 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1358aeb-cea7-402b-ac3a-e5a3d645fb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:58.423858 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1358aeb-cea7-402b-ac3a-e5a3d645fb73 admin admin] PATH_INFO: `/v3/users/f753755775cc42118bbafd67cfc07657` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:58.425807 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1358aeb-cea7-402b-ac3a-e5a3d645fb73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f753755775cc42118bbafd67cfc07657)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:58.427926 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1358aeb-cea7-402b-ac3a-e5a3d645fb73 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:58.509144 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f7ea9-e25e-4162-a21d-6e26d0b37f62 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:58.510886 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5c6f7ea9-e25e-4162-a21d-6e26d0b37f62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:58.520960 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-d1358aeb-cea7-402b-ac3a-e5a3d645fb73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f753755775cc42118bbafd67cfc07657'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:58.521705 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-d1358aeb-cea7-402b-ac3a-e5a3d645fb73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f753755775cc42118bbafd67cfc07657'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:58.525345 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-d1358aeb-cea7-402b-ac3a-e5a3d645fb73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f753755775cc42118bbafd67cfc07657'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:58.530539 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f7ea9-e25e-4162-a21d-6e26d0b37f62 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:58.536703 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-d1358aeb-cea7-402b-ac3a-e5a3d645fb73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f753755775cc42118bbafd67cfc07657'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:58.550438 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9dd074-c3eb-4d95-9e1f-41347770cc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:58.550929 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9dd074-c3eb-4d95-9e1f-41347770cc0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:58.551700 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9dd074-c3eb-4d95-9e1f-41347770cc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:58.552005 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9dd074-c3eb-4d95-9e1f-41347770cc0a admin admin] PATH_INFO: `/v3/projects/11c8b73179574ff9b4105fd2df8beb56` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:58.553291 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9dd074-c3eb-4d95-9e1f-41347770cc0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=11c8b73179574ff9b4105fd2df8beb56)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:58.558585 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9dd074-c3eb-4d95-9e1f-41347770cc0a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:58.585227 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-d1358aeb-cea7-402b-ac3a-e5a3d645fb73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f753755775cc42118bbafd67cfc07657'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:58.610554 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1037/2077] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:35:58 2022] DELETE /identity/v3/users/f753755775cc42118bbafd67cfc07657 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:35:58.689236 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-bb9dd074-c3eb-4d95-9e1f-41347770cc0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11c8b73179574ff9b4105fd2df8beb56', 'request_id': 'req-bb9dd074-c3eb-4d95-9e1f-41347770cc0a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:58.705153 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-bb9dd074-c3eb-4d95-9e1f-41347770cc0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11c8b73179574ff9b4105fd2df8beb56', 'request_id': 'req-bb9dd074-c3eb-4d95-9e1f-41347770cc0a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:58.726311 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-bb9dd074-c3eb-4d95-9e1f-41347770cc0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11c8b73179574ff9b4105fd2df8beb56', 'request_id': 'req-bb9dd074-c3eb-4d95-9e1f-41347770cc0a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:58.764697 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-bb9dd074-c3eb-4d95-9e1f-41347770cc0a admin admin] The token cache is being invalidate because project 11c8b73179574ff9b4105fd2df8beb56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:35:58.765210 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-bb9dd074-c3eb-4d95-9e1f-41347770cc0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:58.774475 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-bb9dd074-c3eb-4d95-9e1f-41347770cc0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:58.778023 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1041/2078] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:35:58 2022] DELETE /identity/v3/projects/11c8b73179574ff9b4105fd2df8beb56 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:35:58.790902 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b69d8-2fb6-4360-bf29-99ff484aec38 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:58.794012 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b69d8-2fb6-4360-bf29-99ff484aec38 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:58.794852 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b69d8-2fb6-4360-bf29-99ff484aec38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:58.870541 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-1b5b69d8-2fb6-4360-bf29-99ff484aec38 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:58.875232 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-1b5b69d8-2fb6-4360-bf29-99ff484aec38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:59.058433 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1038/2079] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:59.060244 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf6813-52ea-4c70-a2d3-d1e21a443630 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:59.060493 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf6813-52ea-4c70-a2d3-d1e21a443630 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:59.060860 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf6813-52ea-4c70-a2d3-d1e21a443630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:59.105114 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-bdcf6813-52ea-4c70-a2d3-d1e21a443630 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:59.106145 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-bdcf6813-52ea-4c70-a2d3-d1e21a443630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:59.123801 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1042/2080] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:35:59.125865 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b69d8-2fb6-4360-bf29-99ff484aec38 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:59.144947 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b69d8-2fb6-4360-bf29-99ff484aec38 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:59.152083 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eab201-af67-4dd7-8814-b969648a4a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:59.152760 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eab201-af67-4dd7-8814-b969648a4a12 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:59.153094 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eab201-af67-4dd7-8814-b969648a4a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:59.153371 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eab201-af67-4dd7-8814-b969648a4a12 admin admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:59.154111 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eab201-af67-4dd7-8814-b969648a4a12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:35:59.154419 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eab201-af67-4dd7-8814-b969648a4a12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:59.156080 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eab201-af67-4dd7-8814-b969648a4a12 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:59.176444 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf6813-52ea-4c70-a2d3-d1e21a443630 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:59.177946 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-bdcf6813-52ea-4c70-a2d3-d1e21a443630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:59.204415 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:59.206727 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf6813-52ea-4c70-a2d3-d1e21a443630 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:59.211981 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1039/2081] 10.222.0.16 () {58 vars in 1152 bytes} [Thu May 26 12:35:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:35:59.216153 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eab201-af67-4dd7-8814-b969648a4a12 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:59.219035 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c010da-78d0-40a2-b003-fcf90f0875c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:59.220483 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c010da-78d0-40a2-b003-fcf90f0875c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:59.221369 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c010da-78d0-40a2-b003-fcf90f0875c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:59.222050 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c010da-78d0-40a2-b003-fcf90f0875c6 admin admin] PATH_INFO: `/v3/projects/b3cdc6e4fd71467da8756279b14e0347` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:59.223615 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c010da-78d0-40a2-b003-fcf90f0875c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3cdc6e4fd71467da8756279b14e0347)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:59.227342 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c010da-78d0-40a2-b003-fcf90f0875c6 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:59.236265 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eab201-af67-4dd7-8814-b969648a4a12 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:59.248658 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeed25c-778c-400e-a9de-2793c96b1bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:59.250369 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeed25c-778c-400e-a9de-2793c96b1bab admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:59.251013 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeed25c-778c-400e-a9de-2793c96b1bab admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:59.251499 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeed25c-778c-400e-a9de-2793c96b1bab admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:59.252425 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeed25c-778c-400e-a9de-2793c96b1bab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:59.254671 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeed25c-778c-400e-a9de-2793c96b1bab admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:59.296602 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1040/2082] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:35:59 2022] POST /identity/v3/projects => generated 363 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:35:59.296602 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38493ece-9c60-403c-9657-3b420a6c2d6a None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:59.296602 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38493ece-9c60-403c-9657-3b420a6c2d6a None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:59.296602 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38493ece-9c60-403c-9657-3b420a6c2d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:59.322399 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-38493ece-9c60-403c-9657-3b420a6c2d6a None None] MFA Rules not processed for user `41661c29981b4667a1621e894e3f3d29`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:59.323609 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-38493ece-9c60-403c-9657-3b420a6c2d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:59.349998 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-57c010da-78d0-40a2-b003-fcf90f0875c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3cdc6e4fd71467da8756279b14e0347', 'request_id': 'req-57c010da-78d0-40a2-b003-fcf90f0875c6'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:59.365216 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-57c010da-78d0-40a2-b003-fcf90f0875c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3cdc6e4fd71467da8756279b14e0347', 'request_id': 'req-57c010da-78d0-40a2-b003-fcf90f0875c6'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:59.366883 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:59.382252 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-57c010da-78d0-40a2-b003-fcf90f0875c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3cdc6e4fd71467da8756279b14e0347', 'request_id': 'req-57c010da-78d0-40a2-b003-fcf90f0875c6'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:59.415177 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-57c010da-78d0-40a2-b003-fcf90f0875c6 admin admin] The token cache is being invalidate because project b3cdc6e4fd71467da8756279b14e0347 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:35:59.415534 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-57c010da-78d0-40a2-b003-fcf90f0875c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:59.416555 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-57c010da-78d0-40a2-b003-fcf90f0875c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:59.418658 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1043/2083] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:35:59 2022] DELETE /identity/v3/projects/b3cdc6e4fd71467da8756279b14e0347 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:59.419564 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c010da-78d0-40a2-b003-fcf90f0875c6 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:59.421524 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1041/2084] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:59.422274 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-57c010da-78d0-40a2-b003-fcf90f0875c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:59.424487 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f552249d-746c-4174-9f0f-f5c177655934 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:59.425225 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f552249d-746c-4174-9f0f-f5c177655934 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:59.426111 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f552249d-746c-4174-9f0f-f5c177655934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:59.450502 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-f552249d-746c-4174-9f0f-f5c177655934 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:59.452020 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-f552249d-746c-4174-9f0f-f5c177655934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:59.539735 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1042/2085] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:59.548198 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b452fc9-3620-4c66-b294-66c0e7a23e1a None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:59.548491 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b452fc9-3620-4c66-b294-66c0e7a23e1a None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:59.548770 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b452fc9-3620-4c66-b294-66c0e7a23e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:59.551143 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c010da-78d0-40a2-b003-fcf90f0875c6 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:59.560362 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19029d2-1478-4280-a7bc-d5edd7b323f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:59.561116 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19029d2-1478-4280-a7bc-d5edd7b323f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:59.561399 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19029d2-1478-4280-a7bc-d5edd7b323f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:59.561746 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19029d2-1478-4280-a7bc-d5edd7b323f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:59.562447 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19029d2-1478-4280-a7bc-d5edd7b323f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:59.564603 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19029d2-1478-4280-a7bc-d5edd7b323f5 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:59.576311 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-3b452fc9-3620-4c66-b294-66c0e7a23e1a None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:59.577914 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-3b452fc9-3620-4c66-b294-66c0e7a23e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:59.589374 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1044/2086] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:35:59 2022] POST /identity/v3/users => generated 282 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:35:59.594078 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1043/2087] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:35:59.594455 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b452fc9-3620-4c66-b294-66c0e7a23e1a None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:59.595915 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19029d2-1478-4280-a7bc-d5edd7b323f5 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:59.606509 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b452fc9-3620-4c66-b294-66c0e7a23e1a None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:59.610138 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19029d2-1478-4280-a7bc-d5edd7b323f5 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:59.612736 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a8333-2e6c-4c57-b7ba-eb6594a5656f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:59.613455 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a8333-2e6c-4c57-b7ba-eb6594a5656f admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:59.613744 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a8333-2e6c-4c57-b7ba-eb6594a5656f admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:59.614084 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a8333-2e6c-4c57-b7ba-eb6594a5656f admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:59.614781 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76a8333-2e6c-4c57-b7ba-eb6594a5656f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:59.616420 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76a8333-2e6c-4c57-b7ba-eb6594a5656f admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:59.617445 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a189fd0-bb6c-478b-8334-617f0e5b2423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:59.618349 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a189fd0-bb6c-478b-8334-617f0e5b2423 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:59.618830 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a189fd0-bb6c-478b-8334-617f0e5b2423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:59.619275 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a189fd0-bb6c-478b-8334-617f0e5b2423 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:59.620330 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a189fd0-bb6c-478b-8334-617f0e5b2423 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:35:59.621050 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a189fd0-bb6c-478b-8334-617f0e5b2423 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:59.622828 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a189fd0-bb6c-478b-8334-617f0e5b2423 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:59.628997 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1044/2088] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:35:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:35:59.632931 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a8333-2e6c-4c57-b7ba-eb6594a5656f admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:59.641461 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1045/2089] 10.222.0.16 () {58 vars in 1152 bytes} [Thu May 26 12:35:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:35:59.645399 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a189fd0-bb6c-478b-8334-617f0e5b2423 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:59.651061 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a8333-2e6c-4c57-b7ba-eb6594a5656f admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:59.657045 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36818a4b-854e-4ef7-a2cb-491726f3acf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:59.657203 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a189fd0-bb6c-478b-8334-617f0e5b2423 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:59.658170 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36818a4b-854e-4ef7-a2cb-491726f3acf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:59.658684 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36818a4b-854e-4ef7-a2cb-491726f3acf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:59.659177 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36818a4b-854e-4ef7-a2cb-491726f3acf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:59.660327 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36818a4b-854e-4ef7-a2cb-491726f3acf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:59.662076 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8fdbf7-6ed3-48c8-bf17-2c5ed3557fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:59.662643 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36818a4b-854e-4ef7-a2cb-491726f3acf7 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:59.662754 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fdbf7-6ed3-48c8-bf17-2c5ed3557fd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:59.662996 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fdbf7-6ed3-48c8-bf17-2c5ed3557fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:59.663270 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fdbf7-6ed3-48c8-bf17-2c5ed3557fd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:59.663952 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8fdbf7-6ed3-48c8-bf17-2c5ed3557fd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:59.666085 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8fdbf7-6ed3-48c8-bf17-2c5ed3557fd3 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:59.676267 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1045/2090] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:35:59 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:35:59.680772 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36818a4b-854e-4ef7-a2cb-491726f3acf7 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:59.695285 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36818a4b-854e-4ef7-a2cb-491726f3acf7 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:59.704064 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d589ccea-fdd5-4f59-901e-1149675fca25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:59.704501 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589ccea-fdd5-4f59-901e-1149675fca25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:59.704784 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589ccea-fdd5-4f59-901e-1149675fca25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:59.705072 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589ccea-fdd5-4f59-901e-1149675fca25 admin admin] PATH_INFO: `/v3/projects/3311cea55327414dae619439e8e869a2/users/aad5557edc2b4787b2470ff8ea245bdb/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:59.711413 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1046/2091] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:35:59 2022] POST /identity/v3/projects => generated 383 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:35:59.712758 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8fdbf7-6ed3-48c8-bf17-2c5ed3557fd3 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:59.729707 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d589ccea-fdd5-4f59-901e-1149675fca25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3311cea55327414dae619439e8e869a2, user_id=aad5557edc2b4787b2470ff8ea245bdb, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:59.734144 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d589ccea-fdd5-4f59-901e-1149675fca25 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:59.765888 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1046/2092] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:35:59 2022] PUT /identity/v3/projects/3311cea55327414dae619439e8e869a2/users/aad5557edc2b4787b2470ff8ea245bdb/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:35:59.768383 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a73ebe-c279-4c6f-b229-cd00d625bce9 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:59.768885 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a73ebe-c279-4c6f-b229-cd00d625bce9 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:59.769188 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a73ebe-c279-4c6f-b229-cd00d625bce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:59.811035 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-58a73ebe-c279-4c6f-b229-cd00d625bce9 None None] MFA Rules not processed for user `aad5557edc2b4787b2470ff8ea245bdb`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:59.812995 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-58a73ebe-c279-4c6f-b229-cd00d625bce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:59.817192 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8fdbf7-6ed3-48c8-bf17-2c5ed3557fd3 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:59.835997 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:59.880675 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:59.904628 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1047/2093] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:35:59 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:59.908223 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f55db2-7f37-4046-a345-dcd87ab68a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:59.908958 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f55db2-7f37-4046-a345-dcd87ab68a2b admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:59.909362 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f55db2-7f37-4046-a345-dcd87ab68a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:59.909645 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f55db2-7f37-4046-a345-dcd87ab68a2b admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:59.910352 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f55db2-7f37-4046-a345-dcd87ab68a2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:59.912622 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f55db2-7f37-4046-a345-dcd87ab68a2b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:59.913834 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a73ebe-c279-4c6f-b229-cd00d625bce9 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:59.929781 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a73ebe-c279-4c6f-b229-cd00d625bce9 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:59.936667 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a9bf00-d60d-485d-ae4c-517359398d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:59.937493 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9bf00-d60d-485d-ae4c-517359398d36 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:59.937787 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9bf00-d60d-485d-ae4c-517359398d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:59.938066 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9bf00-d60d-485d-ae4c-517359398d36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:59.938809 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a9bf00-d60d-485d-ae4c-517359398d36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:59.940510 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1047/2094] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:35:59 2022] POST /identity/v3/users => generated 292 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:35:59.944938 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f55db2-7f37-4046-a345-dcd87ab68a2b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:59.946454 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a9bf00-d60d-485d-ae4c-517359398d36 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:59.963175 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f55db2-7f37-4046-a345-dcd87ab68a2b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:59.971689 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d5c07-c162-4932-a27c-bc43aa069dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:59.972470 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d5c07-c162-4932-a27c-bc43aa069dc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:59.972653 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d5c07-c162-4932-a27c-bc43aa069dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:59.972961 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d5c07-c162-4932-a27c-bc43aa069dc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:59.973704 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d5c07-c162-4932-a27c-bc43aa069dc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:59.976694 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d5c07-c162-4932-a27c-bc43aa069dc3 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:59.994506 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1048/2095] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:35:59 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:35:59.996009 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d5c07-c162-4932-a27c-bc43aa069dc3 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:00.006392 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1048/2096] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:35:59 2022] POST /identity/v3/projects => generated 367 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:36:00.007658 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a9bf00-d60d-485d-ae4c-517359398d36 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:00.011656 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d5c07-c162-4932-a27c-bc43aa069dc3 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:00.160360 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a9bf00-d60d-485d-ae4c-517359398d36 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:00.167727 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5743362f-f859-4593-8fdb-204a181e679b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:00.168505 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743362f-f859-4593-8fdb-204a181e679b admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:00.168924 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743362f-f859-4593-8fdb-204a181e679b admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:00.169326 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743362f-f859-4593-8fdb-204a181e679b admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:00.170139 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5743362f-f859-4593-8fdb-204a181e679b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:00.171130 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de682ea7-1abf-4651-b03d-cb146efa4e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:00.172520 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de682ea7-1abf-4651-b03d-cb146efa4e1a admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:00.173132 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de682ea7-1abf-4651-b03d-cb146efa4e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:00.173593 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de682ea7-1abf-4651-b03d-cb146efa4e1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:00.173930 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5743362f-f859-4593-8fdb-204a181e679b admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:00.175447 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de682ea7-1abf-4651-b03d-cb146efa4e1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:00.177615 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de682ea7-1abf-4651-b03d-cb146efa4e1a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:00.206702 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1049/2097] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:35:59 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:36:00.215308 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de682ea7-1abf-4651-b03d-cb146efa4e1a admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:00.220365 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1049/2098] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:36:00 2022] POST /identity/v3/users => generated 290 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:36:00.224417 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5743362f-f859-4593-8fdb-204a181e679b admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:00.235119 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de682ea7-1abf-4651-b03d-cb146efa4e1a admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:00.242387 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5743362f-f859-4593-8fdb-204a181e679b admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:00.253750 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e24abe-dbde-4d54-82b8-ccac9d8cf425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:00.254967 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d08b6c8-d677-41d2-a748-97ad26cb2d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:00.255104 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e24abe-dbde-4d54-82b8-ccac9d8cf425 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:00.255398 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e24abe-dbde-4d54-82b8-ccac9d8cf425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:00.256417 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08b6c8-d677-41d2-a748-97ad26cb2d7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:00.256706 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08b6c8-d677-41d2-a748-97ad26cb2d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:00.257018 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08b6c8-d677-41d2-a748-97ad26cb2d7b admin admin] PATH_INFO: `/v3/projects/d8ec9eb97749472dac98cd4b6f540547/users/5ee5df3ae35f4ab48c2085d488b5724d/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:00.257824 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e24abe-dbde-4d54-82b8-ccac9d8cf425 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:00.258596 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e24abe-dbde-4d54-82b8-ccac9d8cf425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:00.260365 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e24abe-dbde-4d54-82b8-ccac9d8cf425 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:00.277159 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1050/2099] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:36:00.283671 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e24abe-dbde-4d54-82b8-ccac9d8cf425 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:00.298638 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e24abe-dbde-4d54-82b8-ccac9d8cf425 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:00.303770 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c3d20-8fec-4142-9ec2-3dbc14c5053c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:00.304665 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c3d20-8fec-4142-9ec2-3dbc14c5053c admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:00.305441 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c3d20-8fec-4142-9ec2-3dbc14c5053c admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:00.305698 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c3d20-8fec-4142-9ec2-3dbc14c5053c admin admin] PATH_INFO: `/v3/projects/99c340cbfc5e4c3bb33de3f2d6879363/users/5569657a15cd41a8a2f6b2bb474600a8/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:00.306314 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d08b6c8-d677-41d2-a748-97ad26cb2d7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8ec9eb97749472dac98cd4b6f540547, user_id=5ee5df3ae35f4ab48c2085d488b5724d, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:00.309303 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d08b6c8-d677-41d2-a748-97ad26cb2d7b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:00.333376 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1050/2100] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:36:00 2022] PUT /identity/v3/projects/d8ec9eb97749472dac98cd4b6f540547/users/5ee5df3ae35f4ab48c2085d488b5724d/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:36:00.338075 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9b932-ba25-426a-b97d-b2cec2469307 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:00.338843 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9b932-ba25-426a-b97d-b2cec2469307 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:00.339199 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9b932-ba25-426a-b97d-b2cec2469307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:00.347213 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9c3d20-8fec-4142-9ec2-3dbc14c5053c admin admin] RBAC: Authorizing `identity:create_grant(project_id=99c340cbfc5e4c3bb33de3f2d6879363, user_id=5569657a15cd41a8a2f6b2bb474600a8, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:00.352685 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9c3d20-8fec-4142-9ec2-3dbc14c5053c admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:00.365286 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-4bb9b932-ba25-426a-b97d-b2cec2469307 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:00.367434 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4bb9b932-ba25-426a-b97d-b2cec2469307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:00.394636 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1051/2101] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:36:00 2022] PUT /identity/v3/projects/99c340cbfc5e4c3bb33de3f2d6879363/users/5569657a15cd41a8a2f6b2bb474600a8/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:36:00.398633 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c3d20-8fec-4142-9ec2-3dbc14c5053c admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:00.482171 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1051/2102] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:36:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:36:00.488187 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:00.498349 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb9b932-ba25-426a-b97d-b2cec2469307 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:00.502662 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c3d20-8fec-4142-9ec2-3dbc14c5053c admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:00.505758 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4bb9b932-ba25-426a-b97d-b2cec2469307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:00.514228 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d128fe-5569-4972-ae0e-bba3019bdc2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:00.515574 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d128fe-5569-4972-ae0e-bba3019bdc2f admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:00.516092 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d128fe-5569-4972-ae0e-bba3019bdc2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:00.517004 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d128fe-5569-4972-ae0e-bba3019bdc2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:00.518326 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d128fe-5569-4972-ae0e-bba3019bdc2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:00.521037 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d128fe-5569-4972-ae0e-bba3019bdc2f admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:00.534145 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1052/2103] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:36:00.538394 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d128fe-5569-4972-ae0e-bba3019bdc2f admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:00.551964 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d128fe-5569-4972-ae0e-bba3019bdc2f admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:00.558267 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b5bb59-7b0e-404d-ab33-1d8f0d58a4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:00.559170 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5bb59-7b0e-404d-ab33-1d8f0d58a4b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:00.559458 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5bb59-7b0e-404d-ab33-1d8f0d58a4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:00.559739 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5bb59-7b0e-404d-ab33-1d8f0d58a4b3 admin admin] PATH_INFO: `/v3/projects/99c340cbfc5e4c3bb33de3f2d6879363/users/5569657a15cd41a8a2f6b2bb474600a8/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:00.566796 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:00.572873 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b5bb59-7b0e-404d-ab33-1d8f0d58a4b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99c340cbfc5e4c3bb33de3f2d6879363, user_id=5569657a15cd41a8a2f6b2bb474600a8, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:00.576641 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b5bb59-7b0e-404d-ab33-1d8f0d58a4b3 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:00.591103 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1053/2104] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:36:00 2022] PUT /identity/v3/projects/99c340cbfc5e4c3bb33de3f2d6879363/users/5569657a15cd41a8a2f6b2bb474600a8/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:36:00.599929 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb9b932-ba25-426a-b97d-b2cec2469307 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:00.601529 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc629ecd-349e-421e-88a7-de1e1af73024 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:00.601823 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc629ecd-349e-421e-88a7-de1e1af73024 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:00.602105 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc629ecd-349e-421e-88a7-de1e1af73024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:00.657755 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-dc629ecd-349e-421e-88a7-de1e1af73024 None None] MFA Rules not processed for user `5569657a15cd41a8a2f6b2bb474600a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:00.657755 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-dc629ecd-349e-421e-88a7-de1e1af73024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:00.662196 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5481a-5fb7-40c7-bc9a-dbdcf81354b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:00.662865 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5481a-5fb7-40c7-bc9a-dbdcf81354b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:00.663151 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5481a-5fb7-40c7-bc9a-dbdcf81354b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:00.663433 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5481a-5fb7-40c7-bc9a-dbdcf81354b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:00.766518 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda5481a-5fb7-40c7-bc9a-dbdcf81354b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:00.768008 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda5481a-5fb7-40c7-bc9a-dbdcf81354b0 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:00.773286 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1054/2105] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:36:00 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:36:00.786849 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc629ecd-349e-421e-88a7-de1e1af73024 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:00.788791 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-dc629ecd-349e-421e-88a7-de1e1af73024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:00.793547 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1052/2106] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:36:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:36:00.877082 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc629ecd-349e-421e-88a7-de1e1af73024 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:00.881855 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175078ff-8736-47a6-823e-c165b6189d55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:00.882621 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175078ff-8736-47a6-823e-c165b6189d55 service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:00.883079 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175078ff-8736-47a6-823e-c165b6189d55 service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:00.883416 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175078ff-8736-47a6-823e-c165b6189d55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:00.900308 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175078ff-8736-47a6-823e-c165b6189d55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:00.901911 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175078ff-8736-47a6-823e-c165b6189d55 service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:00.917974 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1055/2107] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:36:00 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:36:01.030079 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5481a-5fb7-40c7-bc9a-dbdcf81354b0 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:01.044302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5481a-5fb7-40c7-bc9a-dbdcf81354b0 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:01.049448 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd357d9d-f084-405b-a14d-62ffcb39e000 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:01.050331 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd357d9d-f084-405b-a14d-62ffcb39e000 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:01.050708 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd357d9d-f084-405b-a14d-62ffcb39e000 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:01.051132 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd357d9d-f084-405b-a14d-62ffcb39e000 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:01.131292 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd357d9d-f084-405b-a14d-62ffcb39e000 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:01.132758 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd357d9d-f084-405b-a14d-62ffcb39e000 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:01.143685 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1053/2108] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:36:01 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:36:06.982305 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e11bab-a553-42b9-b0d1-f60d703e155c None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:06.982884 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e11bab-a553-42b9-b0d1-f60d703e155c None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:06.982884 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e11bab-a553-42b9-b0d1-f60d703e155c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:07.035041 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-c1e11bab-a553-42b9-b0d1-f60d703e155c None None] MFA Rules not processed for user `5ee5df3ae35f4ab48c2085d488b5724d`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:07.036449 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-c1e11bab-a553-42b9-b0d1-f60d703e155c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:07.121644 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd357d9d-f084-405b-a14d-62ffcb39e000 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:07.124920 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:07.132672 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd357d9d-f084-405b-a14d-62ffcb39e000 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:07.138815 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84df7b30-00d9-4c75-8779-af5fb9bce0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:07.139865 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df7b30-00d9-4c75-8779-af5fb9bce0f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:07.140144 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df7b30-00d9-4c75-8779-af5fb9bce0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:07.140416 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df7b30-00d9-4c75-8779-af5fb9bce0f5 admin admin] PATH_INFO: `/v3/users/aad5557edc2b4787b2470ff8ea245bdb` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:07.140938 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1056/2109] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:36:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:36:07.145091 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84df7b30-00d9-4c75-8779-af5fb9bce0f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aad5557edc2b4787b2470ff8ea245bdb)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:07.145410 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e11bab-a553-42b9-b0d1-f60d703e155c None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:07.147048 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84df7b30-00d9-4c75-8779-af5fb9bce0f5 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:07.157190 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e11bab-a553-42b9-b0d1-f60d703e155c None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:07.162258 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb48dfa-c238-4300-b50c-a435af465cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:07.162937 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb48dfa-c238-4300-b50c-a435af465cbc admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:07.163669 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb48dfa-c238-4300-b50c-a435af465cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:07.163956 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb48dfa-c238-4300-b50c-a435af465cbc admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:07.165419 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb48dfa-c238-4300-b50c-a435af465cbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:07.168511 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb48dfa-c238-4300-b50c-a435af465cbc admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:07.199505 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:07.202321 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1057/2110] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:36:07 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:36:07.204610 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb48dfa-c238-4300-b50c-a435af465cbc admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:07.210285 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-84df7b30-00d9-4c75-8779-af5fb9bce0f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aad5557edc2b4787b2470ff8ea245bdb'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:07.218988 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-84df7b30-00d9-4c75-8779-af5fb9bce0f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aad5557edc2b4787b2470ff8ea245bdb'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:07.220047 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-84df7b30-00d9-4c75-8779-af5fb9bce0f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aad5557edc2b4787b2470ff8ea245bdb'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:07.220865 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-84df7b30-00d9-4c75-8779-af5fb9bce0f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aad5557edc2b4787b2470ff8ea245bdb'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:07.229065 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-84df7b30-00d9-4c75-8779-af5fb9bce0f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aad5557edc2b4787b2470ff8ea245bdb'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:07.261273 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1054/2111] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:36:07 2022] DELETE /identity/v3/users/aad5557edc2b4787b2470ff8ea245bdb => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:36:07.265822 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c4a9c-240e-4815-9291-715ca92520cc None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:07.266114 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c4a9c-240e-4815-9291-715ca92520cc None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:07.266439 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c4a9c-240e-4815-9291-715ca92520cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:07.273926 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb48dfa-c238-4300-b50c-a435af465cbc admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:07.286207 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-029c4a9c-240e-4815-9291-715ca92520cc None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:07.287759 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-029c4a9c-240e-4815-9291-715ca92520cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:07.353593 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657e6eae-299f-4236-84b9-c067c6d12c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:07.354321 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e6eae-299f-4236-84b9-c067c6d12c96 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:07.354460 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e6eae-299f-4236-84b9-c067c6d12c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:07.354719 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e6eae-299f-4236-84b9-c067c6d12c96 admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:07.355419 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657e6eae-299f-4236-84b9-c067c6d12c96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:07.357498 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657e6eae-299f-4236-84b9-c067c6d12c96 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:07.375788 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1055/2112] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:36:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:36:07.386556 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029c4a9c-240e-4815-9291-715ca92520cc None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:07.388739 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-029c4a9c-240e-4815-9291-715ca92520cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:07.393622 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1058/2113] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:36:07 2022] POST /identity/v3/users => generated 298 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:36:07.397112 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657e6eae-299f-4236-84b9-c067c6d12c96 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:07.398806 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-657e6eae-299f-4236-84b9-c067c6d12c96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:07.412551 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657e6eae-299f-4236-84b9-c067c6d12c96 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:07.418655 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06e109-c1d6-4dfc-a8f2-41efebe313a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:07.419333 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06e109-c1d6-4dfc-a8f2-41efebe313a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:07.420054 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06e109-c1d6-4dfc-a8f2-41efebe313a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:07.420054 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06e109-c1d6-4dfc-a8f2-41efebe313a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:07.420615 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a06e109-c1d6-4dfc-a8f2-41efebe313a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:07.422288 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a06e109-c1d6-4dfc-a8f2-41efebe313a4 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:07.436881 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1059/2114] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:36:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:36:07.438545 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06e109-c1d6-4dfc-a8f2-41efebe313a4 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:07.466821 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06e109-c1d6-4dfc-a8f2-41efebe313a4 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:07.469258 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029c4a9c-240e-4815-9291-715ca92520cc None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:07.471969 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dad6d3-8cfe-4463-abe6-e53e0d8bb15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:07.472937 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dad6d3-8cfe-4463-abe6-e53e0d8bb15b admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:07.473173 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dad6d3-8cfe-4463-abe6-e53e0d8bb15b admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:07.473741 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dad6d3-8cfe-4463-abe6-e53e0d8bb15b admin admin] PATH_INFO: `/v3/projects/4cc1296236294831b6a530ff7a478651/users/6b2fb8e48ba942ab91cc5e5bfa3fa2db/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:07.474472 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec8181-719c-454d-9afd-c050599458a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:07.475182 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec8181-719c-454d-9afd-c050599458a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:07.475525 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec8181-719c-454d-9afd-c050599458a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:07.475930 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec8181-719c-454d-9afd-c050599458a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:07.487321 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cec8181-719c-454d-9afd-c050599458a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:07.489578 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cec8181-719c-454d-9afd-c050599458a7 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:07.498726 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dad6d3-8cfe-4463-abe6-e53e0d8bb15b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cc1296236294831b6a530ff7a478651, user_id=6b2fb8e48ba942ab91cc5e5bfa3fa2db, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:07.501689 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dad6d3-8cfe-4463-abe6-e53e0d8bb15b admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:07.504412 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1056/2115] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:36:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:36:07.524223 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1060/2116] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:36:07 2022] PUT /identity/v3/projects/4cc1296236294831b6a530ff7a478651/users/6b2fb8e48ba942ab91cc5e5bfa3fa2db/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:36:07.528003 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec8181-719c-454d-9afd-c050599458a7 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:07.538069 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec8181-719c-454d-9afd-c050599458a7 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:07.622492 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8fc6ff-cca7-471f-8033-cfeeeafc17b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:07.623236 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fc6ff-cca7-471f-8033-cfeeeafc17b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:07.623590 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fc6ff-cca7-471f-8033-cfeeeafc17b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:07.623873 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fc6ff-cca7-471f-8033-cfeeeafc17b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:07.625295 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8fc6ff-cca7-471f-8033-cfeeeafc17b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:07.626910 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8fc6ff-cca7-471f-8033-cfeeeafc17b2 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:07.628773 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:07.646569 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1057/2117] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:36:07 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:36:07.647981 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dad6d3-8cfe-4463-abe6-e53e0d8bb15b admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:07.662237 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dad6d3-8cfe-4463-abe6-e53e0d8bb15b admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:07.684157 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1429091-d232-4cf1-87bb-08ffbf45a2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:07.685859 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1429091-d232-4cf1-87bb-08ffbf45a2f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:07.686149 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1429091-d232-4cf1-87bb-08ffbf45a2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:07.687277 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1429091-d232-4cf1-87bb-08ffbf45a2f2 admin admin] PATH_INFO: `/v3/projects/4cc1296236294831b6a530ff7a478651/users/6b2fb8e48ba942ab91cc5e5bfa3fa2db/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:07.695010 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1429091-d232-4cf1-87bb-08ffbf45a2f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cc1296236294831b6a530ff7a478651, user_id=6b2fb8e48ba942ab91cc5e5bfa3fa2db, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:07.698572 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1429091-d232-4cf1-87bb-08ffbf45a2f2 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:07.714771 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1061/2118] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:36:07 2022] PUT /identity/v3/projects/4cc1296236294831b6a530ff7a478651/users/6b2fb8e48ba942ab91cc5e5bfa3fa2db/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:36:07.948921 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8fc6ff-cca7-471f-8033-cfeeeafc17b2 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:07.951598 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ea8fc6ff-cca7-471f-8033-cfeeeafc17b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:07.980277 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8fc6ff-cca7-471f-8033-cfeeeafc17b2 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:08.094974 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52056949-d96d-4c9c-b337-8cf7a3a1cab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:08.096031 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52056949-d96d-4c9c-b337-8cf7a3a1cab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:08.096538 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52056949-d96d-4c9c-b337-8cf7a3a1cab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:08.097054 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52056949-d96d-4c9c-b337-8cf7a3a1cab7 admin admin] PATH_INFO: `/v3/projects/3311cea55327414dae619439e8e869a2` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:08.098747 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52056949-d96d-4c9c-b337-8cf7a3a1cab7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3311cea55327414dae619439e8e869a2)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:08.101146 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52056949-d96d-4c9c-b337-8cf7a3a1cab7 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:08.198856 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-52056949-d96d-4c9c-b337-8cf7a3a1cab7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3311cea55327414dae619439e8e869a2', 'request_id': 'req-52056949-d96d-4c9c-b337-8cf7a3a1cab7'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:08.210777 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-52056949-d96d-4c9c-b337-8cf7a3a1cab7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3311cea55327414dae619439e8e869a2', 'request_id': 'req-52056949-d96d-4c9c-b337-8cf7a3a1cab7'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:08.220532 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-52056949-d96d-4c9c-b337-8cf7a3a1cab7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3311cea55327414dae619439e8e869a2', 'request_id': 'req-52056949-d96d-4c9c-b337-8cf7a3a1cab7'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:08.248787 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-52056949-d96d-4c9c-b337-8cf7a3a1cab7 admin admin] The token cache is being invalidate because project 3311cea55327414dae619439e8e869a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:36:08.249320 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-52056949-d96d-4c9c-b337-8cf7a3a1cab7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:08.250100 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-52056949-d96d-4c9c-b337-8cf7a3a1cab7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:08.251907 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1058/2119] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:36:07 2022] DELETE /identity/v3/projects/3311cea55327414dae619439e8e869a2 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:36:08.255934 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1429091-d232-4cf1-87bb-08ffbf45a2f2 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:08.257820 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-d1429091-d232-4cf1-87bb-08ffbf45a2f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:08.280079 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1429091-d232-4cf1-87bb-08ffbf45a2f2 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:08.303746 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:08.365939 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fed0ae-0cd9-41f0-909a-4efdcd52dabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:08.366915 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fed0ae-0cd9-41f0-909a-4efdcd52dabb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:08.367255 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fed0ae-0cd9-41f0-909a-4efdcd52dabb admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:08.367911 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fed0ae-0cd9-41f0-909a-4efdcd52dabb admin admin] PATH_INFO: `/v3/users/5569657a15cd41a8a2f6b2bb474600a8` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:08.370359 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fed0ae-0cd9-41f0-909a-4efdcd52dabb admin admin] RBAC: Authorizing `identity:delete_user(user_id=5569657a15cd41a8a2f6b2bb474600a8)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:08.373103 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fed0ae-0cd9-41f0-909a-4efdcd52dabb admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:08.440484 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-62fed0ae-0cd9-41f0-909a-4efdcd52dabb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5569657a15cd41a8a2f6b2bb474600a8'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:08.441234 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-62fed0ae-0cd9-41f0-909a-4efdcd52dabb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5569657a15cd41a8a2f6b2bb474600a8'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:08.441852 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-62fed0ae-0cd9-41f0-909a-4efdcd52dabb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5569657a15cd41a8a2f6b2bb474600a8'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:08.451106 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-62fed0ae-0cd9-41f0-909a-4efdcd52dabb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5569657a15cd41a8a2f6b2bb474600a8'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:08.478133 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-62fed0ae-0cd9-41f0-909a-4efdcd52dabb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5569657a15cd41a8a2f6b2bb474600a8'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:08.509574 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1062/2120] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:36:08 2022] DELETE /identity/v3/users/5569657a15cd41a8a2f6b2bb474600a8 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:36:09.325088 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52056949-d96d-4c9c-b337-8cf7a3a1cab7 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:09.345822 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52056949-d96d-4c9c-b337-8cf7a3a1cab7 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:09.477212 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411c1c9f-e625-4adc-948f-f34f17ab86fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:09.478332 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c1c9f-e625-4adc-948f-f34f17ab86fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:09.478620 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c1c9f-e625-4adc-948f-f34f17ab86fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:09.478899 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c1c9f-e625-4adc-948f-f34f17ab86fe admin admin] PATH_INFO: `/v3/projects/99c340cbfc5e4c3bb33de3f2d6879363` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:09.480163 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411c1c9f-e625-4adc-948f-f34f17ab86fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=99c340cbfc5e4c3bb33de3f2d6879363)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:09.482139 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411c1c9f-e625-4adc-948f-f34f17ab86fe admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:09.524804 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:09.546818 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-411c1c9f-e625-4adc-948f-f34f17ab86fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99c340cbfc5e4c3bb33de3f2d6879363', 'request_id': 'req-411c1c9f-e625-4adc-948f-f34f17ab86fe'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:09.553730 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-411c1c9f-e625-4adc-948f-f34f17ab86fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99c340cbfc5e4c3bb33de3f2d6879363', 'request_id': 'req-411c1c9f-e625-4adc-948f-f34f17ab86fe'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:09.561389 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-411c1c9f-e625-4adc-948f-f34f17ab86fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99c340cbfc5e4c3bb33de3f2d6879363', 'request_id': 'req-411c1c9f-e625-4adc-948f-f34f17ab86fe'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:09.584758 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-411c1c9f-e625-4adc-948f-f34f17ab86fe admin admin] The token cache is being invalidate because project 99c340cbfc5e4c3bb33de3f2d6879363 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:36:09.585105 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-411c1c9f-e625-4adc-948f-f34f17ab86fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:09.586569 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-411c1c9f-e625-4adc-948f-f34f17ab86fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:09.589360 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1059/2121] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:36:09 2022] DELETE /identity/v3/projects/99c340cbfc5e4c3bb33de3f2d6879363 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:36:09.594001 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca2196-82b4-4fc9-b491-ef3148a8fa95 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:09.594368 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca2196-82b4-4fc9-b491-ef3148a8fa95 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:09.594491 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca2196-82b4-4fc9-b491-ef3148a8fa95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:09.618510 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-8bca2196-82b4-4fc9-b491-ef3148a8fa95 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:09.620074 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-8bca2196-82b4-4fc9-b491-ef3148a8fa95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:09.698851 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1063/2122] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:36:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:36:09.707226 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2431abc5-beb2-4af1-9bf0-5d3687f22c1b None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:09.710598 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2431abc5-beb2-4af1-9bf0-5d3687f22c1b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:09.710978 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2431abc5-beb2-4af1-9bf0-5d3687f22c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:09.731690 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-2431abc5-beb2-4af1-9bf0-5d3687f22c1b None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:09.733930 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2431abc5-beb2-4af1-9bf0-5d3687f22c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:09.742694 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1060/2123] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:36:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:36:09.749540 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca2196-82b4-4fc9-b491-ef3148a8fa95 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:09.761406 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca2196-82b4-4fc9-b491-ef3148a8fa95 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:09.769944 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ddae0-6d4f-44e2-976e-c29e74e1874a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:09.770404 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ddae0-6d4f-44e2-976e-c29e74e1874a admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:09.770758 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ddae0-6d4f-44e2-976e-c29e74e1874a admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:09.771107 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ddae0-6d4f-44e2-976e-c29e74e1874a admin admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:09.771917 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8ddae0-6d4f-44e2-976e-c29e74e1874a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:36:09.772290 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8ddae0-6d4f-44e2-976e-c29e74e1874a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:09.774003 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8ddae0-6d4f-44e2-976e-c29e74e1874a admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:09.793402 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1064/2124] 10.222.0.16 () {58 vars in 1152 bytes} [Thu May 26 12:36:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:36:09.794448 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2431abc5-beb2-4af1-9bf0-5d3687f22c1b None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:09.807325 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2431abc5-beb2-4af1-9bf0-5d3687f22c1b None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:09.812637 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775421d3-c529-4fe3-a086-9b798b155e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:09.813422 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775421d3-c529-4fe3-a086-9b798b155e43 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:09.813777 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775421d3-c529-4fe3-a086-9b798b155e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:09.814125 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775421d3-c529-4fe3-a086-9b798b155e43 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:09.814908 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775421d3-c529-4fe3-a086-9b798b155e43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:09.816966 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775421d3-c529-4fe3-a086-9b798b155e43 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:09.847298 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1061/2125] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:36:09 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:36:09.851828 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ddae0-6d4f-44e2-976e-c29e74e1874a admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:09.862852 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ddae0-6d4f-44e2-976e-c29e74e1874a admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:09.897425 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:09.940023 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe37966-86a6-4828-8f39-bd208033d56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:09.940880 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe37966-86a6-4828-8f39-bd208033d56c admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:09.941019 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe37966-86a6-4828-8f39-bd208033d56c admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:09.941386 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe37966-86a6-4828-8f39-bd208033d56c admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:09.942148 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe37966-86a6-4828-8f39-bd208033d56c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:09.944164 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe37966-86a6-4828-8f39-bd208033d56c admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:09.969782 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1065/2126] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:36:09 2022] POST /identity/v3/users => generated 292 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:36:09.973704 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775421d3-c529-4fe3-a086-9b798b155e43 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:09.986998 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775421d3-c529-4fe3-a086-9b798b155e43 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:09.992236 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b1a0ae-7493-4583-bd1d-5cf72bf7220c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:09.993031 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1a0ae-7493-4583-bd1d-5cf72bf7220c admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:09.993269 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1a0ae-7493-4583-bd1d-5cf72bf7220c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:09.994123 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1a0ae-7493-4583-bd1d-5cf72bf7220c admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:09.994463 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b1a0ae-7493-4583-bd1d-5cf72bf7220c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:09.996149 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b1a0ae-7493-4583-bd1d-5cf72bf7220c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:10.015622 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1062/2127] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:36:09 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:36:10.020189 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe37966-86a6-4828-8f39-bd208033d56c admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:10.032060 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe37966-86a6-4828-8f39-bd208033d56c admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:10.037216 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f38b14e-59a3-4a83-8aa0-8826084fe88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:10.038056 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38b14e-59a3-4a83-8aa0-8826084fe88c admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:10.038413 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38b14e-59a3-4a83-8aa0-8826084fe88c admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:10.038763 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38b14e-59a3-4a83-8aa0-8826084fe88c admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:10.039653 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f38b14e-59a3-4a83-8aa0-8826084fe88c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:10.041433 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f38b14e-59a3-4a83-8aa0-8826084fe88c admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:10.053658 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1066/2128] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:36:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:36:10.057782 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b1a0ae-7493-4583-bd1d-5cf72bf7220c admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:10.069666 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b1a0ae-7493-4583-bd1d-5cf72bf7220c admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:10.075325 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56dc7bc-6a61-401f-a7ba-067be8c9fc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:10.076243 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56dc7bc-6a61-401f-a7ba-067be8c9fc55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:10.076526 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56dc7bc-6a61-401f-a7ba-067be8c9fc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:10.076802 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56dc7bc-6a61-401f-a7ba-067be8c9fc55 admin admin] PATH_INFO: `/v3/projects/1f77fa2ffe9a4762b8a9368918afb898/users/e5c12467b44b41409cf4ea4c61ccf600/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:10.097716 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56dc7bc-6a61-401f-a7ba-067be8c9fc55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f77fa2ffe9a4762b8a9368918afb898, user_id=e5c12467b44b41409cf4ea4c61ccf600, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:10.101357 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56dc7bc-6a61-401f-a7ba-067be8c9fc55 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:10.120366 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1063/2129] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:36:10 2022] PUT /identity/v3/projects/1f77fa2ffe9a4762b8a9368918afb898/users/e5c12467b44b41409cf4ea4c61ccf600/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:36:10.135593 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccff88e-e04f-495b-b969-7f391d0ac654 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:10.135893 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccff88e-e04f-495b-b969-7f391d0ac654 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:10.136687 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccff88e-e04f-495b-b969-7f391d0ac654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:10.234683 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-6ccff88e-e04f-495b-b969-7f391d0ac654 None None] MFA Rules not processed for user `e5c12467b44b41409cf4ea4c61ccf600`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:10.236174 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-6ccff88e-e04f-495b-b969-7f391d0ac654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:10.415112 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1067/2130] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:36:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:36:10.419312 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56dc7bc-6a61-401f-a7ba-067be8c9fc55 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:10.552623 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56dc7bc-6a61-401f-a7ba-067be8c9fc55 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:10.562343 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01813c7-d5d0-4d1b-8d9b-c98e12281a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:10.563338 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01813c7-d5d0-4d1b-8d9b-c98e12281a94 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:10.563844 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01813c7-d5d0-4d1b-8d9b-c98e12281a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:10.564339 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01813c7-d5d0-4d1b-8d9b-c98e12281a94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:10.565432 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01813c7-d5d0-4d1b-8d9b-c98e12281a94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:10.570778 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01813c7-d5d0-4d1b-8d9b-c98e12281a94 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:10.682865 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1064/2131] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:36:10 2022] POST /identity/v3/projects => generated 381 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:36:10.688131 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccff88e-e04f-495b-b969-7f391d0ac654 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:10.712137 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccff88e-e04f-495b-b969-7f391d0ac654 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:10.844341 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14faa13e-5607-401c-b2da-8ef6bb492522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:10.845275 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14faa13e-5607-401c-b2da-8ef6bb492522 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:10.845745 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14faa13e-5607-401c-b2da-8ef6bb492522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:10.846261 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14faa13e-5607-401c-b2da-8ef6bb492522 admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:10.847112 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14faa13e-5607-401c-b2da-8ef6bb492522 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:10.849330 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14faa13e-5607-401c-b2da-8ef6bb492522 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:10.876882 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1068/2132] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:36:10 2022] POST /identity/v3/users => generated 297 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:36:10.879991 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01813c7-d5d0-4d1b-8d9b-c98e12281a94 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:10.892525 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01813c7-d5d0-4d1b-8d9b-c98e12281a94 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:10.900008 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df93540b-20a2-4dea-88cb-40c8fed5c1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:10.901180 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93540b-20a2-4dea-88cb-40c8fed5c1c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:10.901654 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93540b-20a2-4dea-88cb-40c8fed5c1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:10.902123 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93540b-20a2-4dea-88cb-40c8fed5c1c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:10.903151 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df93540b-20a2-4dea-88cb-40c8fed5c1c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:10.905823 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df93540b-20a2-4dea-88cb-40c8fed5c1c5 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:10.919437 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1065/2133] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:36:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:36:10.924025 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14faa13e-5607-401c-b2da-8ef6bb492522 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:10.935693 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14faa13e-5607-401c-b2da-8ef6bb492522 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:10.943452 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7adaf3-5c65-492e-85db-b317ff0a25a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:10.944447 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7adaf3-5c65-492e-85db-b317ff0a25a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:10.944734 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7adaf3-5c65-492e-85db-b317ff0a25a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:10.945757 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7adaf3-5c65-492e-85db-b317ff0a25a7 admin admin] PATH_INFO: `/v3/projects/d7192fb4dfbb413e8750fb8f5367c331/users/f2a39029e47d45c28b3fbf7770ccaae5/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:10.967491 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7adaf3-5c65-492e-85db-b317ff0a25a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7192fb4dfbb413e8750fb8f5367c331, user_id=f2a39029e47d45c28b3fbf7770ccaae5, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:10.970764 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7adaf3-5c65-492e-85db-b317ff0a25a7 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:10.990823 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1069/2134] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:36:10 2022] PUT /identity/v3/projects/d7192fb4dfbb413e8750fb8f5367c331/users/f2a39029e47d45c28b3fbf7770ccaae5/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:36:10.991355 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:10.995268 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df93540b-20a2-4dea-88cb-40c8fed5c1c5 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:11.017729 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df93540b-20a2-4dea-88cb-40c8fed5c1c5 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:11.060877 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:11.140300 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d158e-74dd-4e0e-975e-ad806057a058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:11.145413 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d158e-74dd-4e0e-975e-ad806057a058 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:11.145719 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d158e-74dd-4e0e-975e-ad806057a058 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:11.146127 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d158e-74dd-4e0e-975e-ad806057a058 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:11.147141 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49d158e-74dd-4e0e-975e-ad806057a058 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:11.149051 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49d158e-74dd-4e0e-975e-ad806057a058 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:11.179665 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1066/2135] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:36:10 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:36:11.182187 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7adaf3-5c65-492e-85db-b317ff0a25a7 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:11.207051 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7adaf3-5c65-492e-85db-b317ff0a25a7 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:11.218138 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd60ea-83b3-4b55-a970-52e95ccae205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:11.219396 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd60ea-83b3-4b55-a970-52e95ccae205 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:11.225055 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd60ea-83b3-4b55-a970-52e95ccae205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:11.225651 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd60ea-83b3-4b55-a970-52e95ccae205 admin admin] PATH_INFO: `/v3/projects/d7192fb4dfbb413e8750fb8f5367c331/users/f2a39029e47d45c28b3fbf7770ccaae5/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:11.228540 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bd60ea-83b3-4b55-a970-52e95ccae205 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7192fb4dfbb413e8750fb8f5367c331, user_id=f2a39029e47d45c28b3fbf7770ccaae5, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:11.232944 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bd60ea-83b3-4b55-a970-52e95ccae205 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:11.269412 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1070/2136] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:36:11 2022] PUT /identity/v3/projects/d7192fb4dfbb413e8750fb8f5367c331/users/f2a39029e47d45c28b3fbf7770ccaae5/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:36:11.271006 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00522282-75d1-497f-afd2-4504202b50ff None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:11.271484 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00522282-75d1-497f-afd2-4504202b50ff None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:11.271917 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00522282-75d1-497f-afd2-4504202b50ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:11.322574 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-00522282-75d1-497f-afd2-4504202b50ff None None] MFA Rules not processed for user `f2a39029e47d45c28b3fbf7770ccaae5`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:11.324461 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-00522282-75d1-497f-afd2-4504202b50ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:11.509516 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1067/2137] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:36:11 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:36:11.524651 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd60ea-83b3-4b55-a970-52e95ccae205 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:11.526659 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-69bd60ea-83b3-4b55-a970-52e95ccae205 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:11.619963 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd60ea-83b3-4b55-a970-52e95ccae205 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:11.623812 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a58264-feed-4384-9e87-794805f4fa6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:11.625100 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a58264-feed-4384-9e87-794805f4fa6a service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:11.625379 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a58264-feed-4384-9e87-794805f4fa6a service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:11.625647 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a58264-feed-4384-9e87-794805f4fa6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:11.638578 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a58264-feed-4384-9e87-794805f4fa6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:11.646914 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a58264-feed-4384-9e87-794805f4fa6a service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:11.683323 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1071/2138] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:36:11 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:36:11.818365 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00522282-75d1-497f-afd2-4504202b50ff None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:11.837379 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00522282-75d1-497f-afd2-4504202b50ff None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:11.855199 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2895ee96-3da1-4257-a8d1-70146fc1665a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:11.855870 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895ee96-3da1-4257-a8d1-70146fc1665a service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:11.856161 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895ee96-3da1-4257-a8d1-70146fc1665a service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:11.856439 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895ee96-3da1-4257-a8d1-70146fc1665a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:11.981198 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2895ee96-3da1-4257-a8d1-70146fc1665a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:11.983248 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2895ee96-3da1-4257-a8d1-70146fc1665a service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:12.000677 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1068/2139] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:36:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:36:12.455666 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a58264-feed-4384-9e87-794805f4fa6a service cinder] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:12.619676 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a58264-feed-4384-9e87-794805f4fa6a service cinder] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:12.631143 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7872cc-0618-453a-b3c0-fc8343ce7a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:12.632630 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7872cc-0618-453a-b3c0-fc8343ce7a79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:12.633314 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7872cc-0618-453a-b3c0-fc8343ce7a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:12.633314 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7872cc-0618-453a-b3c0-fc8343ce7a79 admin admin] PATH_INFO: `/v3/users/e5c12467b44b41409cf4ea4c61ccf600` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:12.634749 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7872cc-0618-453a-b3c0-fc8343ce7a79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5c12467b44b41409cf4ea4c61ccf600)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:12.636579 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7872cc-0618-453a-b3c0-fc8343ce7a79 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:12.730151 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-8c7872cc-0618-453a-b3c0-fc8343ce7a79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5c12467b44b41409cf4ea4c61ccf600'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:12.731270 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-8c7872cc-0618-453a-b3c0-fc8343ce7a79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5c12467b44b41409cf4ea4c61ccf600'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:12.732184 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-8c7872cc-0618-453a-b3c0-fc8343ce7a79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5c12467b44b41409cf4ea4c61ccf600'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:12.755957 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-8c7872cc-0618-453a-b3c0-fc8343ce7a79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5c12467b44b41409cf4ea4c61ccf600'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:12.783275 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-8c7872cc-0618-453a-b3c0-fc8343ce7a79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5c12467b44b41409cf4ea4c61ccf600'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:12.812577 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1072/2140] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:36:12 2022] DELETE /identity/v3/users/e5c12467b44b41409cf4ea4c61ccf600 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:36:12.819232 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf4cae-fd06-455f-a790-dc74fcee8f10 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:12.820661 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf4cae-fd06-455f-a790-dc74fcee8f10 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:12.821112 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf4cae-fd06-455f-a790-dc74fcee8f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:12.860338 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-16cf4cae-fd06-455f-a790-dc74fcee8f10 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:12.861982 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-16cf4cae-fd06-455f-a790-dc74fcee8f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:12.970619 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:13.032876 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1069/2141] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:36:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:36:13.143816 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7872cc-0618-453a-b3c0-fc8343ce7a79 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:13.145819 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-8c7872cc-0618-453a-b3c0-fc8343ce7a79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:13.177486 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:13.265733 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7872cc-0618-453a-b3c0-fc8343ce7a79 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:13.270925 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2432ad4-b264-4c1f-b028-084c0adaf657 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:13.271642 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2432ad4-b264-4c1f-b028-084c0adaf657 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:13.271924 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2432ad4-b264-4c1f-b028-084c0adaf657 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:13.272220 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2432ad4-b264-4c1f-b028-084c0adaf657 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:13.283152 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2432ad4-b264-4c1f-b028-084c0adaf657 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:13.284240 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2432ad4-b264-4c1f-b028-084c0adaf657 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:13.296075 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1073/2142] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:36:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:36:13.800517 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf4cae-fd06-455f-a790-dc74fcee8f10 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:13.802705 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-16cf4cae-fd06-455f-a790-dc74fcee8f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:13.823801 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf4cae-fd06-455f-a790-dc74fcee8f10 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:13.835978 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd9cef-08a5-41cf-afd4-14acd7d3e126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:13.841125 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd9cef-08a5-41cf-afd4-14acd7d3e126 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:13.841786 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd9cef-08a5-41cf-afd4-14acd7d3e126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:13.842085 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd9cef-08a5-41cf-afd4-14acd7d3e126 admin admin] PATH_INFO: `/v3/projects/1f77fa2ffe9a4762b8a9368918afb898` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:13.843526 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acd9cef-08a5-41cf-afd4-14acd7d3e126 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f77fa2ffe9a4762b8a9368918afb898)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:13.845535 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acd9cef-08a5-41cf-afd4-14acd7d3e126 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:13.923703 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5acd9cef-08a5-41cf-afd4-14acd7d3e126 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f77fa2ffe9a4762b8a9368918afb898', 'request_id': 'req-5acd9cef-08a5-41cf-afd4-14acd7d3e126'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:13.931507 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5acd9cef-08a5-41cf-afd4-14acd7d3e126 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f77fa2ffe9a4762b8a9368918afb898', 'request_id': 'req-5acd9cef-08a5-41cf-afd4-14acd7d3e126'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:13.940334 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5acd9cef-08a5-41cf-afd4-14acd7d3e126 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f77fa2ffe9a4762b8a9368918afb898', 'request_id': 'req-5acd9cef-08a5-41cf-afd4-14acd7d3e126'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:13.961844 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5acd9cef-08a5-41cf-afd4-14acd7d3e126 admin admin] The token cache is being invalidate because project 1f77fa2ffe9a4762b8a9368918afb898 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:36:13.962473 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5acd9cef-08a5-41cf-afd4-14acd7d3e126 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:13.963306 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5acd9cef-08a5-41cf-afd4-14acd7d3e126 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:13.965431 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1070/2143] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:36:13 2022] DELETE /identity/v3/projects/1f77fa2ffe9a4762b8a9368918afb898 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:36:13.969802 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2432ad4-b264-4c1f-b028-084c0adaf657 service neutron] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:13.983195 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2432ad4-b264-4c1f-b028-084c0adaf657 service neutron] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:14.064171 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4035d7-12ef-4073-a0b8-2c259541ce00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:14.065247 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4035d7-12ef-4073-a0b8-2c259541ce00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:14.065530 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4035d7-12ef-4073-a0b8-2c259541ce00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:14.065809 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4035d7-12ef-4073-a0b8-2c259541ce00 admin admin] PATH_INFO: `/v3/users/f2a39029e47d45c28b3fbf7770ccaae5` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:14.068433 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4035d7-12ef-4073-a0b8-2c259541ce00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2a39029e47d45c28b3fbf7770ccaae5)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:14.070710 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4035d7-12ef-4073-a0b8-2c259541ce00 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:14.098331 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a9042-892c-40dc-8968-977a0432aafa None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:14.098623 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a9042-892c-40dc-8968-977a0432aafa None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:14.098899 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a9042-892c-40dc-8968-977a0432aafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:14.129233 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-e68a9042-892c-40dc-8968-977a0432aafa None None] MFA Rules not processed for user `6b2fb8e48ba942ab91cc5e5bfa3fa2db`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:14.130761 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e68a9042-892c-40dc-8968-977a0432aafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:14.140462 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-ec4035d7-12ef-4073-a0b8-2c259541ce00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2a39029e47d45c28b3fbf7770ccaae5'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:14.142372 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-ec4035d7-12ef-4073-a0b8-2c259541ce00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2a39029e47d45c28b3fbf7770ccaae5'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:14.142907 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-ec4035d7-12ef-4073-a0b8-2c259541ce00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2a39029e47d45c28b3fbf7770ccaae5'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:14.152519 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-ec4035d7-12ef-4073-a0b8-2c259541ce00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2a39029e47d45c28b3fbf7770ccaae5'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:14.171327 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-ec4035d7-12ef-4073-a0b8-2c259541ce00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2a39029e47d45c28b3fbf7770ccaae5'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:14.188459 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1074/2144] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:36:13 2022] DELETE /identity/v3/users/f2a39029e47d45c28b3fbf7770ccaae5 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:36:14.252904 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1071/2145] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:36:14 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:36:14.264031 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4035d7-12ef-4073-a0b8-2c259541ce00 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:14.266091 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-ec4035d7-12ef-4073-a0b8-2c259541ce00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:14.318801 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:14.371386 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4035d7-12ef-4073-a0b8-2c259541ce00 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:14.380585 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c83d1-93a0-4a42-bbd1-2d0f9c1ecd22 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad8cfccd3a4d42d381ce62ea90849f19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:14.381590 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c83d1-93a0-4a42-bbd1-2d0f9c1ecd22 service glance] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:14.382251 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c83d1-93a0-4a42-bbd1-2d0f9c1ecd22 service glance] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:14.383030 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c83d1-93a0-4a42-bbd1-2d0f9c1ecd22 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:14.385592 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-a52c83d1-93a0-4a42-bbd1-2d0f9c1ecd22 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:14.512932 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c83d1-93a0-4a42-bbd1-2d0f9c1ecd22 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:14.514459 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c83d1-93a0-4a42-bbd1-2d0f9c1ecd22 service glance] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:14.532867 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1075/2146] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:36:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:36:14.690813 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a728f59-d393-4600-a13a-12b77ad65d6d None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:14.691294 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a728f59-d393-4600-a13a-12b77ad65d6d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:14.691693 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a728f59-d393-4600-a13a-12b77ad65d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:14.711633 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c83d1-93a0-4a42-bbd1-2d0f9c1ecd22 service glance] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:14.713153 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-a52c83d1-93a0-4a42-bbd1-2d0f9c1ecd22 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:14.777750 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-3a728f59-d393-4600-a13a-12b77ad65d6d None None] MFA Rules not processed for user `512b4337083145f9ae57948a63444ced`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:14.779459 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3a728f59-d393-4600-a13a-12b77ad65d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:14.880885 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c83d1-93a0-4a42-bbd1-2d0f9c1ecd22 service glance] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:14.891012 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b438c-89d5-4387-b958-5bd0a6b28d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:14.891421 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:14.891946 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b438c-89d5-4387-b958-5bd0a6b28d1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:14.892235 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b438c-89d5-4387-b958-5bd0a6b28d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:14.892511 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b438c-89d5-4387-b958-5bd0a6b28d1e admin admin] PATH_INFO: `/v3/projects/d7192fb4dfbb413e8750fb8f5367c331` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:14.895526 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086b438c-89d5-4387-b958-5bd0a6b28d1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7192fb4dfbb413e8750fb8f5367c331)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:14.898207 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086b438c-89d5-4387-b958-5bd0a6b28d1e admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:14.903668 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1072/2147] 10.222.0.16 () {58 vars in 1009 bytes} [Thu May 26 12:36:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:36:14.955165 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a728f59-d393-4600-a13a-12b77ad65d6d None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:14.956690 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3a728f59-d393-4600-a13a-12b77ad65d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:14.977765 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-086b438c-89d5-4387-b958-5bd0a6b28d1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7192fb4dfbb413e8750fb8f5367c331', 'request_id': 'req-086b438c-89d5-4387-b958-5bd0a6b28d1e'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:14.987369 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-086b438c-89d5-4387-b958-5bd0a6b28d1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7192fb4dfbb413e8750fb8f5367c331', 'request_id': 'req-086b438c-89d5-4387-b958-5bd0a6b28d1e'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:14.995974 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-086b438c-89d5-4387-b958-5bd0a6b28d1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7192fb4dfbb413e8750fb8f5367c331', 'request_id': 'req-086b438c-89d5-4387-b958-5bd0a6b28d1e'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:15.014457 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-086b438c-89d5-4387-b958-5bd0a6b28d1e admin admin] The token cache is being invalidate because project d7192fb4dfbb413e8750fb8f5367c331 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:36:15.015398 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-086b438c-89d5-4387-b958-5bd0a6b28d1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:15.016070 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-086b438c-89d5-4387-b958-5bd0a6b28d1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:15.018326 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1076/2148] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:36:14 2022] DELETE /identity/v3/projects/d7192fb4dfbb413e8750fb8f5367c331 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:36:15.024953 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68694d-9800-4511-9088-5ddb89247145 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:15.025342 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68694d-9800-4511-9088-5ddb89247145 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:15.025743 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68694d-9800-4511-9088-5ddb89247145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:15.052353 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-9e68694d-9800-4511-9088-5ddb89247145 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:15.053385 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a728f59-d393-4600-a13a-12b77ad65d6d None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:15.054037 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-9e68694d-9800-4511-9088-5ddb89247145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:15.068045 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:15.148896 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1077/2149] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:36:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:36:15.149118 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40f1aea-1bc0-4683-9e3a-a6ccf847dda9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02767dcbd1574e08a9e82a775ac2b289', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:15.149118 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f1aea-1bc0-4683-9e3a-a6ccf847dda9 service swift] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:15.149118 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f1aea-1bc0-4683-9e3a-a6ccf847dda9 service swift] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:15.149383 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f1aea-1bc0-4683-9e3a-a6ccf847dda9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:15.151302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a40f1aea-1bc0-4683-9e3a-a6ccf847dda9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:15.160079 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90d8ce-ec84-4a99-9e54-f654264a544a None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:15.161705 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90d8ce-ec84-4a99-9e54-f654264a544a None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:15.162188 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90d8ce-ec84-4a99-9e54-f654264a544a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:15.198121 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-fa90d8ce-ec84-4a99-9e54-f654264a544a None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:15.200100 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-fa90d8ce-ec84-4a99-9e54-f654264a544a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:15.220294 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40f1aea-1bc0-4683-9e3a-a6ccf847dda9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:15.223021 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40f1aea-1bc0-4683-9e3a-a6ccf847dda9 service swift] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:15.228313 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1078/2150] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:36:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:36:15.229317 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa90d8ce-ec84-4a99-9e54-f654264a544a None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:15.233850 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1073/2151] 10.222.0.16 () {60 vars in 1384 bytes} [Thu May 26 12:36:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:36:15.248466 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa90d8ce-ec84-4a99-9e54-f654264a544a None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:15.254339 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312d49b-6de3-418f-835a-627dfd39675f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:15.255150 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312d49b-6de3-418f-835a-627dfd39675f admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:15.255663 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312d49b-6de3-418f-835a-627dfd39675f admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:15.256065 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312d49b-6de3-418f-835a-627dfd39675f admin admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:15.257140 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5312d49b-6de3-418f-835a-627dfd39675f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:36:15.257549 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5312d49b-6de3-418f-835a-627dfd39675f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:15.259700 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5312d49b-6de3-418f-835a-627dfd39675f admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:15.277787 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1079/2152] 10.222.0.16 () {58 vars in 1152 bytes} [Thu May 26 12:36:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:36:15.292484 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40f1aea-1bc0-4683-9e3a-a6ccf847dda9 service swift] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:15.323042 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40f1aea-1bc0-4683-9e3a-a6ccf847dda9 service swift] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:15.343934 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d971ac73-8128-43dc-a765-fe05cc5143d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:15.344874 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971ac73-8128-43dc-a765-fe05cc5143d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:15.345215 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971ac73-8128-43dc-a765-fe05cc5143d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:15.345692 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971ac73-8128-43dc-a765-fe05cc5143d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:15.346525 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d971ac73-8128-43dc-a765-fe05cc5143d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:15.353496 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d971ac73-8128-43dc-a765-fe05cc5143d3 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:15.421246 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312d49b-6de3-418f-835a-627dfd39675f admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:15.423475 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-5312d49b-6de3-418f-835a-627dfd39675f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:15.430759 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1074/2153] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:36:15 2022] POST /identity/v3/projects => generated 375 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:36:15.439682 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d971ac73-8128-43dc-a765-fe05cc5143d3 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:15.448639 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312d49b-6de3-418f-835a-627dfd39675f admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:15.534223 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:15.582710 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d971ac73-8128-43dc-a765-fe05cc5143d3 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:15.590397 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c866740f-2519-47a6-901a-c970133b6650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:15.590865 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866740f-2519-47a6-901a-c970133b6650 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:15.591153 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866740f-2519-47a6-901a-c970133b6650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:15.591571 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866740f-2519-47a6-901a-c970133b6650 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:15.592675 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c866740f-2519-47a6-901a-c970133b6650 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:15.595524 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c866740f-2519-47a6-901a-c970133b6650 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:15.638088 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1075/2154] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:36:15 2022] POST /identity/v3/users => generated 288 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:36:15.639022 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c866740f-2519-47a6-901a-c970133b6650 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:15.645684 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf2aaa3-bc7f-4480-9aef-7e8a293948d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:15.646579 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2aaa3-bc7f-4480-9aef-7e8a293948d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:15.646858 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2aaa3-bc7f-4480-9aef-7e8a293948d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:15.647132 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2aaa3-bc7f-4480-9aef-7e8a293948d2 admin admin] PATH_INFO: `/v3/users/7f3df0f19bad49af92cf6ce1edf7ee1f` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:15.649529 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf2aaa3-bc7f-4480-9aef-7e8a293948d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f3df0f19bad49af92cf6ce1edf7ee1f)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:15.650154 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c866740f-2519-47a6-901a-c970133b6650 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:15.657762 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf2aaa3-bc7f-4480-9aef-7e8a293948d2 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:15.666475 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc86490-21a8-487c-a2b5-1a7e01c459f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:15.668544 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc86490-21a8-487c-a2b5-1a7e01c459f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:15.672029 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc86490-21a8-487c-a2b5-1a7e01c459f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:15.673034 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc86490-21a8-487c-a2b5-1a7e01c459f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:15.674030 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc86490-21a8-487c-a2b5-1a7e01c459f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:15.685567 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc86490-21a8-487c-a2b5-1a7e01c459f8 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:15.717208 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1076/2155] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:36:15 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:36:15.722298 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc86490-21a8-487c-a2b5-1a7e01c459f8 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:15.754138 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc86490-21a8-487c-a2b5-1a7e01c459f8 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:15.766635 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c3ef3-5c08-4b7b-a06e-7b0fdeedd30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:15.767587 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c3ef3-5c08-4b7b-a06e-7b0fdeedd30c admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:15.768028 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c3ef3-5c08-4b7b-a06e-7b0fdeedd30c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:15.768456 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c3ef3-5c08-4b7b-a06e-7b0fdeedd30c admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:15.771148 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0c3ef3-5c08-4b7b-a06e-7b0fdeedd30c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:15.773226 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0c3ef3-5c08-4b7b-a06e-7b0fdeedd30c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:15.803485 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-8bf2aaa3-bc7f-4480-9aef-7e8a293948d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f3df0f19bad49af92cf6ce1edf7ee1f'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:15.804394 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-8bf2aaa3-bc7f-4480-9aef-7e8a293948d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f3df0f19bad49af92cf6ce1edf7ee1f'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:15.805967 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-8bf2aaa3-bc7f-4480-9aef-7e8a293948d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f3df0f19bad49af92cf6ce1edf7ee1f'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:15.810490 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1077/2156] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:36:15 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:36:15.811443 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c3ef3-5c08-4b7b-a06e-7b0fdeedd30c admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:15.814620 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-da0c3ef3-5c08-4b7b-a06e-7b0fdeedd30c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:15.829068 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-8bf2aaa3-bc7f-4480-9aef-7e8a293948d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f3df0f19bad49af92cf6ce1edf7ee1f'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:15.869092 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-8bf2aaa3-bc7f-4480-9aef-7e8a293948d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f3df0f19bad49af92cf6ce1edf7ee1f'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:15.907156 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c3ef3-5c08-4b7b-a06e-7b0fdeedd30c admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:15.924470 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1080/2157] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:36:15 2022] DELETE /identity/v3/users/7f3df0f19bad49af92cf6ce1edf7ee1f => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:36:15.928135 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b883c3e-a717-40d0-a926-e386b6ba90d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:15.930105 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7564a33b-14c7-4528-9226-0ac9233b26c8 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:15.930580 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7564a33b-14c7-4528-9226-0ac9233b26c8 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:15.931081 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7564a33b-14c7-4528-9226-0ac9233b26c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:15.931656 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b883c3e-a717-40d0-a926-e386b6ba90d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:15.932079 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b883c3e-a717-40d0-a926-e386b6ba90d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:15.932428 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b883c3e-a717-40d0-a926-e386b6ba90d1 admin admin] PATH_INFO: `/v3/projects/caf9da1ef77a4d769754b89ba5984796/users/3da8a9ad4a49462497d859b500559eea/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:15.959143 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b883c3e-a717-40d0-a926-e386b6ba90d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=caf9da1ef77a4d769754b89ba5984796, user_id=3da8a9ad4a49462497d859b500559eea, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:15.963528 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b883c3e-a717-40d0-a926-e386b6ba90d1 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:15.970266 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-7564a33b-14c7-4528-9226-0ac9233b26c8 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:15.972502 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-7564a33b-14c7-4528-9226-0ac9233b26c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:15.986052 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:16.010769 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1078/2158] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:36:15 2022] PUT /identity/v3/projects/caf9da1ef77a4d769754b89ba5984796/users/3da8a9ad4a49462497d859b500559eea/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:36:16.021312 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1a7bc-ee7f-4a9d-94a2-0c3699d1fb63 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:16.022312 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1a7bc-ee7f-4a9d-94a2-0c3699d1fb63 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:16.022797 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1a7bc-ee7f-4a9d-94a2-0c3699d1fb63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:16.054998 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1081/2159] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:36:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:36:16.061374 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7564a33b-14c7-4528-9226-0ac9233b26c8 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:16.063966 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-7564a33b-14c7-4528-9226-0ac9233b26c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:16.101737 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-87d1a7bc-ee7f-4a9d-94a2-0c3699d1fb63 None None] MFA Rules not processed for user `3da8a9ad4a49462497d859b500559eea`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:16.105723 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-87d1a7bc-ee7f-4a9d-94a2-0c3699d1fb63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:16.157511 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7564a33b-14c7-4528-9226-0ac9233b26c8 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:16.230718 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5be9ee9-e7dc-4b13-8319-f0765a6d462c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:16.231577 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be9ee9-e7dc-4b13-8319-f0765a6d462c service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:16.232081 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be9ee9-e7dc-4b13-8319-f0765a6d462c service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:16.232461 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be9ee9-e7dc-4b13-8319-f0765a6d462c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:16.236437 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1079/2160] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:36:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:36:16.242874 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d1a7bc-ee7f-4a9d-94a2-0c3699d1fb63 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:16.320235 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:16.325402 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5be9ee9-e7dc-4b13-8319-f0765a6d462c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:16.327866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5be9ee9-e7dc-4b13-8319-f0765a6d462c service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:16.349255 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1082/2161] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:36:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:36:16.356610 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d1a7bc-ee7f-4a9d-94a2-0c3699d1fb63 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:16.370095 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e9b5e-2347-4482-b0b9-8a6d35bd22c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:16.370801 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e9b5e-2347-4482-b0b9-8a6d35bd22c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:16.371092 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e9b5e-2347-4482-b0b9-8a6d35bd22c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:16.371373 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e9b5e-2347-4482-b0b9-8a6d35bd22c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:16.372085 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9e9b5e-2347-4482-b0b9-8a6d35bd22c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:16.375772 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9e9b5e-2347-4482-b0b9-8a6d35bd22c5 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:16.446286 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1080/2162] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:36:16 2022] POST /identity/v3/projects => generated 377 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:36:16.447473 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5be9ee9-e7dc-4b13-8319-f0765a6d462c service neutron] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:16.464732 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5be9ee9-e7dc-4b13-8319-f0765a6d462c service neutron] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:16.510837 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:16.584419 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5985df8-6e55-4a49-ae41-d969f718b86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:16.585582 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5985df8-6e55-4a49-ae41-d969f718b86c admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:16.585869 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5985df8-6e55-4a49-ae41-d969f718b86c admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:16.586148 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5985df8-6e55-4a49-ae41-d969f718b86c admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:16.586922 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5985df8-6e55-4a49-ae41-d969f718b86c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:16.589106 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5985df8-6e55-4a49-ae41-d969f718b86c admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:16.650162 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1083/2163] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:36:16 2022] POST /identity/v3/users => generated 289 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:36:16.653864 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e9b5e-2347-4482-b0b9-8a6d35bd22c5 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:16.668749 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e9b5e-2347-4482-b0b9-8a6d35bd22c5 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:16.694199 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec4a4c-4f12-4bdf-9f67-4ba883f9f58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:16.694199 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec4a4c-4f12-4bdf-9f67-4ba883f9f58e admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:16.694199 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec4a4c-4f12-4bdf-9f67-4ba883f9f58e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:16.694199 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec4a4c-4f12-4bdf-9f67-4ba883f9f58e admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:16.694529 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eec4a4c-4f12-4bdf-9f67-4ba883f9f58e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:16.694529 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eec4a4c-4f12-4bdf-9f67-4ba883f9f58e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:16.733463 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1081/2164] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:36:16 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:36:16.736227 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5985df8-6e55-4a49-ae41-d969f718b86c admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:16.770899 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5985df8-6e55-4a49-ae41-d969f718b86c admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:16.783122 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8199ac99-2237-4f05-bbcf-3db727ccae17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:16.786119 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199ac99-2237-4f05-bbcf-3db727ccae17 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:16.786267 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199ac99-2237-4f05-bbcf-3db727ccae17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:16.786462 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199ac99-2237-4f05-bbcf-3db727ccae17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:16.789536 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8199ac99-2237-4f05-bbcf-3db727ccae17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:16.791045 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec4a4c-4f12-4bdf-9f67-4ba883f9f58e admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:16.793019 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1eec4a4c-4f12-4bdf-9f67-4ba883f9f58e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:16.794241 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8199ac99-2237-4f05-bbcf-3db727ccae17 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:16.816685 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec4a4c-4f12-4bdf-9f67-4ba883f9f58e admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:16.819774 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1084/2165] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:36:16 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:36:16.825533 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8199ac99-2237-4f05-bbcf-3db727ccae17 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:16.838550 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d5fcd-c8b1-46db-8bda-b746c6b0b5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:16.839967 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d5fcd-c8b1-46db-8bda-b746c6b0b5d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:16.840483 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d5fcd-c8b1-46db-8bda-b746c6b0b5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:16.840934 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d5fcd-c8b1-46db-8bda-b746c6b0b5d0 admin admin] PATH_INFO: `/v3/projects/1e144510336a48f4aee0374204f929e3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:16.842665 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399d5fcd-c8b1-46db-8bda-b746c6b0b5d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e144510336a48f4aee0374204f929e3)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:16.845656 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8199ac99-2237-4f05-bbcf-3db727ccae17 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:16.847451 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399d5fcd-c8b1-46db-8bda-b746c6b0b5d0 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:16.854497 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a017d511-e74b-400d-9fa0-6f8e16aee134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:16.855659 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017d511-e74b-400d-9fa0-6f8e16aee134 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:16.856045 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017d511-e74b-400d-9fa0-6f8e16aee134 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:16.856529 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017d511-e74b-400d-9fa0-6f8e16aee134 admin admin] PATH_INFO: `/v3/projects/bce8a99489294c8bb75845bd750d390b/users/314bebb747694cc59322597a52489343/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:16.880822 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a017d511-e74b-400d-9fa0-6f8e16aee134 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bce8a99489294c8bb75845bd750d390b, user_id=314bebb747694cc59322597a52489343, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:16.885420 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a017d511-e74b-400d-9fa0-6f8e16aee134 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:16.923911 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1085/2166] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:36:16 2022] PUT /identity/v3/projects/bce8a99489294c8bb75845bd750d390b/users/314bebb747694cc59322597a52489343/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:36:16.934331 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39379fa-be59-490f-95cf-4b069ec3c10f None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:16.934863 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39379fa-be59-490f-95cf-4b069ec3c10f None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:16.935346 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39379fa-be59-490f-95cf-4b069ec3c10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:16.973566 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-e39379fa-be59-490f-95cf-4b069ec3c10f None None] MFA Rules not processed for user `314bebb747694cc59322597a52489343`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:16.975140 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-e39379fa-be59-490f-95cf-4b069ec3c10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:16.998567 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-399d5fcd-c8b1-46db-8bda-b746c6b0b5d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e144510336a48f4aee0374204f929e3', 'request_id': 'req-399d5fcd-c8b1-46db-8bda-b746c6b0b5d0'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:17.007853 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-399d5fcd-c8b1-46db-8bda-b746c6b0b5d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e144510336a48f4aee0374204f929e3', 'request_id': 'req-399d5fcd-c8b1-46db-8bda-b746c6b0b5d0'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:17.020538 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-399d5fcd-c8b1-46db-8bda-b746c6b0b5d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e144510336a48f4aee0374204f929e3', 'request_id': 'req-399d5fcd-c8b1-46db-8bda-b746c6b0b5d0'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:17.053954 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-399d5fcd-c8b1-46db-8bda-b746c6b0b5d0 admin admin] The token cache is being invalidate because project 1e144510336a48f4aee0374204f929e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:36:17.054881 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-399d5fcd-c8b1-46db-8bda-b746c6b0b5d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:17.055667 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-399d5fcd-c8b1-46db-8bda-b746c6b0b5d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:17.062606 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1082/2167] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:36:16 2022] DELETE /identity/v3/projects/1e144510336a48f4aee0374204f929e3 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:36:17.064365 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58efac-fdaa-41ea-9eac-e1df3e978a43 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:17.065438 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58efac-fdaa-41ea-9eac-e1df3e978a43 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:17.065830 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58efac-fdaa-41ea-9eac-e1df3e978a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:17.115922 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-4b58efac-fdaa-41ea-9eac-e1df3e978a43 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:17.117517 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4b58efac-fdaa-41ea-9eac-e1df3e978a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:17.118168 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1086/2168] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:36:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:36:17.124472 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39379fa-be59-490f-95cf-4b069ec3c10f None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:17.126070 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-e39379fa-be59-490f-95cf-4b069ec3c10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:17.289408 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39379fa-be59-490f-95cf-4b069ec3c10f None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:17.306111 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:17.360497 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1083/2169] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:36:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:36:17.362144 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122753a0-7c07-429c-b0a0-b5cc0af0286c None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:17.363285 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122753a0-7c07-429c-b0a0-b5cc0af0286c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:17.363390 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122753a0-7c07-429c-b0a0-b5cc0af0286c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:17.401868 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-122753a0-7c07-429c-b0a0-b5cc0af0286c None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:17.406085 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-122753a0-7c07-429c-b0a0-b5cc0af0286c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:17.446555 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47119269-c1f9-487f-b05c-6eaea0e6edcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:17.447309 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47119269-c1f9-487f-b05c-6eaea0e6edcb admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:17.447698 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47119269-c1f9-487f-b05c-6eaea0e6edcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:17.448080 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47119269-c1f9-487f-b05c-6eaea0e6edcb admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:17.448956 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47119269-c1f9-487f-b05c-6eaea0e6edcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:17.451102 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1084/2170] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:36:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:36:17.454393 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47119269-c1f9-487f-b05c-6eaea0e6edcb admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:17.456517 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122753a0-7c07-429c-b0a0-b5cc0af0286c None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:17.484057 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122753a0-7c07-429c-b0a0-b5cc0af0286c None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:17.491578 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b4056c-4308-4b00-a5f5-484ea38a4657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:17.492651 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4056c-4308-4b00-a5f5-484ea38a4657 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:17.493123 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4056c-4308-4b00-a5f5-484ea38a4657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:17.493558 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4056c-4308-4b00-a5f5-484ea38a4657 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:17.494805 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b4056c-4308-4b00-a5f5-484ea38a4657 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:36:17.495322 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b4056c-4308-4b00-a5f5-484ea38a4657 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:17.499819 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b4056c-4308-4b00-a5f5-484ea38a4657 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:17.526883 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1085/2171] 10.222.0.16 () {58 vars in 1152 bytes} [Thu May 26 12:36:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:36:17.537106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b4056c-4308-4b00-a5f5-484ea38a4657 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:17.538350 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1087/2172] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:36:17 2022] POST /identity/v3/projects => generated 377 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:36:17.542710 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47119269-c1f9-487f-b05c-6eaea0e6edcb admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:17.558459 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b4056c-4308-4b00-a5f5-484ea38a4657 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:17.615039 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:17.659360 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47119269-c1f9-487f-b05c-6eaea0e6edcb admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:17.661644 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2934ad-66d2-4173-83da-8786b68e74fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:17.662422 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2934ad-66d2-4173-83da-8786b68e74fb admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:17.663198 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2934ad-66d2-4173-83da-8786b68e74fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:17.663198 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2934ad-66d2-4173-83da-8786b68e74fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:17.664105 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2934ad-66d2-4173-83da-8786b68e74fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:17.666061 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab8e69-081d-46ba-9e77-781cd8a2d6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:17.666537 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab8e69-081d-46ba-9e77-781cd8a2d6c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:17.666798 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2934ad-66d2-4173-83da-8786b68e74fb admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:17.666921 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab8e69-081d-46ba-9e77-781cd8a2d6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:17.667215 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab8e69-081d-46ba-9e77-781cd8a2d6c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:17.667905 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbab8e69-081d-46ba-9e77-781cd8a2d6c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:17.670496 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbab8e69-081d-46ba-9e77-781cd8a2d6c6 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:17.717230 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1088/2173] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:36:17 2022] POST /identity/v3/users => generated 295 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:36:17.721517 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab8e69-081d-46ba-9e77-781cd8a2d6c6 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:17.722013 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1086/2174] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:36:17 2022] POST /identity/v3/projects => generated 371 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:36:17.724379 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2934ad-66d2-4173-83da-8786b68e74fb admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:17.751341 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab8e69-081d-46ba-9e77-781cd8a2d6c6 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:17.855346 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e4731-6927-4444-935f-d9a97dd9d392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:17.856041 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e4731-6927-4444-935f-d9a97dd9d392 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:17.856327 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e4731-6927-4444-935f-d9a97dd9d392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:17.856603 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e4731-6927-4444-935f-d9a97dd9d392 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:17.862696 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039e4731-6927-4444-935f-d9a97dd9d392 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:17.867288 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039e4731-6927-4444-935f-d9a97dd9d392 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:17.871752 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2934ad-66d2-4173-83da-8786b68e74fb admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:17.886759 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0848004-3707-4d29-8325-49ef326f12c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:17.889538 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0848004-3707-4d29-8325-49ef326f12c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:17.890261 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0848004-3707-4d29-8325-49ef326f12c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:17.890652 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0848004-3707-4d29-8325-49ef326f12c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:17.891966 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0848004-3707-4d29-8325-49ef326f12c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:17.894335 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0848004-3707-4d29-8325-49ef326f12c1 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:17.897557 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1089/2175] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:36:17 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:36:17.902164 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e4731-6927-4444-935f-d9a97dd9d392 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:17.936335 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e4731-6927-4444-935f-d9a97dd9d392 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:17.941874 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1087/2176] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:36:17 2022] POST /identity/v3/users => generated 286 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:36:17.946783 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0848004-3707-4d29-8325-49ef326f12c1 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:17.951980 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606e6a7f-4ca3-4035-a5e7-32767429b69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:17.953158 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e6a7f-4ca3-4035-a5e7-32767429b69a admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:17.953447 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e6a7f-4ca3-4035-a5e7-32767429b69a admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:17.953719 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e6a7f-4ca3-4035-a5e7-32767429b69a admin admin] PATH_INFO: `/v3/projects/7740d38ac75843a7b6579f62ad52b05d/users/fa4625f28c4a4e36a630b08ae8d99432/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:17.959383 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0848004-3707-4d29-8325-49ef326f12c1 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:17.966969 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a94262e-753e-43a7-b4ba-65603c9e3f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:17.967877 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94262e-753e-43a7-b4ba-65603c9e3f64 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:17.968263 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94262e-753e-43a7-b4ba-65603c9e3f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:17.968866 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94262e-753e-43a7-b4ba-65603c9e3f64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:17.969730 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a94262e-753e-43a7-b4ba-65603c9e3f64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:17.971932 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a94262e-753e-43a7-b4ba-65603c9e3f64 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:17.999131 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1088/2177] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:36:17 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:36:18.005671 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a94262e-753e-43a7-b4ba-65603c9e3f64 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:18.018744 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606e6a7f-4ca3-4035-a5e7-32767429b69a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7740d38ac75843a7b6579f62ad52b05d, user_id=fa4625f28c4a4e36a630b08ae8d99432, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:18.030743 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606e6a7f-4ca3-4035-a5e7-32767429b69a admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:18.038160 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a94262e-753e-43a7-b4ba-65603c9e3f64 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:18.048051 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a78937c-4390-46f6-b3b7-1cad70b1cdcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:18.048973 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78937c-4390-46f6-b3b7-1cad70b1cdcb admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:18.049441 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78937c-4390-46f6-b3b7-1cad70b1cdcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:18.049888 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78937c-4390-46f6-b3b7-1cad70b1cdcb admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:18.054884 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:18.062845 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a78937c-4390-46f6-b3b7-1cad70b1cdcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:18.065310 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1090/2178] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:36:17 2022] PUT /identity/v3/projects/7740d38ac75843a7b6579f62ad52b05d/users/fa4625f28c4a4e36a630b08ae8d99432/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:36:18.066275 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a78937c-4390-46f6-b3b7-1cad70b1cdcb admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:18.069564 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606e6a7f-4ca3-4035-a5e7-32767429b69a admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:18.119442 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1089/2179] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:36:18.123389 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a78937c-4390-46f6-b3b7-1cad70b1cdcb admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:18.169730 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a78937c-4390-46f6-b3b7-1cad70b1cdcb admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:18.269608 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606e6a7f-4ca3-4035-a5e7-32767429b69a admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:18.283646 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf160c-ac4f-4763-ad04-7759d7b99529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:18.284545 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf160c-ac4f-4763-ad04-7759d7b99529 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:18.284978 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf160c-ac4f-4763-ad04-7759d7b99529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:18.285382 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf160c-ac4f-4763-ad04-7759d7b99529 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:18.286338 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf160c-ac4f-4763-ad04-7759d7b99529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:18.291648 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf160c-ac4f-4763-ad04-7759d7b99529 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:18.314717 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c49870-e0d9-43b4-a01f-37b3a01dc7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:18.317750 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1091/2180] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:36:18.317902 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c49870-e0d9-43b4-a01f-37b3a01dc7f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:18.317902 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c49870-e0d9-43b4-a01f-37b3a01dc7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:18.318149 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c49870-e0d9-43b4-a01f-37b3a01dc7f4 admin admin] PATH_INFO: `/v3/projects/a7ec5ce3eac943739d13c7c7fc2eaf85/users/bdba02b8e51c463b9ba36e0ff7cccdc3/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:18.330959 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf160c-ac4f-4763-ad04-7759d7b99529 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:18.357224 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf160c-ac4f-4763-ad04-7759d7b99529 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:18.371036 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7106891f-ba10-4a7e-9690-22d870edaa08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:18.372739 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c49870-e0d9-43b4-a01f-37b3a01dc7f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7ec5ce3eac943739d13c7c7fc2eaf85, user_id=bdba02b8e51c463b9ba36e0ff7cccdc3, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:18.373896 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106891f-ba10-4a7e-9690-22d870edaa08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:18.375058 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106891f-ba10-4a7e-9690-22d870edaa08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:18.376455 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106891f-ba10-4a7e-9690-22d870edaa08 admin admin] PATH_INFO: `/v3/projects/7740d38ac75843a7b6579f62ad52b05d/users/fa4625f28c4a4e36a630b08ae8d99432/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:18.382055 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c49870-e0d9-43b4-a01f-37b3a01dc7f4 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:18.382794 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7106891f-ba10-4a7e-9690-22d870edaa08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7740d38ac75843a7b6579f62ad52b05d, user_id=fa4625f28c4a4e36a630b08ae8d99432, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:18.389005 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7106891f-ba10-4a7e-9690-22d870edaa08 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:18.411236 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1090/2181] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:36:18 2022] PUT /identity/v3/projects/a7ec5ce3eac943739d13c7c7fc2eaf85/users/bdba02b8e51c463b9ba36e0ff7cccdc3/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:36:18.415676 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b932742-9952-4278-966f-5951bd792739 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:18.416785 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b932742-9952-4278-966f-5951bd792739 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:18.418919 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b932742-9952-4278-966f-5951bd792739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:18.424113 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1092/2182] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:36:18 2022] PUT /identity/v3/projects/7740d38ac75843a7b6579f62ad52b05d/users/fa4625f28c4a4e36a630b08ae8d99432/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:36:18.437835 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6100af0-8264-40c1-abb3-8436a91c0c0c None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:18.438269 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6100af0-8264-40c1-abb3-8436a91c0c0c None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:18.438653 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6100af0-8264-40c1-abb3-8436a91c0c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:18.467052 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-9b932742-9952-4278-966f-5951bd792739 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:18.470886 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9b932742-9952-4278-966f-5951bd792739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:18.480806 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:18.522072 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-a6100af0-8264-40c1-abb3-8436a91c0c0c None None] MFA Rules not processed for user `fa4625f28c4a4e36a630b08ae8d99432`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:18.525927 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-a6100af0-8264-40c1-abb3-8436a91c0c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:18.631236 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1091/2183] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:36:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:36:18.649894 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b932742-9952-4278-966f-5951bd792739 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:18.651438 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9b932742-9952-4278-966f-5951bd792739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:18.709608 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1093/2184] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:36:18 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:36:18.718150 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6100af0-8264-40c1-abb3-8436a91c0c0c None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:18.719819 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-a6100af0-8264-40c1-abb3-8436a91c0c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:18.804238 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b932742-9952-4278-966f-5951bd792739 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:18.823437 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc9c95-7b4d-43d1-a9b7-f85f26221ec5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:18.824174 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc9c95-7b4d-43d1-a9b7-f85f26221ec5 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:18.824532 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc9c95-7b4d-43d1-a9b7-f85f26221ec5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:18.824900 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc9c95-7b4d-43d1-a9b7-f85f26221ec5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:18.836739 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facc9c95-7b4d-43d1-a9b7-f85f26221ec5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:18.838342 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facc9c95-7b4d-43d1-a9b7-f85f26221ec5 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:18.850393 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1092/2185] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:36:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:36:18.867134 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6100af0-8264-40c1-abb3-8436a91c0c0c None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:18.881081 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c0fab4-547e-4085-89bf-ff37ee38275f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:18.882406 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0fab4-547e-4085-89bf-ff37ee38275f service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:18.882698 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0fab4-547e-4085-89bf-ff37ee38275f service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:18.882973 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0fab4-547e-4085-89bf-ff37ee38275f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:18.898511 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-00c0fab4-547e-4085-89bf-ff37ee38275f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:18.967649 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:19.078951 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c0fab4-547e-4085-89bf-ff37ee38275f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:19.080595 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c0fab4-547e-4085-89bf-ff37ee38275f service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:19.107962 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1094/2186] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:36:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:36:20.553089 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc9c95-7b4d-43d1-a9b7-f85f26221ec5 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:20.555125 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-facc9c95-7b4d-43d1-a9b7-f85f26221ec5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:20.613156 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc9c95-7b4d-43d1-a9b7-f85f26221ec5 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:20.643013 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1f04d-b797-4229-ad80-34d2af9f336e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:20.643925 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1f04d-b797-4229-ad80-34d2af9f336e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:20.648928 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1f04d-b797-4229-ad80-34d2af9f336e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:20.651688 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1f04d-b797-4229-ad80-34d2af9f336e admin admin] PATH_INFO: `/v3/users/19413231705941d9a98a620586a907ee` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:20.654010 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e1f04d-b797-4229-ad80-34d2af9f336e admin admin] RBAC: Authorizing `identity:delete_user(user_id=19413231705941d9a98a620586a907ee)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:20.662879 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e1f04d-b797-4229-ad80-34d2af9f336e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:20.817960 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-28e1f04d-b797-4229-ad80-34d2af9f336e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19413231705941d9a98a620586a907ee'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:20.839263 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-28e1f04d-b797-4229-ad80-34d2af9f336e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19413231705941d9a98a620586a907ee'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:20.840243 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-28e1f04d-b797-4229-ad80-34d2af9f336e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19413231705941d9a98a620586a907ee'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:20.841032 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-28e1f04d-b797-4229-ad80-34d2af9f336e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19413231705941d9a98a620586a907ee'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:20.862731 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-28e1f04d-b797-4229-ad80-34d2af9f336e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19413231705941d9a98a620586a907ee'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:20.945455 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1093/2187] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:36:20 2022] DELETE /identity/v3/users/19413231705941d9a98a620586a907ee => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:36:20.946897 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e1b316-eddc-40db-97e3-dc5aa332e8a7 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:20.947407 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e1b316-eddc-40db-97e3-dc5aa332e8a7 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:20.947488 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e1b316-eddc-40db-97e3-dc5aa332e8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:20.993357 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-d1e1b316-eddc-40db-97e3-dc5aa332e8a7 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:20.994617 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-d1e1b316-eddc-40db-97e3-dc5aa332e8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:21.194050 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1095/2188] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:36:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:36:21.232585 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1f04d-b797-4229-ad80-34d2af9f336e admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:21.233766 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-28e1f04d-b797-4229-ad80-34d2af9f336e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:21.291617 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e1b316-eddc-40db-97e3-dc5aa332e8a7 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:21.293067 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-d1e1b316-eddc-40db-97e3-dc5aa332e8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:21.324084 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:21.392116 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1f04d-b797-4229-ad80-34d2af9f336e admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:21.399894 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e1b316-eddc-40db-97e3-dc5aa332e8a7 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:21.401795 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77bc102-811d-41d0-823e-dfe72bd49a46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:21.403745 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c99ff-984f-45f9-94a5-a789cc61eab8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:21.404400 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c99ff-984f-45f9-94a5-a789cc61eab8 service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:21.404686 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c99ff-984f-45f9-94a5-a789cc61eab8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:21.404917 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77bc102-811d-41d0-823e-dfe72bd49a46 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:21.405619 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c99ff-984f-45f9-94a5-a789cc61eab8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:21.405992 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77bc102-811d-41d0-823e-dfe72bd49a46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:21.406917 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77bc102-811d-41d0-823e-dfe72bd49a46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:21.408114 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-dd0c99ff-984f-45f9-94a5-a789cc61eab8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:21.432386 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77bc102-811d-41d0-823e-dfe72bd49a46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:21.436084 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77bc102-811d-41d0-823e-dfe72bd49a46 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:21.461682 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1094/2189] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:36:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:36:21.477007 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0c99ff-984f-45f9-94a5-a789cc61eab8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:21.478499 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0c99ff-984f-45f9-94a5-a789cc61eab8 service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:21.490124 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1096/2190] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:36:21 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:36:22.345298 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77bc102-811d-41d0-823e-dfe72bd49a46 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:22.349523 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e77bc102-811d-41d0-823e-dfe72bd49a46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:22.571927 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77bc102-811d-41d0-823e-dfe72bd49a46 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:22.585472 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08eadec-c769-4de7-b37d-830acb3f1d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:22.586769 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08eadec-c769-4de7-b37d-830acb3f1d9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:22.587054 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08eadec-c769-4de7-b37d-830acb3f1d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:22.587335 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08eadec-c769-4de7-b37d-830acb3f1d9a admin admin] PATH_INFO: `/v3/projects/b4ea12bdacb8489a9ecf2f77bf899763` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:22.589148 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08eadec-c769-4de7-b37d-830acb3f1d9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4ea12bdacb8489a9ecf2f77bf899763)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:22.591103 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08eadec-c769-4de7-b37d-830acb3f1d9a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:22.676167 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c99ff-984f-45f9-94a5-a789cc61eab8 service cinder] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:22.685035 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f08eadec-c769-4de7-b37d-830acb3f1d9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4ea12bdacb8489a9ecf2f77bf899763', 'request_id': 'req-f08eadec-c769-4de7-b37d-830acb3f1d9a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:22.699783 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c99ff-984f-45f9-94a5-a789cc61eab8 service cinder] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:22.704307 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:22.705163 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f08eadec-c769-4de7-b37d-830acb3f1d9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4ea12bdacb8489a9ecf2f77bf899763', 'request_id': 'req-f08eadec-c769-4de7-b37d-830acb3f1d9a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:22.716609 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f08eadec-c769-4de7-b37d-830acb3f1d9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4ea12bdacb8489a9ecf2f77bf899763', 'request_id': 'req-f08eadec-c769-4de7-b37d-830acb3f1d9a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:22.759521 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f08eadec-c769-4de7-b37d-830acb3f1d9a admin admin] The token cache is being invalidate because project b4ea12bdacb8489a9ecf2f77bf899763 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:36:22.759895 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f08eadec-c769-4de7-b37d-830acb3f1d9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:22.760636 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f08eadec-c769-4de7-b37d-830acb3f1d9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:22.762329 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1095/2191] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:36:22 2022] DELETE /identity/v3/projects/b4ea12bdacb8489a9ecf2f77bf899763 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:36:22.767956 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bff9f4-d2a6-467b-8307-e2d02b39cc97 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:22.768455 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bff9f4-d2a6-467b-8307-e2d02b39cc97 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:22.768810 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bff9f4-d2a6-467b-8307-e2d02b39cc97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:22.852418 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897959c2-b4eb-46f0-aaaa-5add6d09999a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:22.854599 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897959c2-b4eb-46f0-aaaa-5add6d09999a service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:22.854970 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897959c2-b4eb-46f0-aaaa-5add6d09999a service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:22.855248 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897959c2-b4eb-46f0-aaaa-5add6d09999a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:22.864510 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-897959c2-b4eb-46f0-aaaa-5add6d09999a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:22.907578 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d3bff9f4-d2a6-467b-8307-e2d02b39cc97 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:22.909030 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d3bff9f4-d2a6-467b-8307-e2d02b39cc97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:22.966469 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:22.981978 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897959c2-b4eb-46f0-aaaa-5add6d09999a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:22.986357 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897959c2-b4eb-46f0-aaaa-5add6d09999a service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:23.002494 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1097/2192] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:36:22 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:36:23.072222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1096/2193] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:36:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:36:23.074463 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872bda0-e8d1-408a-be87-528930aa7af8 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:23.074765 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872bda0-e8d1-408a-be87-528930aa7af8 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:23.075050 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872bda0-e8d1-408a-be87-528930aa7af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:23.123559 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-7872bda0-e8d1-408a-be87-528930aa7af8 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:23.125466 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-7872bda0-e8d1-408a-be87-528930aa7af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:23.151744 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1098/2194] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:36:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:36:23.152203 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bff9f4-d2a6-467b-8307-e2d02b39cc97 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:23.173634 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bff9f4-d2a6-467b-8307-e2d02b39cc97 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:23.190716 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5808b95c-c57f-494f-9ad9-2e6ae1f53952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:23.190716 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5808b95c-c57f-494f-9ad9-2e6ae1f53952 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:23.190716 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5808b95c-c57f-494f-9ad9-2e6ae1f53952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:23.190716 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5808b95c-c57f-494f-9ad9-2e6ae1f53952 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:23.191358 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5808b95c-c57f-494f-9ad9-2e6ae1f53952 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:36:23.191574 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5808b95c-c57f-494f-9ad9-2e6ae1f53952 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:23.193970 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5808b95c-c57f-494f-9ad9-2e6ae1f53952 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:23.236676 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1097/2195] 10.222.0.16 () {58 vars in 1152 bytes} [Thu May 26 12:36:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:36:23.237954 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872bda0-e8d1-408a-be87-528930aa7af8 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:23.251980 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872bda0-e8d1-408a-be87-528930aa7af8 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:23.266036 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed88702-78f7-42b9-b5f4-76c3386e6b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:23.266717 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed88702-78f7-42b9-b5f4-76c3386e6b41 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:23.267004 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed88702-78f7-42b9-b5f4-76c3386e6b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:23.267281 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed88702-78f7-42b9-b5f4-76c3386e6b41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:23.267979 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed88702-78f7-42b9-b5f4-76c3386e6b41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:23.269953 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed88702-78f7-42b9-b5f4-76c3386e6b41 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:23.356094 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1099/2196] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:36:23 2022] POST /identity/v3/projects => generated 373 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:36:23.359391 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5808b95c-c57f-494f-9ad9-2e6ae1f53952 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:23.372412 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5808b95c-c57f-494f-9ad9-2e6ae1f53952 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:23.527117 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72089255-62d7-4a79-87f8-ab63490262de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:23.528308 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72089255-62d7-4a79-87f8-ab63490262de admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:23.528949 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72089255-62d7-4a79-87f8-ab63490262de admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:23.529399 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72089255-62d7-4a79-87f8-ab63490262de admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:23.531514 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72089255-62d7-4a79-87f8-ab63490262de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:23.533736 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72089255-62d7-4a79-87f8-ab63490262de admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:23.599028 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1098/2197] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:36:23 2022] POST /identity/v3/users => generated 287 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:36:23.600352 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed88702-78f7-42b9-b5f4-76c3386e6b41 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:23.623773 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed88702-78f7-42b9-b5f4-76c3386e6b41 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:23.638873 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8ee65-f9b8-49a6-9034-882c4822d71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:23.640561 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8ee65-f9b8-49a6-9034-882c4822d71e admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:23.641019 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8ee65-f9b8-49a6-9034-882c4822d71e admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:23.641634 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8ee65-f9b8-49a6-9034-882c4822d71e admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:23.642621 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da8ee65-f9b8-49a6-9034-882c4822d71e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:23.644431 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da8ee65-f9b8-49a6-9034-882c4822d71e admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:23.672574 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1100/2198] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:36:23 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:36:23.674033 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72089255-62d7-4a79-87f8-ab63490262de admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:23.694940 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72089255-62d7-4a79-87f8-ab63490262de admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:23.704409 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0507ae05-dd04-41f3-88c5-b6ea909f2711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:23.705316 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0507ae05-dd04-41f3-88c5-b6ea909f2711 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:23.705606 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0507ae05-dd04-41f3-88c5-b6ea909f2711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:23.705883 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0507ae05-dd04-41f3-88c5-b6ea909f2711 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:23.706690 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0507ae05-dd04-41f3-88c5-b6ea909f2711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:23.709569 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0507ae05-dd04-41f3-88c5-b6ea909f2711 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:23.768081 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1099/2199] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:36:23 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:36:23.772083 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8ee65-f9b8-49a6-9034-882c4822d71e admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:23.787215 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8ee65-f9b8-49a6-9034-882c4822d71e admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:23.807604 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ce2d6-8bb1-4a30-b60e-d12f19de36ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:23.809010 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ce2d6-8bb1-4a30-b60e-d12f19de36ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:23.813280 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ce2d6-8bb1-4a30-b60e-d12f19de36ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:23.813748 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ce2d6-8bb1-4a30-b60e-d12f19de36ec admin admin] PATH_INFO: `/v3/projects/1dcee0d352204af2affd56b2c625c87f/users/2d5dd127ef0b453cb083cd7b15120ce6/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:23.887127 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411ce2d6-8bb1-4a30-b60e-d12f19de36ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dcee0d352204af2affd56b2c625c87f, user_id=2d5dd127ef0b453cb083cd7b15120ce6, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:23.895349 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411ce2d6-8bb1-4a30-b60e-d12f19de36ec admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:23.932751 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1101/2200] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:36:23 2022] PUT /identity/v3/projects/1dcee0d352204af2affd56b2c625c87f/users/2d5dd127ef0b453cb083cd7b15120ce6/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:36:23.935282 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421fef5-e6e9-48b2-ba11-69a6425861e3 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:23.935869 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421fef5-e6e9-48b2-ba11-69a6425861e3 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:23.936332 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421fef5-e6e9-48b2-ba11-69a6425861e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:24.020007 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-2421fef5-e6e9-48b2-ba11-69a6425861e3 None None] MFA Rules not processed for user `2d5dd127ef0b453cb083cd7b15120ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:24.021651 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2421fef5-e6e9-48b2-ba11-69a6425861e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:24.194185 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1100/2201] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:36:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:36:24.215630 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ce2d6-8bb1-4a30-b60e-d12f19de36ec admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:24.217731 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-411ce2d6-8bb1-4a30-b60e-d12f19de36ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:24.312774 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:24.341677 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ce2d6-8bb1-4a30-b60e-d12f19de36ec admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:24.351282 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ca939-b5ac-4411-9081-fee8ae55ad45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:24.352184 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ca939-b5ac-4411-9081-fee8ae55ad45 service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:24.352553 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ca939-b5ac-4411-9081-fee8ae55ad45 service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:24.357349 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ca939-b5ac-4411-9081-fee8ae55ad45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:24.379669 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898ca939-b5ac-4411-9081-fee8ae55ad45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:24.382018 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898ca939-b5ac-4411-9081-fee8ae55ad45 service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:24.393428 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1102/2202] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:36:24 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:36:28.243029 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d061a-3603-4edb-893f-29d920c953e2 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:28.243564 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d061a-3603-4edb-893f-29d920c953e2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:28.243564 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d061a-3603-4edb-893f-29d920c953e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:28.280862 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-ef7d061a-3603-4edb-893f-29d920c953e2 None None] MFA Rules not processed for user `bdba02b8e51c463b9ba36e0ff7cccdc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:28.283801 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ef7d061a-3603-4edb-893f-29d920c953e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:28.314143 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:28.438023 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1101/2203] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:36:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:36:28.443700 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ca939-b5ac-4411-9081-fee8ae55ad45 service cinder] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:28.444177 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-898ca939-b5ac-4411-9081-fee8ae55ad45 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:28.564866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ca939-b5ac-4411-9081-fee8ae55ad45 service cinder] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:28.580419 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feadb827-bba5-420d-aea1-0d8b7d12770d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:28.581728 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feadb827-bba5-420d-aea1-0d8b7d12770d admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:28.582203 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feadb827-bba5-420d-aea1-0d8b7d12770d admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:28.582696 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feadb827-bba5-420d-aea1-0d8b7d12770d admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:28.583587 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feadb827-bba5-420d-aea1-0d8b7d12770d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:28.585996 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feadb827-bba5-420d-aea1-0d8b7d12770d admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:28.633912 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1103/2204] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:36:28 2022] POST /identity/v3/projects => generated 371 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:36:28.638585 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d061a-3603-4edb-893f-29d920c953e2 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:28.656456 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d061a-3603-4edb-893f-29d920c953e2 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:28.764221 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d2f2d4-527b-474d-9037-4eb3fc2ec154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:28.765269 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2f2d4-527b-474d-9037-4eb3fc2ec154 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:28.765730 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2f2d4-527b-474d-9037-4eb3fc2ec154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:28.766118 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2f2d4-527b-474d-9037-4eb3fc2ec154 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:28.767352 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d2f2d4-527b-474d-9037-4eb3fc2ec154 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:28.769445 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d2f2d4-527b-474d-9037-4eb3fc2ec154 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:28.805022 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1102/2205] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:36:28 2022] POST /identity/v3/users => generated 292 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:36:28.807004 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feadb827-bba5-420d-aea1-0d8b7d12770d admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:28.818989 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feadb827-bba5-420d-aea1-0d8b7d12770d admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:28.830065 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d5c9c-34d6-491f-ab60-f741597ed2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:28.831007 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d5c9c-34d6-491f-ab60-f741597ed2ad admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:28.831323 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d5c9c-34d6-491f-ab60-f741597ed2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:28.831540 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d5c9c-34d6-491f-ab60-f741597ed2ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:28.832337 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9d5c9c-34d6-491f-ab60-f741597ed2ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:28.838591 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9d5c9c-34d6-491f-ab60-f741597ed2ad admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:28.861722 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1104/2206] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:36:28 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:36:28.864551 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d2f2d4-527b-474d-9037-4eb3fc2ec154 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:28.900880 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d2f2d4-527b-474d-9037-4eb3fc2ec154 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:28.912710 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ed49a-8d02-425c-85db-2715faa8152f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:28.914241 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ed49a-8d02-425c-85db-2715faa8152f admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:28.914877 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ed49a-8d02-425c-85db-2715faa8152f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:28.915382 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ed49a-8d02-425c-85db-2715faa8152f admin admin] PATH_INFO: `/v3/projects/e52e523cdbac4cfb8e4cc1456404d854/users/7ecf1c752f744460978f311c2a5faa13/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:28.946411 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1ed49a-8d02-425c-85db-2715faa8152f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e52e523cdbac4cfb8e4cc1456404d854, user_id=7ecf1c752f744460978f311c2a5faa13, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:28.949822 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1ed49a-8d02-425c-85db-2715faa8152f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:28.977267 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1103/2207] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:36:28 2022] PUT /identity/v3/projects/e52e523cdbac4cfb8e4cc1456404d854/users/7ecf1c752f744460978f311c2a5faa13/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:36:28.978505 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d5c9c-34d6-491f-ab60-f741597ed2ad admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:28.991395 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d5c9c-34d6-491f-ab60-f741597ed2ad admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:29.085305 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8585394-73f9-4967-b516-218a94ac2b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:29.086214 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8585394-73f9-4967-b516-218a94ac2b0f admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:29.086607 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8585394-73f9-4967-b516-218a94ac2b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:29.087003 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8585394-73f9-4967-b516-218a94ac2b0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:29.087852 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8585394-73f9-4967-b516-218a94ac2b0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:29.089666 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8585394-73f9-4967-b516-218a94ac2b0f admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:29.106590 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1105/2208] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:36:28 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:36:29.111751 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ed49a-8d02-425c-85db-2715faa8152f admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:29.127439 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ed49a-8d02-425c-85db-2715faa8152f admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:29.138099 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29475ff5-b334-4e72-8c88-2132d73da902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:29.139224 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29475ff5-b334-4e72-8c88-2132d73da902 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:29.139361 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29475ff5-b334-4e72-8c88-2132d73da902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:29.139630 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29475ff5-b334-4e72-8c88-2132d73da902 admin admin] PATH_INFO: `/v3/projects/e52e523cdbac4cfb8e4cc1456404d854/users/7ecf1c752f744460978f311c2a5faa13/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:29.141726 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29475ff5-b334-4e72-8c88-2132d73da902 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e52e523cdbac4cfb8e4cc1456404d854, user_id=7ecf1c752f744460978f311c2a5faa13, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:29.144409 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29475ff5-b334-4e72-8c88-2132d73da902 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:29.161841 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1104/2209] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:36:29 2022] PUT /identity/v3/projects/e52e523cdbac4cfb8e4cc1456404d854/users/7ecf1c752f744460978f311c2a5faa13/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:36:29.302915 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8585394-73f9-4967-b516-218a94ac2b0f admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:29.304888 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-e8585394-73f9-4967-b516-218a94ac2b0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:29.340681 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8585394-73f9-4967-b516-218a94ac2b0f admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:29.411777 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:29.430879 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fff6b7-b61d-4f4f-a3b7-c81c09574ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:29.431771 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fff6b7-b61d-4f4f-a3b7-c81c09574ba4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:29.432060 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fff6b7-b61d-4f4f-a3b7-c81c09574ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:29.432339 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fff6b7-b61d-4f4f-a3b7-c81c09574ba4 admin admin] PATH_INFO: `/v3/users/3da8a9ad4a49462497d859b500559eea` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:29.438226 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fff6b7-b61d-4f4f-a3b7-c81c09574ba4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3da8a9ad4a49462497d859b500559eea)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:29.440244 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fff6b7-b61d-4f4f-a3b7-c81c09574ba4 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:29.517134 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-c1fff6b7-b61d-4f4f-a3b7-c81c09574ba4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3da8a9ad4a49462497d859b500559eea'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:29.517808 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-c1fff6b7-b61d-4f4f-a3b7-c81c09574ba4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3da8a9ad4a49462497d859b500559eea'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:29.518627 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-c1fff6b7-b61d-4f4f-a3b7-c81c09574ba4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3da8a9ad4a49462497d859b500559eea'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:29.535334 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-c1fff6b7-b61d-4f4f-a3b7-c81c09574ba4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3da8a9ad4a49462497d859b500559eea'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:29.571408 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-c1fff6b7-b61d-4f4f-a3b7-c81c09574ba4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3da8a9ad4a49462497d859b500559eea'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:29.615263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1106/2210] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:36:29 2022] DELETE /identity/v3/users/3da8a9ad4a49462497d859b500559eea => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:36:29.620251 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9aa8e-70b0-4ad7-88b7-cb411c773f81 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:29.621187 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9aa8e-70b0-4ad7-88b7-cb411c773f81 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:29.621644 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9aa8e-70b0-4ad7-88b7-cb411c773f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:29.656478 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b3d9aa8e-70b0-4ad7-88b7-cb411c773f81 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:29.658304 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b3d9aa8e-70b0-4ad7-88b7-cb411c773f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:29.790961 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1105/2211] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:36:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:36:29.799875 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fff6b7-b61d-4f4f-a3b7-c81c09574ba4 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:29.801441 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-c1fff6b7-b61d-4f4f-a3b7-c81c09574ba4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:29.981312 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fff6b7-b61d-4f4f-a3b7-c81c09574ba4 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:29.985895 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439de6bc-819d-456f-8a92-7616459f3671 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:29.986846 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439de6bc-819d-456f-8a92-7616459f3671 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:29.987067 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439de6bc-819d-456f-8a92-7616459f3671 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:29.987673 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439de6bc-819d-456f-8a92-7616459f3671 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:30.000304 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439de6bc-819d-456f-8a92-7616459f3671 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:30.001943 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439de6bc-819d-456f-8a92-7616459f3671 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:30.013960 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1107/2212] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:36:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:36:30.681583 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d9aa8e-70b0-4ad7-88b7-cb411c773f81 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:30.686120 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b3d9aa8e-70b0-4ad7-88b7-cb411c773f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:30.700050 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:30.708598 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d9aa8e-70b0-4ad7-88b7-cb411c773f81 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:30.728665 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392af5f-7e4c-4be3-b6f7-d4b44f6b6679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:30.730647 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392af5f-7e4c-4be3-b6f7-d4b44f6b6679 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:30.731530 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392af5f-7e4c-4be3-b6f7-d4b44f6b6679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:30.732116 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392af5f-7e4c-4be3-b6f7-d4b44f6b6679 admin admin] PATH_INFO: `/v3/projects/caf9da1ef77a4d769754b89ba5984796` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:30.739544 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d392af5f-7e4c-4be3-b6f7-d4b44f6b6679 admin admin] RBAC: Authorizing `identity:delete_project(project_id=caf9da1ef77a4d769754b89ba5984796)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:30.743555 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d392af5f-7e4c-4be3-b6f7-d4b44f6b6679 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:30.864880 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d392af5f-7e4c-4be3-b6f7-d4b44f6b6679 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caf9da1ef77a4d769754b89ba5984796', 'request_id': 'req-d392af5f-7e4c-4be3-b6f7-d4b44f6b6679'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:30.876799 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d392af5f-7e4c-4be3-b6f7-d4b44f6b6679 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caf9da1ef77a4d769754b89ba5984796', 'request_id': 'req-d392af5f-7e4c-4be3-b6f7-d4b44f6b6679'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:30.895801 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d392af5f-7e4c-4be3-b6f7-d4b44f6b6679 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caf9da1ef77a4d769754b89ba5984796', 'request_id': 'req-d392af5f-7e4c-4be3-b6f7-d4b44f6b6679'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:30.933095 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d392af5f-7e4c-4be3-b6f7-d4b44f6b6679 admin admin] The token cache is being invalidate because project caf9da1ef77a4d769754b89ba5984796 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:36:30.933882 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d392af5f-7e4c-4be3-b6f7-d4b44f6b6679 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:30.935989 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d392af5f-7e4c-4be3-b6f7-d4b44f6b6679 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:30.940968 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1106/2213] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:36:30 2022] DELETE /identity/v3/projects/caf9da1ef77a4d769754b89ba5984796 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:36:30.945161 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439de6bc-819d-456f-8a92-7616459f3671 service neutron] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:30.962638 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439de6bc-819d-456f-8a92-7616459f3671 service neutron] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:31.119374 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed7f99-eaac-4545-b297-276368de9435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:31.120572 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed7f99-eaac-4545-b297-276368de9435 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:31.120891 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed7f99-eaac-4545-b297-276368de9435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:31.121170 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed7f99-eaac-4545-b297-276368de9435 admin admin] PATH_INFO: `/v3/users/314bebb747694cc59322597a52489343` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:31.124973 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ed7f99-eaac-4545-b297-276368de9435 admin admin] RBAC: Authorizing `identity:delete_user(user_id=314bebb747694cc59322597a52489343)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:31.127253 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ed7f99-eaac-4545-b297-276368de9435 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:31.133837 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:31.257249 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-69ed7f99-eaac-4545-b297-276368de9435 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '314bebb747694cc59322597a52489343'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:31.258861 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-69ed7f99-eaac-4545-b297-276368de9435 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '314bebb747694cc59322597a52489343'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:31.260021 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-69ed7f99-eaac-4545-b297-276368de9435 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '314bebb747694cc59322597a52489343'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:31.274344 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-69ed7f99-eaac-4545-b297-276368de9435 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '314bebb747694cc59322597a52489343'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:31.292699 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-69ed7f99-eaac-4545-b297-276368de9435 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '314bebb747694cc59322597a52489343'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:31.322767 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1108/2214] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:36:30 2022] DELETE /identity/v3/users/314bebb747694cc59322597a52489343 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:36:31.772601 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392af5f-7e4c-4be3-b6f7-d4b44f6b6679 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:31.774776 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d392af5f-7e4c-4be3-b6f7-d4b44f6b6679 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:31.803607 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392af5f-7e4c-4be3-b6f7-d4b44f6b6679 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:31.929661 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3a486-1568-433c-ac3f-f08af3fe23a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:31.930866 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3a486-1568-433c-ac3f-f08af3fe23a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:31.931350 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3a486-1568-433c-ac3f-f08af3fe23a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:31.931851 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3a486-1568-433c-ac3f-f08af3fe23a1 admin admin] PATH_INFO: `/v3/projects/bce8a99489294c8bb75845bd750d390b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:31.935300 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b3a486-1568-433c-ac3f-f08af3fe23a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bce8a99489294c8bb75845bd750d390b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:31.937705 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b3a486-1568-433c-ac3f-f08af3fe23a1 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:32.076715 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-86b3a486-1568-433c-ac3f-f08af3fe23a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bce8a99489294c8bb75845bd750d390b', 'request_id': 'req-86b3a486-1568-433c-ac3f-f08af3fe23a1'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:32.095915 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-86b3a486-1568-433c-ac3f-f08af3fe23a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bce8a99489294c8bb75845bd750d390b', 'request_id': 'req-86b3a486-1568-433c-ac3f-f08af3fe23a1'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:32.117808 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-86b3a486-1568-433c-ac3f-f08af3fe23a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bce8a99489294c8bb75845bd750d390b', 'request_id': 'req-86b3a486-1568-433c-ac3f-f08af3fe23a1'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:32.161020 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-86b3a486-1568-433c-ac3f-f08af3fe23a1 admin admin] The token cache is being invalidate because project bce8a99489294c8bb75845bd750d390b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:36:32.165589 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-86b3a486-1568-433c-ac3f-f08af3fe23a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:32.166712 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-86b3a486-1568-433c-ac3f-f08af3fe23a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:32.168519 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1107/2215] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:36:31 2022] DELETE /identity/v3/projects/bce8a99489294c8bb75845bd750d390b => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:36:32.172744 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed7f99-eaac-4545-b297-276368de9435 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:32.174262 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-69ed7f99-eaac-4545-b297-276368de9435 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:32.194424 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed7f99-eaac-4545-b297-276368de9435 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:32.295840 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963c1a56-aaf9-4938-b2a3-d5ef16e2798b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:32.296885 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c1a56-aaf9-4938-b2a3-d5ef16e2798b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:32.297145 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c1a56-aaf9-4938-b2a3-d5ef16e2798b admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:32.297422 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c1a56-aaf9-4938-b2a3-d5ef16e2798b admin admin] PATH_INFO: `/v3/users/fa4625f28c4a4e36a630b08ae8d99432` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:32.298954 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963c1a56-aaf9-4938-b2a3-d5ef16e2798b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa4625f28c4a4e36a630b08ae8d99432)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:32.303650 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963c1a56-aaf9-4938-b2a3-d5ef16e2798b admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:32.396197 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-963c1a56-aaf9-4938-b2a3-d5ef16e2798b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa4625f28c4a4e36a630b08ae8d99432'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:32.396962 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-963c1a56-aaf9-4938-b2a3-d5ef16e2798b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa4625f28c4a4e36a630b08ae8d99432'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:32.397667 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-963c1a56-aaf9-4938-b2a3-d5ef16e2798b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa4625f28c4a4e36a630b08ae8d99432'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:32.415888 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-963c1a56-aaf9-4938-b2a3-d5ef16e2798b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa4625f28c4a4e36a630b08ae8d99432'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:32.442332 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-963c1a56-aaf9-4938-b2a3-d5ef16e2798b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa4625f28c4a4e36a630b08ae8d99432'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:32.458145 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:32.467384 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1109/2216] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:36:32 2022] DELETE /identity/v3/users/fa4625f28c4a4e36a630b08ae8d99432 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:36:33.132155 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3a486-1568-433c-ac3f-f08af3fe23a1 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:33.133709 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-86b3a486-1568-433c-ac3f-f08af3fe23a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:33.175880 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3a486-1568-433c-ac3f-f08af3fe23a1 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:33.216991 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:33.373372 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7803c74-f09b-41e8-8817-3c54cf91b8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:33.377561 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7803c74-f09b-41e8-8817-3c54cf91b8d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:33.377898 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7803c74-f09b-41e8-8817-3c54cf91b8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:33.378251 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7803c74-f09b-41e8-8817-3c54cf91b8d5 admin admin] PATH_INFO: `/v3/projects/7740d38ac75843a7b6579f62ad52b05d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:33.385797 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7803c74-f09b-41e8-8817-3c54cf91b8d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7740d38ac75843a7b6579f62ad52b05d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:33.389874 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7803c74-f09b-41e8-8817-3c54cf91b8d5 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:33.582623 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b7803c74-f09b-41e8-8817-3c54cf91b8d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7740d38ac75843a7b6579f62ad52b05d', 'request_id': 'req-b7803c74-f09b-41e8-8817-3c54cf91b8d5'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:33.635972 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b7803c74-f09b-41e8-8817-3c54cf91b8d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7740d38ac75843a7b6579f62ad52b05d', 'request_id': 'req-b7803c74-f09b-41e8-8817-3c54cf91b8d5'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:33.673072 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b7803c74-f09b-41e8-8817-3c54cf91b8d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7740d38ac75843a7b6579f62ad52b05d', 'request_id': 'req-b7803c74-f09b-41e8-8817-3c54cf91b8d5'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:33.797761 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b7803c74-f09b-41e8-8817-3c54cf91b8d5 admin admin] The token cache is being invalidate because project 7740d38ac75843a7b6579f62ad52b05d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:36:33.798760 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b7803c74-f09b-41e8-8817-3c54cf91b8d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:33.799672 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b7803c74-f09b-41e8-8817-3c54cf91b8d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:33.806324 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1108/2217] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:36:33 2022] DELETE /identity/v3/projects/7740d38ac75843a7b6579f62ad52b05d => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:36:33.811442 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa16f2e-336d-4cc0-b31f-e6fb06767a3c None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:33.811442 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa16f2e-336d-4cc0-b31f-e6fb06767a3c None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:33.812337 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa16f2e-336d-4cc0-b31f-e6fb06767a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:33.874612 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-2fa16f2e-336d-4cc0-b31f-e6fb06767a3c None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:33.884066 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-2fa16f2e-336d-4cc0-b31f-e6fb06767a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:34.017733 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1110/2218] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:36:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:36:34.019121 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6cf532-1191-442c-9278-b83d96da0744 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:34.019417 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6cf532-1191-442c-9278-b83d96da0744 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:34.019696 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6cf532-1191-442c-9278-b83d96da0744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:34.084999 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-6f6cf532-1191-442c-9278-b83d96da0744 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:34.086251 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6f6cf532-1191-442c-9278-b83d96da0744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:34.137062 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1109/2219] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:36:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:36:34.141817 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa16f2e-336d-4cc0-b31f-e6fb06767a3c None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:34.158261 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa16f2e-336d-4cc0-b31f-e6fb06767a3c None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:34.190650 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7bb248-baad-458b-ba92-bb3e5829c5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:34.191833 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7bb248-baad-458b-ba92-bb3e5829c5de admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:34.192399 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7bb248-baad-458b-ba92-bb3e5829c5de admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:34.192970 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7bb248-baad-458b-ba92-bb3e5829c5de admin admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:34.193976 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7bb248-baad-458b-ba92-bb3e5829c5de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:36:34.194959 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7bb248-baad-458b-ba92-bb3e5829c5de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:34.201898 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7bb248-baad-458b-ba92-bb3e5829c5de admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:34.250418 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1111/2220] 10.222.0.16 () {58 vars in 1152 bytes} [Thu May 26 12:36:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:36:34.254791 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6cf532-1191-442c-9278-b83d96da0744 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:34.266021 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6cf532-1191-442c-9278-b83d96da0744 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:34.283693 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffac804-b72c-42ff-92e4-bd54ecd67b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:34.284568 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffac804-b72c-42ff-92e4-bd54ecd67b3d admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:34.285000 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffac804-b72c-42ff-92e4-bd54ecd67b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:34.285386 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffac804-b72c-42ff-92e4-bd54ecd67b3d admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:34.286193 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffac804-b72c-42ff-92e4-bd54ecd67b3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:34.292027 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffac804-b72c-42ff-92e4-bd54ecd67b3d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:34.381269 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7bb248-baad-458b-ba92-bb3e5829c5de admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:34.385351 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1110/2221] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:36:34 2022] POST /identity/v3/projects => generated 383 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:36:34.398005 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7bb248-baad-458b-ba92-bb3e5829c5de admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:34.521301 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838cd8f-cc2e-4b5d-9862-8c2d2d607d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:34.522079 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838cd8f-cc2e-4b5d-9862-8c2d2d607d44 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:34.522505 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838cd8f-cc2e-4b5d-9862-8c2d2d607d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:34.523160 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838cd8f-cc2e-4b5d-9862-8c2d2d607d44 admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:34.524529 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6838cd8f-cc2e-4b5d-9862-8c2d2d607d44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:34.526652 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6838cd8f-cc2e-4b5d-9862-8c2d2d607d44 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:34.578384 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffac804-b72c-42ff-92e4-bd54ecd67b3d admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:34.591690 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1112/2222] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:36:34 2022] POST /identity/v3/users => generated 292 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:36:34.596442 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffac804-b72c-42ff-92e4-bd54ecd67b3d admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:34.611405 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3216f578-2d17-41b2-b6a9-15311292ce8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:34.612348 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216f578-2d17-41b2-b6a9-15311292ce8a admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:34.613298 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216f578-2d17-41b2-b6a9-15311292ce8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:34.613298 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216f578-2d17-41b2-b6a9-15311292ce8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:34.613844 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3216f578-2d17-41b2-b6a9-15311292ce8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:34.617984 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3216f578-2d17-41b2-b6a9-15311292ce8a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:34.652019 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838cd8f-cc2e-4b5d-9862-8c2d2d607d44 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:34.665935 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838cd8f-cc2e-4b5d-9862-8c2d2d607d44 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:34.667287 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1111/2223] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:36:34 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:36:34.679889 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dab97ed-8300-4106-81a9-94394bc553aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:34.681044 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab97ed-8300-4106-81a9-94394bc553aa admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:34.681457 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab97ed-8300-4106-81a9-94394bc553aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:34.681848 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab97ed-8300-4106-81a9-94394bc553aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:34.684713 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dab97ed-8300-4106-81a9-94394bc553aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:34.691438 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dab97ed-8300-4106-81a9-94394bc553aa admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:34.732618 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3216f578-2d17-41b2-b6a9-15311292ce8a admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:34.745739 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1113/2224] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:36:34 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:36:34.746586 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3216f578-2d17-41b2-b6a9-15311292ce8a admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:34.767576 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8673da7e-33ef-4529-a270-2634f1455c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:34.768704 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8673da7e-33ef-4529-a270-2634f1455c4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:34.769139 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8673da7e-33ef-4529-a270-2634f1455c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:34.770266 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8673da7e-33ef-4529-a270-2634f1455c4f admin admin] PATH_INFO: `/v3/projects/7c4668aff4344bd69cb8ef7bb405915e/users/20f59067669545ea8ff250f67e0eba69/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:34.823914 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8673da7e-33ef-4529-a270-2634f1455c4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c4668aff4344bd69cb8ef7bb405915e, user_id=20f59067669545ea8ff250f67e0eba69, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:34.826716 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8673da7e-33ef-4529-a270-2634f1455c4f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:34.852879 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1112/2225] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:36:34 2022] PUT /identity/v3/projects/7c4668aff4344bd69cb8ef7bb405915e/users/20f59067669545ea8ff250f67e0eba69/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:36:34.864619 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b0d23-5a98-452a-b6f4-ff7c7697db5a None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:34.865255 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b0d23-5a98-452a-b6f4-ff7c7697db5a None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:34.865255 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b0d23-5a98-452a-b6f4-ff7c7697db5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:34.901354 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-8c9b0d23-5a98-452a-b6f4-ff7c7697db5a None None] MFA Rules not processed for user `20f59067669545ea8ff250f67e0eba69`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:34.902786 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-8c9b0d23-5a98-452a-b6f4-ff7c7697db5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:34.985187 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:35.008452 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1114/2226] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:36:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:36:35.016114 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8673da7e-33ef-4529-a270-2634f1455c4f admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:35.018174 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8673da7e-33ef-4529-a270-2634f1455c4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:35.125905 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:35.150007 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8673da7e-33ef-4529-a270-2634f1455c4f admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:35.159389 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80379d6e-4b43-407f-a78a-11a380d5514e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:35.160334 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80379d6e-4b43-407f-a78a-11a380d5514e service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:35.160791 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80379d6e-4b43-407f-a78a-11a380d5514e service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:35.161311 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80379d6e-4b43-407f-a78a-11a380d5514e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:35.179630 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80379d6e-4b43-407f-a78a-11a380d5514e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:35.181445 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80379d6e-4b43-407f-a78a-11a380d5514e service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:35.192630 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1113/2227] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:36:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:36:35.720714 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494dc94-bc66-4ba0-bfdd-802859d598da None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:35.721461 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494dc94-bc66-4ba0-bfdd-802859d598da None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:35.722007 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494dc94-bc66-4ba0-bfdd-802859d598da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:35.786571 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-5494dc94-bc66-4ba0-bfdd-802859d598da None None] MFA Rules not processed for user `5ee5df3ae35f4ab48c2085d488b5724d`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:35.788185 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-5494dc94-bc66-4ba0-bfdd-802859d598da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:35.923904 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1115/2228] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:36:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:36:36.904392 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbbaeb5-4d65-4852-aaa6-03a5ea73a261 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:36.907834 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbbaeb5-4d65-4852-aaa6-03a5ea73a261 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:36.908375 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbbaeb5-4d65-4852-aaa6-03a5ea73a261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:36.983066 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-6fbbaeb5-4d65-4852-aaa6-03a5ea73a261 None None] MFA Rules not processed for user `7ecf1c752f744460978f311c2a5faa13`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:36.986855 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6fbbaeb5-4d65-4852-aaa6-03a5ea73a261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:37.160545 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1114/2229] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:36:36 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:36:37.227559 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5494dc94-bc66-4ba0-bfdd-802859d598da None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:37.238913 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-5494dc94-bc66-4ba0-bfdd-802859d598da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:37.429161 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5494dc94-bc66-4ba0-bfdd-802859d598da None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:37.448047 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea754b07-5b54-4755-8c22-52d76997e3ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536f68ff77794352adf41aaacdc0645c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:37.448923 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea754b07-5b54-4755-8c22-52d76997e3ab service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:37.449392 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea754b07-5b54-4755-8c22-52d76997e3ab service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:37.449779 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea754b07-5b54-4755-8c22-52d76997e3ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:37.452903 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-ea754b07-5b54-4755-8c22-52d76997e3ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:37.554856 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea754b07-5b54-4755-8c22-52d76997e3ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:37.556676 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea754b07-5b54-4755-8c22-52d76997e3ab service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:37.570699 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1116/2230] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:36:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:36:38.395744 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbbaeb5-4d65-4852-aaa6-03a5ea73a261 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:38.469991 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbbaeb5-4d65-4852-aaa6-03a5ea73a261 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:38.475148 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1d9b6-5986-4422-9db8-046d7057b816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:38.476044 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1d9b6-5986-4422-9db8-046d7057b816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:38.476332 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1d9b6-5986-4422-9db8-046d7057b816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:38.476732 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1d9b6-5986-4422-9db8-046d7057b816 admin admin] PATH_INFO: `/v3/users/20f59067669545ea8ff250f67e0eba69` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:38.478141 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef1d9b6-5986-4422-9db8-046d7057b816 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20f59067669545ea8ff250f67e0eba69)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:38.480303 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef1d9b6-5986-4422-9db8-046d7057b816 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:38.549249 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6ef1d9b6-5986-4422-9db8-046d7057b816 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20f59067669545ea8ff250f67e0eba69'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:38.558093 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6ef1d9b6-5986-4422-9db8-046d7057b816 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20f59067669545ea8ff250f67e0eba69'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:38.559088 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6ef1d9b6-5986-4422-9db8-046d7057b816 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20f59067669545ea8ff250f67e0eba69'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:38.559823 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6ef1d9b6-5986-4422-9db8-046d7057b816 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20f59067669545ea8ff250f67e0eba69'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:38.568971 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6ef1d9b6-5986-4422-9db8-046d7057b816 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20f59067669545ea8ff250f67e0eba69'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:38.583828 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:38.600243 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1115/2231] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:36:38 2022] DELETE /identity/v3/users/20f59067669545ea8ff250f67e0eba69 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:36:38.602014 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7cdda-2d28-4b75-bcff-9a2102ee2829 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:38.602823 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7cdda-2d28-4b75-bcff-9a2102ee2829 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:38.602823 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7cdda-2d28-4b75-bcff-9a2102ee2829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:38.620934 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-79f7cdda-2d28-4b75-bcff-9a2102ee2829 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:38.622282 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-79f7cdda-2d28-4b75-bcff-9a2102ee2829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:38.673657 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:38.721617 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1117/2232] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:36:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:36:38.741159 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1d9b6-5986-4422-9db8-046d7057b816 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:38.743286 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6ef1d9b6-5986-4422-9db8-046d7057b816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:38.825190 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1d9b6-5986-4422-9db8-046d7057b816 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:38.829704 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20475916-0cb8-4c82-bd32-8fda78af8e65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:38.830491 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20475916-0cb8-4c82-bd32-8fda78af8e65 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:38.830857 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20475916-0cb8-4c82-bd32-8fda78af8e65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:38.831344 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20475916-0cb8-4c82-bd32-8fda78af8e65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:38.844827 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20475916-0cb8-4c82-bd32-8fda78af8e65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:38.846689 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20475916-0cb8-4c82-bd32-8fda78af8e65 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:38.871759 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1116/2233] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:36:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:36:39.240885 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f7cdda-2d28-4b75-bcff-9a2102ee2829 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:39.243276 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-79f7cdda-2d28-4b75-bcff-9a2102ee2829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:39.273277 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47f306-78b4-48b3-a4da-0551f8e8e0e2 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:39.273827 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47f306-78b4-48b3-a4da-0551f8e8e0e2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:39.274588 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47f306-78b4-48b3-a4da-0551f8e8e0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:39.275844 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f7cdda-2d28-4b75-bcff-9a2102ee2829 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:39.281803 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1789e866-7eca-45f5-bfa9-f81091d10751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:39.283535 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789e866-7eca-45f5-bfa9-f81091d10751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:39.284272 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789e866-7eca-45f5-bfa9-f81091d10751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:39.284640 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789e866-7eca-45f5-bfa9-f81091d10751 admin admin] PATH_INFO: `/v3/users/2d5dd127ef0b453cb083cd7b15120ce6` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:39.286278 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1789e866-7eca-45f5-bfa9-f81091d10751 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d5dd127ef0b453cb083cd7b15120ce6)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:39.289854 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1789e866-7eca-45f5-bfa9-f81091d10751 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:39.315284 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-ff47f306-78b4-48b3-a4da-0551f8e8e0e2 None None] MFA Rules not processed for user `bdba02b8e51c463b9ba36e0ff7cccdc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:39.316943 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ff47f306-78b4-48b3-a4da-0551f8e8e0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:39.413279 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-1789e866-7eca-45f5-bfa9-f81091d10751 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d5dd127ef0b453cb083cd7b15120ce6'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:39.414306 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-1789e866-7eca-45f5-bfa9-f81091d10751 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d5dd127ef0b453cb083cd7b15120ce6'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:39.415118 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-1789e866-7eca-45f5-bfa9-f81091d10751 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d5dd127ef0b453cb083cd7b15120ce6'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:39.432600 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1117/2234] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:36:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:36:39.433639 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47f306-78b4-48b3-a4da-0551f8e8e0e2 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:39.435021 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ff47f306-78b4-48b3-a4da-0551f8e8e0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:39.443973 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-1789e866-7eca-45f5-bfa9-f81091d10751 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d5dd127ef0b453cb083cd7b15120ce6'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:39.464635 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-1789e866-7eca-45f5-bfa9-f81091d10751 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d5dd127ef0b453cb083cd7b15120ce6'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:39.471900 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47f306-78b4-48b3-a4da-0551f8e8e0e2 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:39.486403 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c8e0b6-3cc9-4716-9328-79eccabd482f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:39.487061 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8e0b6-3cc9-4716-9328-79eccabd482f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:39.487341 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8e0b6-3cc9-4716-9328-79eccabd482f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:39.487617 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8e0b6-3cc9-4716-9328-79eccabd482f admin admin] PATH_INFO: `/v3/projects/7c4668aff4344bd69cb8ef7bb405915e` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:39.488690 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1118/2235] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:36:39 2022] DELETE /identity/v3/users/2d5dd127ef0b453cb083cd7b15120ce6 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:36:39.495517 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ceba79-02f9-43d5-8df6-d5a5236330a8 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:39.496230 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c8e0b6-3cc9-4716-9328-79eccabd482f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c4668aff4344bd69cb8ef7bb405915e)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:39.496958 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ceba79-02f9-43d5-8df6-d5a5236330a8 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:39.497244 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ceba79-02f9-43d5-8df6-d5a5236330a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:39.500914 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c8e0b6-3cc9-4716-9328-79eccabd482f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:39.578066 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-82c8e0b6-3cc9-4716-9328-79eccabd482f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c4668aff4344bd69cb8ef7bb405915e', 'request_id': 'req-82c8e0b6-3cc9-4716-9328-79eccabd482f'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:39.587767 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-82c8e0b6-3cc9-4716-9328-79eccabd482f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c4668aff4344bd69cb8ef7bb405915e', 'request_id': 'req-82c8e0b6-3cc9-4716-9328-79eccabd482f'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:39.590459 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-59ceba79-02f9-43d5-8df6-d5a5236330a8 None None] MFA Rules not processed for user `512b4337083145f9ae57948a63444ced`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:39.591815 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-59ceba79-02f9-43d5-8df6-d5a5236330a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:39.601261 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-82c8e0b6-3cc9-4716-9328-79eccabd482f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c4668aff4344bd69cb8ef7bb405915e', 'request_id': 'req-82c8e0b6-3cc9-4716-9328-79eccabd482f'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:39.627287 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-82c8e0b6-3cc9-4716-9328-79eccabd482f admin admin] The token cache is being invalidate because project 7c4668aff4344bd69cb8ef7bb405915e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:36:39.627580 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-82c8e0b6-3cc9-4716-9328-79eccabd482f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:39.630227 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-82c8e0b6-3cc9-4716-9328-79eccabd482f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:39.633414 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1118/2236] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:36:39 2022] DELETE /identity/v3/projects/7c4668aff4344bd69cb8ef7bb405915e => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:36:39.637896 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a7699-57a6-4e85-b7c9-b2087a9c029c None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:39.638554 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a7699-57a6-4e85-b7c9-b2087a9c029c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:39.639142 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a7699-57a6-4e85-b7c9-b2087a9c029c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:39.689287 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-e30a7699-57a6-4e85-b7c9-b2087a9c029c None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:39.694589 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e30a7699-57a6-4e85-b7c9-b2087a9c029c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:39.767991 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:39.793958 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1119/2237] 10.222.0.16 () {58 vars in 1009 bytes} [Thu May 26 12:36:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:36:39.795068 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ceba79-02f9-43d5-8df6-d5a5236330a8 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:39.797184 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-59ceba79-02f9-43d5-8df6-d5a5236330a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:39.927416 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1119/2238] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:36:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:36:39.932453 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:39.941170 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a7699-57a6-4e85-b7c9-b2087a9c029c None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:39.945278 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e30a7699-57a6-4e85-b7c9-b2087a9c029c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:39.996094 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ceba79-02f9-43d5-8df6-d5a5236330a8 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:40.005687 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e8520e-5b1d-4476-bdb6-bfdd0f91351e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02767dcbd1574e08a9e82a775ac2b289', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:40.007061 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8520e-5b1d-4476-bdb6-bfdd0f91351e service swift] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:40.008649 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8520e-5b1d-4476-bdb6-bfdd0f91351e service swift] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:40.023409 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8520e-5b1d-4476-bdb6-bfdd0f91351e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:40.051548 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e8520e-5b1d-4476-bdb6-bfdd0f91351e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:40.057461 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e8520e-5b1d-4476-bdb6-bfdd0f91351e service swift] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:40.058157 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a7699-57a6-4e85-b7c9-b2087a9c029c None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:40.064555 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415250d6-e276-4eb9-bb70-4b4d5a2a415d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:40.065411 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415250d6-e276-4eb9-bb70-4b4d5a2a415d service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:40.065769 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415250d6-e276-4eb9-bb70-4b4d5a2a415d service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:40.066319 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415250d6-e276-4eb9-bb70-4b4d5a2a415d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:40.071967 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1120/2239] 10.222.0.16 () {60 vars in 1384 bytes} [Thu May 26 12:36:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:36:40.094691 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415250d6-e276-4eb9-bb70-4b4d5a2a415d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:40.096913 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415250d6-e276-4eb9-bb70-4b4d5a2a415d service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:40.112556 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1120/2240] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:36:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:36:40.603629 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e8520e-5b1d-4476-bdb6-bfdd0f91351e service swift] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:40.605076 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-e4e8520e-5b1d-4476-bdb6-bfdd0f91351e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:40.622334 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e8520e-5b1d-4476-bdb6-bfdd0f91351e service swift] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:40.629247 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8edc0b9-7c72-4f8f-901f-625aca1b942f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:40.630124 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8edc0b9-7c72-4f8f-901f-625aca1b942f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:40.630404 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8edc0b9-7c72-4f8f-901f-625aca1b942f admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:40.630676 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8edc0b9-7c72-4f8f-901f-625aca1b942f admin admin] PATH_INFO: `/v3/projects/1dcee0d352204af2affd56b2c625c87f` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:40.631978 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8edc0b9-7c72-4f8f-901f-625aca1b942f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dcee0d352204af2affd56b2c625c87f)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:40.633983 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8edc0b9-7c72-4f8f-901f-625aca1b942f admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:40.690560 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-f8edc0b9-7c72-4f8f-901f-625aca1b942f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dcee0d352204af2affd56b2c625c87f', 'request_id': 'req-f8edc0b9-7c72-4f8f-901f-625aca1b942f'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:40.700167 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-f8edc0b9-7c72-4f8f-901f-625aca1b942f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dcee0d352204af2affd56b2c625c87f', 'request_id': 'req-f8edc0b9-7c72-4f8f-901f-625aca1b942f'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:40.707952 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-f8edc0b9-7c72-4f8f-901f-625aca1b942f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dcee0d352204af2affd56b2c625c87f', 'request_id': 'req-f8edc0b9-7c72-4f8f-901f-625aca1b942f'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:40.719527 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-f8edc0b9-7c72-4f8f-901f-625aca1b942f admin admin] The token cache is being invalidate because project 1dcee0d352204af2affd56b2c625c87f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:36:40.719910 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-f8edc0b9-7c72-4f8f-901f-625aca1b942f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:40.720643 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-f8edc0b9-7c72-4f8f-901f-625aca1b942f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:40.722604 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1121/2241] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:36:40 2022] DELETE /identity/v3/projects/1dcee0d352204af2affd56b2c625c87f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:36:50.104723 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=43 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:50.715765 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=39,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:37:14.430729 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c1bf0-f304-4d3b-a4c2-0687ca1d7f06 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:14.431269 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c1bf0-f304-4d3b-a4c2-0687ca1d7f06 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:14.431392 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c1bf0-f304-4d3b-a4c2-0687ca1d7f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:14.448809 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-da3c1bf0-f304-4d3b-a4c2-0687ca1d7f06 None None] MFA Rules not processed for user `bd25ae73d8f943839c9682cc4503909d`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:37:14.450011 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-da3c1bf0-f304-4d3b-a4c2-0687ca1d7f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:14.504026 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1121/2242] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:37:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:37:19.735262 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8edc0b9-7c72-4f8f-901f-625aca1b942f admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:37:19.738204 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-f8edc0b9-7c72-4f8f-901f-625aca1b942f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:19.833881 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8edc0b9-7c72-4f8f-901f-625aca1b942f admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:37:19.842670 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15ebc03-be08-4bcb-ace1-8d89cd6aee95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:37:19.843602 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ebc03-be08-4bcb-ace1-8d89cd6aee95 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:19.844050 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ebc03-be08-4bcb-ace1-8d89cd6aee95 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:19.844492 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ebc03-be08-4bcb-ace1-8d89cd6aee95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:19.846812 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-d15ebc03-be08-4bcb-ace1-8d89cd6aee95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:19.931418 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15ebc03-be08-4bcb-ace1-8d89cd6aee95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:37:19.933312 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15ebc03-be08-4bcb-ace1-8d89cd6aee95 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:37:19.945922 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1122/2243] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:37:19 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:37:24.496631 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=25 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:37:27.692264 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3c1bf0-f304-4d3b-a4c2-0687ca1d7f06 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:37:27.703253 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3c1bf0-f304-4d3b-a4c2-0687ca1d7f06 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:37:27.707700 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7d3131-0076-40d7-9d44-d2e11f9ded70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:37:27.708460 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d3131-0076-40d7-9d44-d2e11f9ded70 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:27.708865 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d3131-0076-40d7-9d44-d2e11f9ded70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:27.709251 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d3131-0076-40d7-9d44-d2e11f9ded70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:27.711709 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-de7d3131-0076-40d7-9d44-d2e11f9ded70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:27.796975 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7d3131-0076-40d7-9d44-d2e11f9ded70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:37:27.798794 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7d3131-0076-40d7-9d44-d2e11f9ded70 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:37:27.810848 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1122/2244] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:37:27 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:37:29.941103 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=50 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:37:37.805407 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=30 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:37:57.131610 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567d24e-5beb-45cc-bc63-c0cc45245e5b None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:57.132156 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567d24e-5beb-45cc-bc63-c0cc45245e5b None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:57.132156 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567d24e-5beb-45cc-bc63-c0cc45245e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:57.179814 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-e567d24e-5beb-45cc-bc63-c0cc45245e5b None None] MFA Rules not processed for user `512b4337083145f9ae57948a63444ced`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:37:57.181060 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-e567d24e-5beb-45cc-bc63-c0cc45245e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:57.250029 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1123/2245] 10.222.0.16 () {58 vars in 1009 bytes} [Thu May 26 12:37:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:37:57.290237 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7d3131-0076-40d7-9d44-d2e11f9ded70 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:37:57.291680 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-de7d3131-0076-40d7-9d44-d2e11f9ded70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:57.383392 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7d3131-0076-40d7-9d44-d2e11f9ded70 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:37:57.388481 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fafd37c-7c39-4760-8a8b-e7fb4d56e851 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02767dcbd1574e08a9e82a775ac2b289', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:37:57.389161 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fafd37c-7c39-4760-8a8b-e7fb4d56e851 service swift] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:57.389451 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fafd37c-7c39-4760-8a8b-e7fb4d56e851 service swift] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:57.389729 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fafd37c-7c39-4760-8a8b-e7fb4d56e851 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:57.398930 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fafd37c-7c39-4760-8a8b-e7fb4d56e851 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:37:57.400526 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fafd37c-7c39-4760-8a8b-e7fb4d56e851 service swift] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:37:57.408793 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1123/2246] 10.222.0.16 () {60 vars in 1384 bytes} [Thu May 26 12:37:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:38:07.247042 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=43 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:07.405469 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=41 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:10.244416 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8da760-9eee-49ad-93d2-8e79c1d3094c None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:10.244912 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8da760-9eee-49ad-93d2-8e79c1d3094c None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:10.245029 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8da760-9eee-49ad-93d2-8e79c1d3094c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:10.262177 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-ce8da760-9eee-49ad-93d2-8e79c1d3094c None None] MFA Rules not processed for user `41661c29981b4667a1621e894e3f3d29`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:10.263367 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-ce8da760-9eee-49ad-93d2-8e79c1d3094c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:10.316460 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1124/2247] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:38:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:10.626436 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fafd37c-7c39-4760-8a8b-e7fb4d56e851 service swift] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:10.627835 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6fafd37c-7c39-4760-8a8b-e7fb4d56e851 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:10.719898 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fafd37c-7c39-4760-8a8b-e7fb4d56e851 service swift] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:10.726876 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f5f088-8779-491b-84ca-2bc186587746 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4327435c97834afeb7e6806ef02349a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:10.727912 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5f088-8779-491b-84ca-2bc186587746 service placement] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:10.728352 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5f088-8779-491b-84ca-2bc186587746 service placement] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:10.728781 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5f088-8779-491b-84ca-2bc186587746 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:10.731110 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-44f5f088-8779-491b-84ca-2bc186587746 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:10.750308 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f5f088-8779-491b-84ca-2bc186587746 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:10.750308 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f5f088-8779-491b-84ca-2bc186587746 service placement] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:10.760578 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1124/2248] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:38:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:12.707268 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35739a72-47ef-4eeb-a320-4a5212976c42 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:12.707865 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35739a72-47ef-4eeb-a320-4a5212976c42 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:12.708885 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35739a72-47ef-4eeb-a320-4a5212976c42 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:12.710288 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1125/2249] 10.222.0.16 () {54 vars in 921 bytes} [Thu May 26 12:38:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:38:12.716695 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955bcb47-fd6a-4c3b-9318-178db9901d48 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:12.717227 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955bcb47-fd6a-4c3b-9318-178db9901d48 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:12.717335 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955bcb47-fd6a-4c3b-9318-178db9901d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:12.793503 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-955bcb47-fd6a-4c3b-9318-178db9901d48 None None] MFA Rules not processed for user `536f68ff77794352adf41aaacdc0645c`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:12.794743 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-955bcb47-fd6a-4c3b-9318-178db9901d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:12.888283 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1125/2250] 10.222.0.16 () {58 vars in 1018 bytes} [Thu May 26 12:38:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:12.901180 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35739a72-47ef-4eeb-a320-4a5212976c42 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:12.906077 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-35739a72-47ef-4eeb-a320-4a5212976c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:13.008285 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35739a72-47ef-4eeb-a320-4a5212976c42 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:13.012171 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96a0f1-b37e-4cee-9d1d-a58512a3ca32 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad8cfccd3a4d42d381ce62ea90849f19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:13.012851 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96a0f1-b37e-4cee-9d1d-a58512a3ca32 service glance] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:13.013208 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96a0f1-b37e-4cee-9d1d-a58512a3ca32 service glance] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:13.013487 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96a0f1-b37e-4cee-9d1d-a58512a3ca32 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:13.025140 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a96a0f1-b37e-4cee-9d1d-a58512a3ca32 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:13.026595 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a96a0f1-b37e-4cee-9d1d-a58512a3ca32 service glance] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:13.039367 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1126/2251] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:38:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:13.109516 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7691a-56d0-4356-931e-4c35c05d500c None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:13.109740 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7691a-56d0-4356-931e-4c35c05d500c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:13.110025 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7691a-56d0-4356-931e-4c35c05d500c None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:13.112246 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1126/2252] 10.222.0.16 () {54 vars in 921 bytes} [Thu May 26 12:38:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:38:13.118313 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb619ba6-960a-40c0-900c-ebe40be7497d None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:13.118600 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb619ba6-960a-40c0-900c-ebe40be7497d None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:13.118875 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb619ba6-960a-40c0-900c-ebe40be7497d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:13.144593 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-cb619ba6-960a-40c0-900c-ebe40be7497d None None] MFA Rules not processed for user `68033ffcafbc47bbadd008abd9e56c4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:13.147353 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-cb619ba6-960a-40c0-900c-ebe40be7497d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:13.156483 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1127/2253] 10.222.0.16 () {58 vars in 1018 bytes} [Thu May 26 12:38:13 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:13.169170 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a7691a-56d0-4356-931e-4c35c05d500c None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:13.180795 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a7691a-56d0-4356-931e-4c35c05d500c None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:13.185982 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b1da6-f679-4371-8300-dadb2566575f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:13.186637 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b1da6-f679-4371-8300-dadb2566575f service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:13.186926 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b1da6-f679-4371-8300-dadb2566575f service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:13.187205 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b1da6-f679-4371-8300-dadb2566575f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:13.195454 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b1da6-f679-4371-8300-dadb2566575f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:13.197068 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b1da6-f679-4371-8300-dadb2566575f service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:13.205363 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1127/2254] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:38:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:13.290716 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce80365-8982-4dd8-92b2-8b11a281b42f None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:13.290931 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce80365-8982-4dd8-92b2-8b11a281b42f None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:13.291289 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce80365-8982-4dd8-92b2-8b11a281b42f None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:13.292713 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1128/2255] 10.222.0.16 () {54 vars in 921 bytes} [Thu May 26 12:38:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:38:13.298370 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e4064-01af-44b1-9deb-8624bbca817d None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:13.298663 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e4064-01af-44b1-9deb-8624bbca817d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:13.298943 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e4064-01af-44b1-9deb-8624bbca817d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:13.318212 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:13.324390 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-ed0e4064-01af-44b1-9deb-8624bbca817d None None] MFA Rules not processed for user `536f68ff77794352adf41aaacdc0645c`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:13.325650 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ed0e4064-01af-44b1-9deb-8624bbca817d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:13.335703 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1128/2256] 10.222.0.16 () {58 vars in 1018 bytes} [Thu May 26 12:38:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:13.346412 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce80365-8982-4dd8-92b2-8b11a281b42f None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:13.358575 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce80365-8982-4dd8-92b2-8b11a281b42f None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:13.362237 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30bde69-9a06-4fa9-857a-024632a909cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:13.362942 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30bde69-9a06-4fa9-857a-024632a909cc service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:13.363288 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30bde69-9a06-4fa9-857a-024632a909cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:13.363624 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30bde69-9a06-4fa9-857a-024632a909cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:13.375262 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30bde69-9a06-4fa9-857a-024632a909cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:13.376773 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30bde69-9a06-4fa9-857a-024632a909cc service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:13.389283 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1129/2257] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:38:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:18.925667 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4573516-bd14-4c6e-8473-1c18b8092e14 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:18.926133 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4573516-bd14-4c6e-8473-1c18b8092e14 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:18.926210 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4573516-bd14-4c6e-8473-1c18b8092e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:18.944378 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a4573516-bd14-4c6e-8473-1c18b8092e14 None None] MFA Rules not processed for user `512b4337083145f9ae57948a63444ced`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:18.945654 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a4573516-bd14-4c6e-8473-1c18b8092e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:18.952868 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1129/2258] 10.222.0.16 () {58 vars in 1009 bytes} [Thu May 26 12:38:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:18.964778 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30bde69-9a06-4fa9-857a-024632a909cc service neutron] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:18.976437 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30bde69-9a06-4fa9-857a-024632a909cc service neutron] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:18.981452 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dbad66-1815-4085-8016-f4ef43673468 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02767dcbd1574e08a9e82a775ac2b289', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:18.982084 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbad66-1815-4085-8016-f4ef43673468 service swift] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:18.982369 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbad66-1815-4085-8016-f4ef43673468 service swift] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:18.982647 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbad66-1815-4085-8016-f4ef43673468 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:18.991947 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dbad66-1815-4085-8016-f4ef43673468 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:18.993593 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dbad66-1815-4085-8016-f4ef43673468 service swift] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:19.001878 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1130/2259] 10.222.0.16 () {60 vars in 1384 bytes} [Thu May 26 12:38:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 26 12:38:28.939051 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:28.998476 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=75 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:46.690126 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2637e0-1ac9-43df-83d5-af95cf6b4519 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:46.690633 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2637e0-1ac9-43df-83d5-af95cf6b4519 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:46.690741 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2637e0-1ac9-43df-83d5-af95cf6b4519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:46.708974 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-cf2637e0-1ac9-43df-83d5-af95cf6b4519 None None] MFA Rules not processed for user `512b4337083145f9ae57948a63444ced`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:46.710168 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-cf2637e0-1ac9-43df-83d5-af95cf6b4519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:46.717501 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1130/2260] 10.222.0.16 () {58 vars in 967 bytes} [Thu May 26 12:38:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:46.729772 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dbad66-1815-4085-8016-f4ef43673468 service swift] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:46.740018 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dbad66-1815-4085-8016-f4ef43673468 service swift] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:46.745234 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc8037-106f-4e77-989a-4636c377b25f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02767dcbd1574e08a9e82a775ac2b289', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:46.745862 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc8037-106f-4e77-989a-4636c377b25f service swift] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:46.746142 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc8037-106f-4e77-989a-4636c377b25f service swift] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:46.746400 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc8037-106f-4e77-989a-4636c377b25f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:46.755908 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fc8037-106f-4e77-989a-4636c377b25f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:46.757539 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fc8037-106f-4e77-989a-4636c377b25f service swift] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:46.765727 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1131/2261] 10.222.0.16 () {60 vars in 1384 bytes} [Thu May 26 12:38:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:38:56.703320 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:56.762413 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=6 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:42.484353 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2637e0-1ac9-43df-83d5-af95cf6b4519 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:42.494946 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2637e0-1ac9-43df-83d5-af95cf6b4519 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:42.499124 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ebe4c7-c3ab-4033-ac97-b762fc7206c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:42.499846 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebe4c7-c3ab-4033-ac97-b762fc7206c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:42.500161 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebe4c7-c3ab-4033-ac97-b762fc7206c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:42.500497 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebe4c7-c3ab-4033-ac97-b762fc7206c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:42.502587 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-11ebe4c7-c3ab-4033-ac97-b762fc7206c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:42.519335 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ebe4c7-c3ab-4033-ac97-b762fc7206c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:42.521077 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ebe4c7-c3ab-4033-ac97-b762fc7206c6 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:42.534154 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1131/2262] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:39:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:39:42.664387 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424d713-426e-4d2f-a04a-44d92b1f4799 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:42.664943 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424d713-426e-4d2f-a04a-44d92b1f4799 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:42.665046 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424d713-426e-4d2f-a04a-44d92b1f4799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:42.682275 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-5424d713-426e-4d2f-a04a-44d92b1f4799 None None] MFA Rules not processed for user `bd25ae73d8f943839c9682cc4503909d`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:42.683465 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-5424d713-426e-4d2f-a04a-44d92b1f4799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:42.695510 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1132/2263] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:39:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:45.335691 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ebe4c7-c3ab-4033-ac97-b762fc7206c6 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:45.337327 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-11ebe4c7-c3ab-4033-ac97-b762fc7206c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:45.347961 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ebe4c7-c3ab-4033-ac97-b762fc7206c6 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:45.351694 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83de5f7-f1d5-43be-b896-5879d5f704c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:45.352392 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83de5f7-f1d5-43be-b896-5879d5f704c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:45.352657 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83de5f7-f1d5-43be-b896-5879d5f704c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:45.352973 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83de5f7-f1d5-43be-b896-5879d5f704c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:45.354810 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e83de5f7-f1d5-43be-b896-5879d5f704c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:45.369163 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83de5f7-f1d5-43be-b896-5879d5f704c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:45.371171 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83de5f7-f1d5-43be-b896-5879d5f704c1 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:45.382386 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1132/2264] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:39:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:39:52.677247 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:55.377325 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=12 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:40:03.000000 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424d713-426e-4d2f-a04a-44d92b1f4799 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:03.001448 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-5424d713-426e-4d2f-a04a-44d92b1f4799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:03.017871 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424d713-426e-4d2f-a04a-44d92b1f4799 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:03.023332 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af1443-c82d-482d-b787-8c93666a4f5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536f68ff77794352adf41aaacdc0645c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:03.023968 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af1443-c82d-482d-b787-8c93666a4f5f service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:03.024276 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af1443-c82d-482d-b787-8c93666a4f5f service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:03.024582 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af1443-c82d-482d-b787-8c93666a4f5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:03.026324 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-37af1443-c82d-482d-b787-8c93666a4f5f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:03.083990 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af1443-c82d-482d-b787-8c93666a4f5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:03.085609 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af1443-c82d-482d-b787-8c93666a4f5f service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:03.094737 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1133/2265] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:40:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:40:04.984904 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4550d7-48d0-45b2-af92-0d025f0f9857 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:04.985444 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4550d7-48d0-45b2-af92-0d025f0f9857 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:04.985550 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4550d7-48d0-45b2-af92-0d025f0f9857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:05.002903 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-2e4550d7-48d0-45b2-af92-0d025f0f9857 None None] MFA Rules not processed for user `62ff83542a7c4c7982affdc3b882cdd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:40:05.004089 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2e4550d7-48d0-45b2-af92-0d025f0f9857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:05.011038 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1133/2266] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:40:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:40:05.614873 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af1443-c82d-482d-b787-8c93666a4f5f service nova] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:05.627596 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af1443-c82d-482d-b787-8c93666a4f5f service nova] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:05.632987 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa3de2-4abe-40fd-a8a3-883c4bafec12 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4327435c97834afeb7e6806ef02349a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:05.633637 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa3de2-4abe-40fd-a8a3-883c4bafec12 service placement] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:05.633919 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa3de2-4abe-40fd-a8a3-883c4bafec12 service placement] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:05.634194 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa3de2-4abe-40fd-a8a3-883c4bafec12 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:05.636057 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-ebaa3de2-4abe-40fd-a8a3-883c4bafec12 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:05.649293 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaa3de2-4abe-40fd-a8a3-883c4bafec12 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:05.650537 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaa3de2-4abe-40fd-a8a3-883c4bafec12 service placement] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:05.661151 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1134/2267] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:40:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:40:07.478070 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4550d7-48d0-45b2-af92-0d025f0f9857 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:07.488875 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4550d7-48d0-45b2-af92-0d025f0f9857 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:07.492485 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8ff2a1-e3f2-4c35-aee2-ca24d49016f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:07.493169 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ff2a1-e3f2-4c35-aee2-ca24d49016f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:07.493450 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ff2a1-e3f2-4c35-aee2-ca24d49016f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:07.493727 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ff2a1-e3f2-4c35-aee2-ca24d49016f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:07.495767 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5e8ff2a1-e3f2-4c35-aee2-ca24d49016f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:07.506795 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8ff2a1-e3f2-4c35-aee2-ca24d49016f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:07.508299 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8ff2a1-e3f2-4c35-aee2-ca24d49016f1 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:07.517616 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1134/2268] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:40:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:40:15.656759 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=34 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:40:17.513457 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=9 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:40:23.863524 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa3de2-4abe-40fd-a8a3-883c4bafec12 service placement] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:23.883239 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa3de2-4abe-40fd-a8a3-883c4bafec12 service placement] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:23.890973 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f777e7-4268-460e-94fc-204b8bc0b258 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536f68ff77794352adf41aaacdc0645c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:23.892081 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f777e7-4268-460e-94fc-204b8bc0b258 service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:23.892541 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f777e7-4268-460e-94fc-204b8bc0b258 service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:23.893008 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f777e7-4268-460e-94fc-204b8bc0b258 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:23.895595 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-65f777e7-4268-460e-94fc-204b8bc0b258 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:23.916404 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f777e7-4268-460e-94fc-204b8bc0b258 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:23.918544 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f777e7-4268-460e-94fc-204b8bc0b258 service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:23.938304 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1135/2269] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:40:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:40:25.868098 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8ff2a1-e3f2-4c35-aee2-ca24d49016f1 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:25.886840 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8ff2a1-e3f2-4c35-aee2-ca24d49016f1 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:25.893546 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08656f9-425a-4864-b017-c20e06eb0ec1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536f68ff77794352adf41aaacdc0645c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:25.894434 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08656f9-425a-4864-b017-c20e06eb0ec1 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:25.894890 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08656f9-425a-4864-b017-c20e06eb0ec1 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:25.895165 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08656f9-425a-4864-b017-c20e06eb0ec1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:25.897245 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f08656f9-425a-4864-b017-c20e06eb0ec1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:25.936262 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08656f9-425a-4864-b017-c20e06eb0ec1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:25.938246 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08656f9-425a-4864-b017-c20e06eb0ec1 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:25.968864 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1135/2270] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:40:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:40:28.904777 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f12358-e492-4bae-a4cd-71d349b21cff None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:28.905376 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f12358-e492-4bae-a4cd-71d349b21cff None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:28.905376 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f12358-e492-4bae-a4cd-71d349b21cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:28.924057 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-c7f12358-e492-4bae-a4cd-71d349b21cff None None] MFA Rules not processed for user `41661c29981b4667a1621e894e3f3d29`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:40:28.925273 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-c7f12358-e492-4bae-a4cd-71d349b21cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:28.933469 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1136/2271] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:40:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:40:29.235449 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08656f9-425a-4864-b017-c20e06eb0ec1 service nova] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:29.244606 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08656f9-425a-4864-b017-c20e06eb0ec1 service nova] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:29.248506 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7bb34d-f11f-4386-9455-a9392dd51b00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:29.249248 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7bb34d-f11f-4386-9455-a9392dd51b00 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:29.249535 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7bb34d-f11f-4386-9455-a9392dd51b00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:29.249808 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7bb34d-f11f-4386-9455-a9392dd51b00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:29.251657 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4a7bb34d-f11f-4386-9455-a9392dd51b00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:29.261616 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7bb34d-f11f-4386-9455-a9392dd51b00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:29.263047 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7bb34d-f11f-4386-9455-a9392dd51b00 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:29.270992 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1136/2272] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:40:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:40:33.396761 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e740c8-60a8-4976-9713-f397cfbe9d03 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:33.397285 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e740c8-60a8-4976-9713-f397cfbe9d03 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:33.397380 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e740c8-60a8-4976-9713-f397cfbe9d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:33.415004 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-30e740c8-60a8-4976-9713-f397cfbe9d03 None None] MFA Rules not processed for user `512b4337083145f9ae57948a63444ced`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:40:33.416127 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-30e740c8-60a8-4976-9713-f397cfbe9d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:33.423580 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1137/2273] 10.222.0.16 () {58 vars in 967 bytes} [Thu May 26 12:40:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:40:33.471830 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7bb34d-f11f-4386-9455-a9392dd51b00 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:33.484777 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7bb34d-f11f-4386-9455-a9392dd51b00 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:33.490250 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c50e5-e738-4770-820e-33797c267fb9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02767dcbd1574e08a9e82a775ac2b289', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:33.490644 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c50e5-e738-4770-820e-33797c267fb9 service swift] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:33.491022 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c50e5-e738-4770-820e-33797c267fb9 service swift] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:33.491366 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c50e5-e738-4770-820e-33797c267fb9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:33.500104 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7c50e5-e738-4770-820e-33797c267fb9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:33.501805 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7c50e5-e738-4770-820e-33797c267fb9 service swift] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:33.510354 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1137/2274] 10.222.0.16 () {60 vars in 1384 bytes} [Thu May 26 12:40:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:40:37.931795 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb0125-47ea-49ca-bc63-3d008ded9415 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:37.932322 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb0125-47ea-49ca-bc63-3d008ded9415 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:37.932429 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb0125-47ea-49ca-bc63-3d008ded9415 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:37.933847 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1138/2275] 10.222.0.16 () {54 vars in 921 bytes} [Thu May 26 12:40:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:40:37.943253 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0d0d5-48a4-4b26-9640-d0e65e5b752b None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:37.943790 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0d0d5-48a4-4b26-9640-d0e65e5b752b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:37.944114 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0d0d5-48a4-4b26-9640-d0e65e5b752b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:37.982540 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-65e0d0d5-48a4-4b26-9640-d0e65e5b752b None None] MFA Rules not processed for user `4327435c97834afeb7e6806ef02349a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:40:37.983977 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-65e0d0d5-48a4-4b26-9640-d0e65e5b752b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:37.994084 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1138/2276] 10.222.0.16 () {58 vars in 1018 bytes} [Thu May 26 12:40:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:40:38.015413 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fb0125-47ea-49ca-bc63-3d008ded9415 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:38.017659 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-45fb0125-47ea-49ca-bc63-3d008ded9415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:38.040658 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fb0125-47ea-49ca-bc63-3d008ded9415 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:38.045791 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d513a1-aa09-4a5d-a4d9-d980a0081b13 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4327435c97834afeb7e6806ef02349a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:38.046434 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d513a1-aa09-4a5d-a4d9-d980a0081b13 service placement] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:38.046711 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d513a1-aa09-4a5d-a4d9-d980a0081b13 service placement] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:38.047151 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d513a1-aa09-4a5d-a4d9-d980a0081b13 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:38.056764 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d513a1-aa09-4a5d-a4d9-d980a0081b13 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:38.058608 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d513a1-aa09-4a5d-a4d9-d980a0081b13 service placement] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:38.074617 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1139/2277] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:40:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:40:39.074006 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e0d0d5-48a4-4b26-9640-d0e65e5b752b None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:39.075532 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-65e0d0d5-48a4-4b26-9640-d0e65e5b752b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:39.092743 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e0d0d5-48a4-4b26-9640-d0e65e5b752b None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:39.099147 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195a970c-114e-4f6c-9d17-247a204fa199 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536f68ff77794352adf41aaacdc0645c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:39.099954 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a970c-114e-4f6c-9d17-247a204fa199 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:39.100332 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a970c-114e-4f6c-9d17-247a204fa199 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:39.100681 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a970c-114e-4f6c-9d17-247a204fa199 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:39.103291 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-195a970c-114e-4f6c-9d17-247a204fa199 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:39.119109 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195a970c-114e-4f6c-9d17-247a204fa199 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:39.120876 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195a970c-114e-4f6c-9d17-247a204fa199 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:39.135478 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1139/2278] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:40:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:40:39.223290 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d513a1-aa09-4a5d-a4d9-d980a0081b13 service placement] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:39.224789 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-44d513a1-aa09-4a5d-a4d9-d980a0081b13 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:39.339877 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d513a1-aa09-4a5d-a4d9-d980a0081b13 service placement] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:39.345543 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f9e73a-ae33-4e9c-8ff2-18c902ae078d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:39.346943 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9e73a-ae33-4e9c-8ff2-18c902ae078d service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:39.347486 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9e73a-ae33-4e9c-8ff2-18c902ae078d service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:39.348030 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9e73a-ae33-4e9c-8ff2-18c902ae078d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:39.350824 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-26f9e73a-ae33-4e9c-8ff2-18c902ae078d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:39.451063 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f9e73a-ae33-4e9c-8ff2-18c902ae078d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:39.454249 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f9e73a-ae33-4e9c-8ff2-18c902ae078d service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:39.466669 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1140/2279] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:40:39 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:40:40.178928 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c87430-5063-48d6-b55b-a3beb2810a02 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:40.179954 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c87430-5063-48d6-b55b-a3beb2810a02 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:40.180239 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c87430-5063-48d6-b55b-a3beb2810a02 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:40.181809 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1140/2280] 10.222.0.16 () {54 vars in 921 bytes} [Thu May 26 12:40:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:40:40.194076 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c03657-1771-40fa-a8ba-1b50d756b1a9 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:40.194369 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c03657-1771-40fa-a8ba-1b50d756b1a9 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:40.194653 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c03657-1771-40fa-a8ba-1b50d756b1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:40.216737 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-f8c03657-1771-40fa-a8ba-1b50d756b1a9 None None] MFA Rules not processed for user `68033ffcafbc47bbadd008abd9e56c4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:40:40.217990 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-f8c03657-1771-40fa-a8ba-1b50d756b1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:40.230824 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1141/2281] 10.222.0.16 () {58 vars in 1018 bytes} [Thu May 26 12:40:40 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:40:40.248615 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c87430-5063-48d6-b55b-a3beb2810a02 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:40.262086 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c87430-5063-48d6-b55b-a3beb2810a02 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:40.266274 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed8af8-c732-426c-aad6-bdf5ee005f91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:40.267089 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed8af8-c732-426c-aad6-bdf5ee005f91 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:40.267599 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed8af8-c732-426c-aad6-bdf5ee005f91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:40.267857 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed8af8-c732-426c-aad6-bdf5ee005f91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:40.276134 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eed8af8-c732-426c-aad6-bdf5ee005f91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:40.277693 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eed8af8-c732-426c-aad6-bdf5ee005f91 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:40.285779 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1141/2282] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:40:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:40:40.368308 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803d53f-5cf8-4bf0-9886-898bc538c820 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:40.368596 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803d53f-5cf8-4bf0-9886-898bc538c820 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:40.368926 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803d53f-5cf8-4bf0-9886-898bc538c820 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:40.370310 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1142/2283] 10.222.0.16 () {54 vars in 921 bytes} [Thu May 26 12:40:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:40:40.376374 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb18f0-ee3f-48b6-994e-2b8dc9a3ac65 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:40.376734 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb18f0-ee3f-48b6-994e-2b8dc9a3ac65 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:40.377111 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb18f0-ee3f-48b6-994e-2b8dc9a3ac65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:40.396733 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c1eb18f0-ee3f-48b6-994e-2b8dc9a3ac65 None None] MFA Rules not processed for user `536f68ff77794352adf41aaacdc0645c`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:40:40.397790 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c1eb18f0-ee3f-48b6-994e-2b8dc9a3ac65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:40.408756 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1142/2284] 10.222.0.16 () {58 vars in 1018 bytes} [Thu May 26 12:40:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:40:40.420626 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803d53f-5cf8-4bf0-9886-898bc538c820 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:40.432279 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803d53f-5cf8-4bf0-9886-898bc538c820 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:40.436320 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e80e69-ea79-40cf-ba6a-b8c8f89f4701 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:40.437119 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e80e69-ea79-40cf-ba6a-b8c8f89f4701 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:40.437584 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e80e69-ea79-40cf-ba6a-b8c8f89f4701 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:40.437851 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e80e69-ea79-40cf-ba6a-b8c8f89f4701 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:40.449426 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e80e69-ea79-40cf-ba6a-b8c8f89f4701 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:40.450869 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e80e69-ea79-40cf-ba6a-b8c8f89f4701 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:40.462893 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1143/2285] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:40:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:40:43.214220 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb18f0-ee3f-48b6-994e-2b8dc9a3ac65 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:43.215730 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c1eb18f0-ee3f-48b6-994e-2b8dc9a3ac65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:43.337565 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb18f0-ee3f-48b6-994e-2b8dc9a3ac65 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:43.344317 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc189d94-5071-4b2c-87e3-d887b548d336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:43.345311 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc189d94-5071-4b2c-87e3-d887b548d336 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:43.345807 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc189d94-5071-4b2c-87e3-d887b548d336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:43.346083 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc189d94-5071-4b2c-87e3-d887b548d336 admin admin] PATH_INFO: `/v3/users/5ee5df3ae35f4ab48c2085d488b5724d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:43.347630 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc189d94-5071-4b2c-87e3-d887b548d336 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ee5df3ae35f4ab48c2085d488b5724d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:43.349652 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc189d94-5071-4b2c-87e3-d887b548d336 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:43.410902 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fc189d94-5071-4b2c-87e3-d887b548d336 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ee5df3ae35f4ab48c2085d488b5724d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:43.420122 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fc189d94-5071-4b2c-87e3-d887b548d336 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ee5df3ae35f4ab48c2085d488b5724d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:43.421738 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fc189d94-5071-4b2c-87e3-d887b548d336 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ee5df3ae35f4ab48c2085d488b5724d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:43.422489 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fc189d94-5071-4b2c-87e3-d887b548d336 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ee5df3ae35f4ab48c2085d488b5724d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:43.432461 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fc189d94-5071-4b2c-87e3-d887b548d336 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ee5df3ae35f4ab48c2085d488b5724d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:43.438285 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:40:43.455067 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1143/2286] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:40:43 2022] DELETE /identity/v3/users/5ee5df3ae35f4ab48c2085d488b5724d => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:40:43.833778 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e80e69-ea79-40cf-ba6a-b8c8f89f4701 service neutron] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:43.860349 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e80e69-ea79-40cf-ba6a-b8c8f89f4701 service neutron] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:43.907071 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:40:43.941039 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66002331-617e-499f-a9df-db928e227cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:43.941920 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66002331-617e-499f-a9df-db928e227cb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:43.942196 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66002331-617e-499f-a9df-db928e227cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:43.942468 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66002331-617e-499f-a9df-db928e227cb7 admin admin] PATH_INFO: `/v3/projects/d8ec9eb97749472dac98cd4b6f540547` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:43.943814 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66002331-617e-499f-a9df-db928e227cb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8ec9eb97749472dac98cd4b6f540547)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:43.945968 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66002331-617e-499f-a9df-db928e227cb7 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:44.002286 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-66002331-617e-499f-a9df-db928e227cb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8ec9eb97749472dac98cd4b6f540547', 'request_id': 'req-66002331-617e-499f-a9df-db928e227cb7'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:44.010323 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-66002331-617e-499f-a9df-db928e227cb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8ec9eb97749472dac98cd4b6f540547', 'request_id': 'req-66002331-617e-499f-a9df-db928e227cb7'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:44.017079 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-66002331-617e-499f-a9df-db928e227cb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8ec9eb97749472dac98cd4b6f540547', 'request_id': 'req-66002331-617e-499f-a9df-db928e227cb7'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:44.028689 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-66002331-617e-499f-a9df-db928e227cb7 admin admin] The token cache is being invalidate because project d8ec9eb97749472dac98cd4b6f540547 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:40:44.029187 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-66002331-617e-499f-a9df-db928e227cb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:44.029911 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-66002331-617e-499f-a9df-db928e227cb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:44.031492 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1144/2287] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:40:43 2022] DELETE /identity/v3/projects/d8ec9eb97749472dac98cd4b6f540547 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:40:44.035485 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc189d94-5071-4b2c-87e3-d887b548d336 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:44.037480 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-fc189d94-5071-4b2c-87e3-d887b548d336 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:44.051904 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc189d94-5071-4b2c-87e3-d887b548d336 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:44.111506 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32791fb1-a3c0-4bde-a38f-9ea761fee11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:44.112514 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32791fb1-a3c0-4bde-a38f-9ea761fee11b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:44.112887 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32791fb1-a3c0-4bde-a38f-9ea761fee11b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:44.113235 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32791fb1-a3c0-4bde-a38f-9ea761fee11b admin admin] PATH_INFO: `/v3/users/6b2fb8e48ba942ab91cc5e5bfa3fa2db` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:44.114499 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32791fb1-a3c0-4bde-a38f-9ea761fee11b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b2fb8e48ba942ab91cc5e5bfa3fa2db)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:44.116451 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32791fb1-a3c0-4bde-a38f-9ea761fee11b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:44.179281 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-32791fb1-a3c0-4bde-a38f-9ea761fee11b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b2fb8e48ba942ab91cc5e5bfa3fa2db'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:44.202333 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-32791fb1-a3c0-4bde-a38f-9ea761fee11b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b2fb8e48ba942ab91cc5e5bfa3fa2db'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:44.202955 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-32791fb1-a3c0-4bde-a38f-9ea761fee11b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b2fb8e48ba942ab91cc5e5bfa3fa2db'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:44.203737 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-32791fb1-a3c0-4bde-a38f-9ea761fee11b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b2fb8e48ba942ab91cc5e5bfa3fa2db'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:44.215254 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-32791fb1-a3c0-4bde-a38f-9ea761fee11b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b2fb8e48ba942ab91cc5e5bfa3fa2db'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:44.244462 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1144/2288] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:40:44 2022] DELETE /identity/v3/users/6b2fb8e48ba942ab91cc5e5bfa3fa2db => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:40:45.208745 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66002331-617e-499f-a9df-db928e227cb7 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:45.210291 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-66002331-617e-499f-a9df-db928e227cb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:45.227524 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66002331-617e-499f-a9df-db928e227cb7 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:45.308422 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b3560-6284-4d97-bb59-5dc43409b0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:45.309479 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b3560-6284-4d97-bb59-5dc43409b0f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:45.310069 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b3560-6284-4d97-bb59-5dc43409b0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:45.310326 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b3560-6284-4d97-bb59-5dc43409b0f5 admin admin] PATH_INFO: `/v3/projects/4cc1296236294831b6a530ff7a478651` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:45.311686 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4b3560-6284-4d97-bb59-5dc43409b0f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cc1296236294831b6a530ff7a478651)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:45.315546 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4b3560-6284-4d97-bb59-5dc43409b0f5 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:45.376069 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-1d4b3560-6284-4d97-bb59-5dc43409b0f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cc1296236294831b6a530ff7a478651', 'request_id': 'req-1d4b3560-6284-4d97-bb59-5dc43409b0f5'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:45.384296 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-1d4b3560-6284-4d97-bb59-5dc43409b0f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cc1296236294831b6a530ff7a478651', 'request_id': 'req-1d4b3560-6284-4d97-bb59-5dc43409b0f5'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:45.392438 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-1d4b3560-6284-4d97-bb59-5dc43409b0f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cc1296236294831b6a530ff7a478651', 'request_id': 'req-1d4b3560-6284-4d97-bb59-5dc43409b0f5'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:45.400246 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:40:45.410436 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-1d4b3560-6284-4d97-bb59-5dc43409b0f5 admin admin] The token cache is being invalidate because project 4cc1296236294831b6a530ff7a478651 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:40:45.410740 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-1d4b3560-6284-4d97-bb59-5dc43409b0f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:45.412212 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-1d4b3560-6284-4d97-bb59-5dc43409b0f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:45.414765 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1145/2289] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:40:45 2022] DELETE /identity/v3/projects/4cc1296236294831b6a530ff7a478651 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:40:50.291802 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5af81-d2b9-433c-be42-c22d8625ed16 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:50.292457 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5af81-d2b9-433c-be42-c22d8625ed16 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:50.292457 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5af81-d2b9-433c-be42-c22d8625ed16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:50.310904 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c8d5af81-d2b9-433c-be42-c22d8625ed16 None None] MFA Rules not processed for user `ae9585c4fe0c4d0eb1a820c9dc096a89`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:40:50.312094 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c8d5af81-d2b9-433c-be42-c22d8625ed16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:50.370340 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1145/2290] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:40:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:40:54.301018 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b3560-6284-4d97-bb59-5dc43409b0f5 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:54.303062 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-1d4b3560-6284-4d97-bb59-5dc43409b0f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:54.390298 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b3560-6284-4d97-bb59-5dc43409b0f5 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:54.395336 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0a0f69-9818-4976-b20c-27d041701640 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:54.396031 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a0f69-9818-4976-b20c-27d041701640 service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:54.396455 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a0f69-9818-4976-b20c-27d041701640 service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:54.396815 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a0f69-9818-4976-b20c-27d041701640 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:54.399374 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-be0a0f69-9818-4976-b20c-27d041701640 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:54.490873 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0a0f69-9818-4976-b20c-27d041701640 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:54.492122 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0a0f69-9818-4976-b20c-27d041701640 service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:54.506136 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1146/2291] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:40:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:41:00.363105 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=83,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:04.501430 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=50 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:15.955983 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d5af81-d2b9-433c-be42-c22d8625ed16 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:15.957435 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c8d5af81-d2b9-433c-be42-c22d8625ed16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:16.016923 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d5af81-d2b9-433c-be42-c22d8625ed16 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:16.020573 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f224d-8a1f-4cde-b38f-bab16092ce44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:16.021246 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f224d-8a1f-4cde-b38f-bab16092ce44 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:16.021533 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f224d-8a1f-4cde-b38f-bab16092ce44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:16.021833 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f224d-8a1f-4cde-b38f-bab16092ce44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:16.023784 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-946f224d-8a1f-4cde-b38f-bab16092ce44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:16.092029 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946f224d-8a1f-4cde-b38f-bab16092ce44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:16.093529 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946f224d-8a1f-4cde-b38f-bab16092ce44 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:16.104160 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1146/2292] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:41:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:41:19.168424 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0a0f69-9818-4976-b20c-27d041701640 service cinder] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:19.170404 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-be0a0f69-9818-4976-b20c-27d041701640 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:19.224274 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f224d-8a1f-4cde-b38f-bab16092ce44 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:19.225897 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-946f224d-8a1f-4cde-b38f-bab16092ce44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:19.243618 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f224d-8a1f-4cde-b38f-bab16092ce44 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:19.249361 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325030a1-ec49-47d8-87b7-6b14472173e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:19.250285 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325030a1-ec49-47d8-87b7-6b14472173e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:19.250534 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325030a1-ec49-47d8-87b7-6b14472173e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:19.250843 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325030a1-ec49-47d8-87b7-6b14472173e6 admin admin] PATH_INFO: `/v3/users/bd25ae73d8f943839c9682cc4503909d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:19.252127 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325030a1-ec49-47d8-87b7-6b14472173e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd25ae73d8f943839c9682cc4503909d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:19.254165 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325030a1-ec49-47d8-87b7-6b14472173e6 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:19.289699 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0a0f69-9818-4976-b20c-27d041701640 service cinder] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:19.295667 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b606449a-de3d-4f09-a4b8-f8aeea41f5ec service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4327435c97834afeb7e6806ef02349a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:19.296350 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b606449a-de3d-4f09-a4b8-f8aeea41f5ec service placement] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:19.296674 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b606449a-de3d-4f09-a4b8-f8aeea41f5ec service placement] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:19.297020 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b606449a-de3d-4f09-a4b8-f8aeea41f5ec service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:19.298851 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-b606449a-de3d-4f09-a4b8-f8aeea41f5ec service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:19.315049 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-325030a1-ec49-47d8-87b7-6b14472173e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd25ae73d8f943839c9682cc4503909d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:19.315697 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b606449a-de3d-4f09-a4b8-f8aeea41f5ec service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:19.317492 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b606449a-de3d-4f09-a4b8-f8aeea41f5ec service placement] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:19.323821 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-325030a1-ec49-47d8-87b7-6b14472173e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd25ae73d8f943839c9682cc4503909d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:19.324639 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-325030a1-ec49-47d8-87b7-6b14472173e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd25ae73d8f943839c9682cc4503909d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:19.325380 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-325030a1-ec49-47d8-87b7-6b14472173e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd25ae73d8f943839c9682cc4503909d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:19.329222 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1147/2293] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:41:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:41:19.334315 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-325030a1-ec49-47d8-87b7-6b14472173e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd25ae73d8f943839c9682cc4503909d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:19.353396 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1147/2294] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:41:19 2022] DELETE /identity/v3/users/bd25ae73d8f943839c9682cc4503909d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:41:19.534319 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b606449a-de3d-4f09-a4b8-f8aeea41f5ec service placement] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:19.555912 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b606449a-de3d-4f09-a4b8-f8aeea41f5ec service placement] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:19.621357 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb07a9c-945d-42f3-9530-40deef300e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:19.622220 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb07a9c-945d-42f3-9530-40deef300e6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:19.622502 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb07a9c-945d-42f3-9530-40deef300e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:19.622777 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb07a9c-945d-42f3-9530-40deef300e6f admin admin] PATH_INFO: `/v3/projects/5463c05f534944d1bca996652c4fcadb` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:19.624221 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb07a9c-945d-42f3-9530-40deef300e6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5463c05f534944d1bca996652c4fcadb)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:19.626192 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb07a9c-945d-42f3-9530-40deef300e6f admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:19.671826 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-6fb07a9c-945d-42f3-9530-40deef300e6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5463c05f534944d1bca996652c4fcadb', 'request_id': 'req-6fb07a9c-945d-42f3-9530-40deef300e6f'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:19.679754 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-6fb07a9c-945d-42f3-9530-40deef300e6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5463c05f534944d1bca996652c4fcadb', 'request_id': 'req-6fb07a9c-945d-42f3-9530-40deef300e6f'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:19.686003 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-6fb07a9c-945d-42f3-9530-40deef300e6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5463c05f534944d1bca996652c4fcadb', 'request_id': 'req-6fb07a9c-945d-42f3-9530-40deef300e6f'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:19.696719 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-6fb07a9c-945d-42f3-9530-40deef300e6f admin admin] The token cache is being invalidate because project 5463c05f534944d1bca996652c4fcadb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:41:19.697032 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-6fb07a9c-945d-42f3-9530-40deef300e6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:19.697665 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-6fb07a9c-945d-42f3-9530-40deef300e6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:19.699182 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1148/2295] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:41:19 2022] DELETE /identity/v3/projects/5463c05f534944d1bca996652c4fcadb => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:19.704324 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d953e7-de91-4ca1-aadf-3d115732a5f2 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:19.704641 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d953e7-de91-4ca1-aadf-3d115732a5f2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:19.704955 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d953e7-de91-4ca1-aadf-3d115732a5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:19.723139 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d3d953e7-de91-4ca1-aadf-3d115732a5f2 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:19.724330 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d3d953e7-de91-4ca1-aadf-3d115732a5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:19.740725 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:19.787380 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1148/2296] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:41:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:41:19.795096 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1990d-1511-4d40-bdb1-36c490775643 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:19.795378 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1990d-1511-4d40-bdb1-36c490775643 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:19.795652 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1990d-1511-4d40-bdb1-36c490775643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:19.814929 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-7bc1990d-1511-4d40-bdb1-36c490775643 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:19.816216 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-7bc1990d-1511-4d40-bdb1-36c490775643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:19.824757 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1149/2297] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:41:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:19.828978 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d953e7-de91-4ca1-aadf-3d115732a5f2 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:19.838581 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d953e7-de91-4ca1-aadf-3d115732a5f2 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:19.843166 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b0856d-9e27-4462-838a-d2d2daf75a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:19.843822 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0856d-9e27-4462-838a-d2d2daf75a90 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:19.844101 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0856d-9e27-4462-838a-d2d2daf75a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:19.844373 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0856d-9e27-4462-838a-d2d2daf75a90 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:19.845136 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b0856d-9e27-4462-838a-d2d2daf75a90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:41:19.845440 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b0856d-9e27-4462-838a-d2d2daf75a90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:19.847076 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b0856d-9e27-4462-838a-d2d2daf75a90 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:19.858948 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1149/2298] 10.222.0.16 () {58 vars in 1152 bytes} [Thu May 26 12:41:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:41:19.863351 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1990d-1511-4d40-bdb1-36c490775643 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:19.873942 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1990d-1511-4d40-bdb1-36c490775643 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:19.878867 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637207d1-dc85-4aa4-9970-fb9b38c0061a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:19.879523 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637207d1-dc85-4aa4-9970-fb9b38c0061a admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:19.879803 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637207d1-dc85-4aa4-9970-fb9b38c0061a admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:19.880080 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637207d1-dc85-4aa4-9970-fb9b38c0061a admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:19.880780 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637207d1-dc85-4aa4-9970-fb9b38c0061a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:19.882747 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637207d1-dc85-4aa4-9970-fb9b38c0061a admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:19.893545 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:19.923741 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1150/2299] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:41:19 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:41:19.928691 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b0856d-9e27-4462-838a-d2d2daf75a90 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:19.941419 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b0856d-9e27-4462-838a-d2d2daf75a90 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:20.008826 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce75fa-7d3c-49d8-b3b0-c22aa71a0efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:20.009538 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce75fa-7d3c-49d8-b3b0-c22aa71a0efa admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:20.009826 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce75fa-7d3c-49d8-b3b0-c22aa71a0efa admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:20.010104 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce75fa-7d3c-49d8-b3b0-c22aa71a0efa admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:20.010793 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ce75fa-7d3c-49d8-b3b0-c22aa71a0efa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:20.012741 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ce75fa-7d3c-49d8-b3b0-c22aa71a0efa admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:20.033856 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1150/2300] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:41:19 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:41:20.037707 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637207d1-dc85-4aa4-9970-fb9b38c0061a admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:20.049354 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637207d1-dc85-4aa4-9970-fb9b38c0061a admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:20.053994 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ac6350-6c02-4482-917e-68e94ecb93e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:20.054628 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac6350-6c02-4482-917e-68e94ecb93e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:20.054912 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac6350-6c02-4482-917e-68e94ecb93e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:20.055686 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac6350-6c02-4482-917e-68e94ecb93e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:20.056404 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ac6350-6c02-4482-917e-68e94ecb93e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:20.058016 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ac6350-6c02-4482-917e-68e94ecb93e9 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:20.068154 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1151/2301] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:41:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:41:20.072741 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce75fa-7d3c-49d8-b3b0-c22aa71a0efa admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:20.082689 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce75fa-7d3c-49d8-b3b0-c22aa71a0efa admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:20.093540 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3048b7-55e7-4a88-b4c4-418a9c12b63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:20.094223 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3048b7-55e7-4a88-b4c4-418a9c12b63f admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:20.094506 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3048b7-55e7-4a88-b4c4-418a9c12b63f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:20.094778 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3048b7-55e7-4a88-b4c4-418a9c12b63f admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:20.095509 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3048b7-55e7-4a88-b4c4-418a9c12b63f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:20.097269 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3048b7-55e7-4a88-b4c4-418a9c12b63f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:20.107818 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1151/2302] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:41:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:41:20.112317 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ac6350-6c02-4482-917e-68e94ecb93e9 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:20.123499 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ac6350-6c02-4482-917e-68e94ecb93e9 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:20.128257 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f6aaae-ca73-4e26-973e-eedda0371588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:20.129172 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6aaae-ca73-4e26-973e-eedda0371588 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:20.129457 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6aaae-ca73-4e26-973e-eedda0371588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:20.129758 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6aaae-ca73-4e26-973e-eedda0371588 admin admin] PATH_INFO: `/v3/projects/42d8b18aba9b4394a225271e0daf0df9/users/64cb93e32cdc429ab8c94a7e7bd58b89/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:20.145360 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f6aaae-ca73-4e26-973e-eedda0371588 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42d8b18aba9b4394a225271e0daf0df9, user_id=64cb93e32cdc429ab8c94a7e7bd58b89, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:20.148015 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f6aaae-ca73-4e26-973e-eedda0371588 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:20.161572 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1152/2303] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:41:20 2022] PUT /identity/v3/projects/42d8b18aba9b4394a225271e0daf0df9/users/64cb93e32cdc429ab8c94a7e7bd58b89/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:20.171426 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a384bf-e41f-42ee-b55a-f85ac94804f2 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:20.171733 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a384bf-e41f-42ee-b55a-f85ac94804f2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:20.171995 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a384bf-e41f-42ee-b55a-f85ac94804f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:20.204257 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-56a384bf-e41f-42ee-b55a-f85ac94804f2 None None] MFA Rules not processed for user `64cb93e32cdc429ab8c94a7e7bd58b89`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:20.205519 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-56a384bf-e41f-42ee-b55a-f85ac94804f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:20.275901 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1152/2304] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:41:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:20.287886 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f6aaae-ca73-4e26-973e-eedda0371588 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:20.290441 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-99f6aaae-ca73-4e26-973e-eedda0371588 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:20.365509 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f6aaae-ca73-4e26-973e-eedda0371588 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:20.371682 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d6e49b-f4d3-4403-944e-5fff05ce7f4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536f68ff77794352adf41aaacdc0645c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:20.372331 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6e49b-f4d3-4403-944e-5fff05ce7f4c service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:20.372631 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6e49b-f4d3-4403-944e-5fff05ce7f4c service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:20.372936 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6e49b-f4d3-4403-944e-5fff05ce7f4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:20.381551 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d6e49b-f4d3-4403-944e-5fff05ce7f4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:20.383148 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d6e49b-f4d3-4403-944e-5fff05ce7f4c service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:20.392537 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1153/2305] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:41:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:41:25.599097 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a384bf-e41f-42ee-b55a-f85ac94804f2 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:25.617928 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:25.664140 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a384bf-e41f-42ee-b55a-f85ac94804f2 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:25.668771 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea473b2-392b-4d8c-8995-3591d2ce7aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:25.669695 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea473b2-392b-4d8c-8995-3591d2ce7aa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:25.669979 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea473b2-392b-4d8c-8995-3591d2ce7aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:25.670251 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea473b2-392b-4d8c-8995-3591d2ce7aa9 admin admin] PATH_INFO: `/v3/users/64cb93e32cdc429ab8c94a7e7bd58b89` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:25.671478 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea473b2-392b-4d8c-8995-3591d2ce7aa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64cb93e32cdc429ab8c94a7e7bd58b89)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:25.673459 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea473b2-392b-4d8c-8995-3591d2ce7aa9 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:25.721963 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-cea473b2-392b-4d8c-8995-3591d2ce7aa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64cb93e32cdc429ab8c94a7e7bd58b89'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:25.730329 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-cea473b2-392b-4d8c-8995-3591d2ce7aa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64cb93e32cdc429ab8c94a7e7bd58b89'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:25.731412 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-cea473b2-392b-4d8c-8995-3591d2ce7aa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64cb93e32cdc429ab8c94a7e7bd58b89'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:25.732399 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-cea473b2-392b-4d8c-8995-3591d2ce7aa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64cb93e32cdc429ab8c94a7e7bd58b89'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:25.741027 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-cea473b2-392b-4d8c-8995-3591d2ce7aa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64cb93e32cdc429ab8c94a7e7bd58b89'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:25.760706 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1153/2306] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:41:25 2022] DELETE /identity/v3/users/64cb93e32cdc429ab8c94a7e7bd58b89 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:25.765450 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de226f57-b239-478a-bf2b-5f49a19ace86 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:25.765971 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de226f57-b239-478a-bf2b-5f49a19ace86 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:25.766102 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de226f57-b239-478a-bf2b-5f49a19ace86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:25.784830 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-de226f57-b239-478a-bf2b-5f49a19ace86 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:25.786080 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-de226f57-b239-478a-bf2b-5f49a19ace86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:25.846081 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1154/2307] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:41:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:25.855818 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea473b2-392b-4d8c-8995-3591d2ce7aa9 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:25.857281 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-cea473b2-392b-4d8c-8995-3591d2ce7aa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:25.914225 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea473b2-392b-4d8c-8995-3591d2ce7aa9 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:25.918001 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb8e7e-4dbc-4279-af64-3d6c8bc7644d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:25.918660 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb8e7e-4dbc-4279-af64-3d6c8bc7644d service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:25.918931 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb8e7e-4dbc-4279-af64-3d6c8bc7644d service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:25.919209 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb8e7e-4dbc-4279-af64-3d6c8bc7644d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:25.928283 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeb8e7e-4dbc-4279-af64-3d6c8bc7644d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:25.929796 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeb8e7e-4dbc-4279-af64-3d6c8bc7644d service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:25.939859 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1154/2308] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:41:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:41:26.442909 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de226f57-b239-478a-bf2b-5f49a19ace86 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:26.444437 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-de226f57-b239-478a-bf2b-5f49a19ace86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:26.456589 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de226f57-b239-478a-bf2b-5f49a19ace86 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:26.465696 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c4db1-3960-441b-9cbf-f953196862a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:26.466609 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c4db1-3960-441b-9cbf-f953196862a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:26.466879 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c4db1-3960-441b-9cbf-f953196862a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:26.467150 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c4db1-3960-441b-9cbf-f953196862a2 admin admin] PATH_INFO: `/v3/projects/42d8b18aba9b4394a225271e0daf0df9` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:26.468465 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8c4db1-3960-441b-9cbf-f953196862a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42d8b18aba9b4394a225271e0daf0df9)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:26.470439 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8c4db1-3960-441b-9cbf-f953196862a2 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:26.513651 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:26.534605 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-4e8c4db1-3960-441b-9cbf-f953196862a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42d8b18aba9b4394a225271e0daf0df9', 'request_id': 'req-4e8c4db1-3960-441b-9cbf-f953196862a2'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:26.542752 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-4e8c4db1-3960-441b-9cbf-f953196862a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42d8b18aba9b4394a225271e0daf0df9', 'request_id': 'req-4e8c4db1-3960-441b-9cbf-f953196862a2'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:26.549253 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-4e8c4db1-3960-441b-9cbf-f953196862a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42d8b18aba9b4394a225271e0daf0df9', 'request_id': 'req-4e8c4db1-3960-441b-9cbf-f953196862a2'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:26.560910 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-4e8c4db1-3960-441b-9cbf-f953196862a2 admin admin] The token cache is being invalidate because project 42d8b18aba9b4394a225271e0daf0df9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:41:26.561202 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-4e8c4db1-3960-441b-9cbf-f953196862a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:26.562174 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-4e8c4db1-3960-441b-9cbf-f953196862a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:26.563449 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1155/2309] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:41:26 2022] DELETE /identity/v3/projects/42d8b18aba9b4394a225271e0daf0df9 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:26.568417 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c63d28-79ac-460b-992e-8e57e8551b10 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:26.568708 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c63d28-79ac-460b-992e-8e57e8551b10 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:26.569030 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c63d28-79ac-460b-992e-8e57e8551b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:26.587000 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-83c63d28-79ac-460b-992e-8e57e8551b10 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:26.588208 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-83c63d28-79ac-460b-992e-8e57e8551b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:26.622380 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:26.652530 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1155/2310] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:41:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:41:26.661621 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc5dac-b72d-45eb-b888-be008594e0ac None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:26.661984 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc5dac-b72d-45eb-b888-be008594e0ac None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:26.662368 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc5dac-b72d-45eb-b888-be008594e0ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:26.682377 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-32fc5dac-b72d-45eb-b888-be008594e0ac None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:26.683591 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-32fc5dac-b72d-45eb-b888-be008594e0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:26.692560 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1156/2311] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:41:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:26.696769 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c63d28-79ac-460b-992e-8e57e8551b10 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:26.707077 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c63d28-79ac-460b-992e-8e57e8551b10 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:26.712526 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac21bb2-de40-4dd4-820d-d1b6d4272f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:26.713232 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac21bb2-de40-4dd4-820d-d1b6d4272f76 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:26.713515 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac21bb2-de40-4dd4-820d-d1b6d4272f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:26.713802 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac21bb2-de40-4dd4-820d-d1b6d4272f76 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:26.714530 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac21bb2-de40-4dd4-820d-d1b6d4272f76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:41:26.714856 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac21bb2-de40-4dd4-820d-d1b6d4272f76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:26.716499 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac21bb2-de40-4dd4-820d-d1b6d4272f76 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:26.730955 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1156/2312] 10.222.0.16 () {58 vars in 1152 bytes} [Thu May 26 12:41:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:41:26.735675 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc5dac-b72d-45eb-b888-be008594e0ac None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:26.745116 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc5dac-b72d-45eb-b888-be008594e0ac None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:26.750063 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aac75a-77f1-40b1-bd44-325886c9d060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:26.750715 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aac75a-77f1-40b1-bd44-325886c9d060 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:26.750993 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aac75a-77f1-40b1-bd44-325886c9d060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:26.751263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aac75a-77f1-40b1-bd44-325886c9d060 admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:26.751953 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aac75a-77f1-40b1-bd44-325886c9d060 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:26.754200 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aac75a-77f1-40b1-bd44-325886c9d060 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:26.779971 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1157/2313] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:41:26 2022] POST /identity/v3/projects => generated 363 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:41:26.784073 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac21bb2-de40-4dd4-820d-d1b6d4272f76 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:26.794723 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac21bb2-de40-4dd4-820d-d1b6d4272f76 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:26.857109 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913065a9-9ad3-4aa7-9ca4-e268db4ab875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:26.857768 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913065a9-9ad3-4aa7-9ca4-e268db4ab875 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:26.858048 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913065a9-9ad3-4aa7-9ca4-e268db4ab875 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:26.858320 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913065a9-9ad3-4aa7-9ca4-e268db4ab875 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:26.858996 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913065a9-9ad3-4aa7-9ca4-e268db4ab875 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:26.860949 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913065a9-9ad3-4aa7-9ca4-e268db4ab875 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:26.880910 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1157/2314] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:41:26 2022] POST /identity/v3/users => generated 282 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:41:26.885236 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aac75a-77f1-40b1-bd44-325886c9d060 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:26.895454 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aac75a-77f1-40b1-bd44-325886c9d060 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:26.900816 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee26bdd-855c-4917-846b-0d8c343d858a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:26.901537 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee26bdd-855c-4917-846b-0d8c343d858a admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:26.901818 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee26bdd-855c-4917-846b-0d8c343d858a admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:26.902094 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee26bdd-855c-4917-846b-0d8c343d858a admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:26.902821 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee26bdd-855c-4917-846b-0d8c343d858a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:26.904506 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee26bdd-855c-4917-846b-0d8c343d858a admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:26.915793 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1158/2315] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:41:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:41:26.919831 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913065a9-9ad3-4aa7-9ca4-e268db4ab875 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:26.929725 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913065a9-9ad3-4aa7-9ca4-e268db4ab875 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:26.934608 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f31fefc-b91b-4a14-8144-76c7b23d52e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:26.935263 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31fefc-b91b-4a14-8144-76c7b23d52e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:26.935634 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31fefc-b91b-4a14-8144-76c7b23d52e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:26.936097 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31fefc-b91b-4a14-8144-76c7b23d52e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:26.937253 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f31fefc-b91b-4a14-8144-76c7b23d52e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:26.939934 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f31fefc-b91b-4a14-8144-76c7b23d52e9 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:26.951015 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1158/2316] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:41:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:41:26.955250 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee26bdd-855c-4917-846b-0d8c343d858a admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:26.966026 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee26bdd-855c-4917-846b-0d8c343d858a admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:26.970641 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2760e90d-11e5-430a-a776-2be59f776014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:26.971519 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760e90d-11e5-430a-a776-2be59f776014 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:26.971801 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760e90d-11e5-430a-a776-2be59f776014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:26.972090 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760e90d-11e5-430a-a776-2be59f776014 admin admin] PATH_INFO: `/v3/projects/598f7a59790d4a0895ebdf51611b901f/users/665a3f1daa4b4849a0f180ed29ebd3b3/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:26.986957 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2760e90d-11e5-430a-a776-2be59f776014 admin admin] RBAC: Authorizing `identity:create_grant(project_id=598f7a59790d4a0895ebdf51611b901f, user_id=665a3f1daa4b4849a0f180ed29ebd3b3, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:26.989737 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2760e90d-11e5-430a-a776-2be59f776014 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:27.005126 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1159/2317] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:41:26 2022] PUT /identity/v3/projects/598f7a59790d4a0895ebdf51611b901f/users/665a3f1daa4b4849a0f180ed29ebd3b3/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:27.016282 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afdce9c-3af8-4175-9a53-f393f71915a4 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:27.016625 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afdce9c-3af8-4175-9a53-f393f71915a4 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:27.016945 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afdce9c-3af8-4175-9a53-f393f71915a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:27.044542 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-3afdce9c-3af8-4175-9a53-f393f71915a4 None None] MFA Rules not processed for user `665a3f1daa4b4849a0f180ed29ebd3b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:27.045896 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3afdce9c-3af8-4175-9a53-f393f71915a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:27.112350 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1159/2318] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:41:27 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:27.117056 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2760e90d-11e5-430a-a776-2be59f776014 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:27.188504 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2760e90d-11e5-430a-a776-2be59f776014 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:27.194589 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb00a8c-c6b0-449b-b370-3815d11631ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:27.195270 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb00a8c-c6b0-449b-b370-3815d11631ad admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:27.196056 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb00a8c-c6b0-449b-b370-3815d11631ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:27.196343 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb00a8c-c6b0-449b-b370-3815d11631ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:27.197067 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb00a8c-c6b0-449b-b370-3815d11631ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:27.198983 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb00a8c-c6b0-449b-b370-3815d11631ad admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:27.223919 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1160/2319] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:41:27 2022] POST /identity/v3/projects => generated 365 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:41:27.228111 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afdce9c-3af8-4175-9a53-f393f71915a4 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:27.238844 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afdce9c-3af8-4175-9a53-f393f71915a4 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:27.272007 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:27.297907 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9741ca8e-9df3-4f8d-92f2-44543c63b176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:27.298579 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741ca8e-9df3-4f8d-92f2-44543c63b176 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:27.298865 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741ca8e-9df3-4f8d-92f2-44543c63b176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:27.299144 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741ca8e-9df3-4f8d-92f2-44543c63b176 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:27.299828 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9741ca8e-9df3-4f8d-92f2-44543c63b176 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:27.301811 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9741ca8e-9df3-4f8d-92f2-44543c63b176 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:27.323542 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1160/2320] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:41:27 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:41:27.328084 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb00a8c-c6b0-449b-b370-3815d11631ad admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:27.341178 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb00a8c-c6b0-449b-b370-3815d11631ad admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:27.346792 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3133508-9ce9-4f91-841d-1f60220937fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:27.347598 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3133508-9ce9-4f91-841d-1f60220937fc admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:27.347963 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3133508-9ce9-4f91-841d-1f60220937fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:27.348247 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3133508-9ce9-4f91-841d-1f60220937fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:27.349148 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3133508-9ce9-4f91-841d-1f60220937fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:27.351081 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3133508-9ce9-4f91-841d-1f60220937fc admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:27.363718 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1161/2321] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:41:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:41:27.368322 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9741ca8e-9df3-4f8d-92f2-44543c63b176 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:27.378507 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9741ca8e-9df3-4f8d-92f2-44543c63b176 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:27.383794 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326c6df-28eb-4ed7-bba9-ba4b6900008a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:27.384663 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326c6df-28eb-4ed7-bba9-ba4b6900008a admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:27.384988 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326c6df-28eb-4ed7-bba9-ba4b6900008a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:27.385256 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326c6df-28eb-4ed7-bba9-ba4b6900008a admin admin] PATH_INFO: `/v3/projects/3d0c17ece0064a489d0c77b85c8ee8ff/users/69d9907ee859435785e12aefe9b8f073/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:27.399847 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0326c6df-28eb-4ed7-bba9-ba4b6900008a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d0c17ece0064a489d0c77b85c8ee8ff, user_id=69d9907ee859435785e12aefe9b8f073, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:27.402572 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0326c6df-28eb-4ed7-bba9-ba4b6900008a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:27.414785 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1161/2322] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:41:27 2022] PUT /identity/v3/projects/3d0c17ece0064a489d0c77b85c8ee8ff/users/69d9907ee859435785e12aefe9b8f073/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:27.418798 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3133508-9ce9-4f91-841d-1f60220937fc admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:27.428860 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3133508-9ce9-4f91-841d-1f60220937fc admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:27.454742 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:27.490285 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb195f7-8c69-4fa8-88eb-fe0c41afd469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:27.490998 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb195f7-8c69-4fa8-88eb-fe0c41afd469 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:27.491285 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb195f7-8c69-4fa8-88eb-fe0c41afd469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:27.491561 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb195f7-8c69-4fa8-88eb-fe0c41afd469 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:27.492296 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb195f7-8c69-4fa8-88eb-fe0c41afd469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:27.494447 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb195f7-8c69-4fa8-88eb-fe0c41afd469 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:27.505101 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1162/2323] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:41:27 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:41:27.509927 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326c6df-28eb-4ed7-bba9-ba4b6900008a admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:27.521071 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326c6df-28eb-4ed7-bba9-ba4b6900008a admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:27.526328 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3dbc28-9c3e-4c1e-ad25-fc07187953c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:27.527282 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3dbc28-9c3e-4c1e-ad25-fc07187953c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:27.527569 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3dbc28-9c3e-4c1e-ad25-fc07187953c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:27.527906 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3dbc28-9c3e-4c1e-ad25-fc07187953c6 admin admin] PATH_INFO: `/v3/projects/3d0c17ece0064a489d0c77b85c8ee8ff/users/69d9907ee859435785e12aefe9b8f073/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:27.530142 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3dbc28-9c3e-4c1e-ad25-fc07187953c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d0c17ece0064a489d0c77b85c8ee8ff, user_id=69d9907ee859435785e12aefe9b8f073, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:27.533115 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3dbc28-9c3e-4c1e-ad25-fc07187953c6 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:27.544506 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1162/2324] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:41:27 2022] PUT /identity/v3/projects/3d0c17ece0064a489d0c77b85c8ee8ff/users/69d9907ee859435785e12aefe9b8f073/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:27.554672 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b402467-1ecd-41dc-a73d-cae5ce5afd22 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:27.555470 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b402467-1ecd-41dc-a73d-cae5ce5afd22 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:27.555752 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b402467-1ecd-41dc-a73d-cae5ce5afd22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:27.582514 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-0b402467-1ecd-41dc-a73d-cae5ce5afd22 None None] MFA Rules not processed for user `69d9907ee859435785e12aefe9b8f073`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:27.583712 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-0b402467-1ecd-41dc-a73d-cae5ce5afd22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:27.655342 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1163/2325] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:41:27 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:27.667173 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3dbc28-9c3e-4c1e-ad25-fc07187953c6 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:27.669057 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-fb3dbc28-9c3e-4c1e-ad25-fc07187953c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:27.725716 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3dbc28-9c3e-4c1e-ad25-fc07187953c6 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:27.729991 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d8992-4c23-4442-bf0d-0ee5c912aafa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:27.730634 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d8992-4c23-4442-bf0d-0ee5c912aafa service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:27.730919 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d8992-4c23-4442-bf0d-0ee5c912aafa service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:27.731195 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d8992-4c23-4442-bf0d-0ee5c912aafa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:27.740256 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20d8992-4c23-4442-bf0d-0ee5c912aafa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:27.741781 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20d8992-4c23-4442-bf0d-0ee5c912aafa service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:27.752493 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1163/2326] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:41:27 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:41:27.823754 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b402467-1ecd-41dc-a73d-cae5ce5afd22 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:27.833490 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b402467-1ecd-41dc-a73d-cae5ce5afd22 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:27.837131 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd22790b-31a6-4063-b9f7-e6529951648f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:27.837767 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22790b-31a6-4063-b9f7-e6529951648f service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:27.838048 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22790b-31a6-4063-b9f7-e6529951648f service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:27.838322 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22790b-31a6-4063-b9f7-e6529951648f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:27.895578 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd22790b-31a6-4063-b9f7-e6529951648f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:27.897294 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd22790b-31a6-4063-b9f7-e6529951648f service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:27.906278 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1164/2327] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:41:27 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:41:34.909706 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d8992-4c23-4442-bf0d-0ee5c912aafa service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:34.970492 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d8992-4c23-4442-bf0d-0ee5c912aafa service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:34.975261 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f440510-a9b3-46e9-81bc-05fafbcca08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:34.976137 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f440510-a9b3-46e9-81bc-05fafbcca08c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:34.976419 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f440510-a9b3-46e9-81bc-05fafbcca08c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:34.976691 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f440510-a9b3-46e9-81bc-05fafbcca08c admin admin] PATH_INFO: `/v3/users/665a3f1daa4b4849a0f180ed29ebd3b3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:34.977918 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f440510-a9b3-46e9-81bc-05fafbcca08c admin admin] RBAC: Authorizing `identity:delete_user(user_id=665a3f1daa4b4849a0f180ed29ebd3b3)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:34.979861 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f440510-a9b3-46e9-81bc-05fafbcca08c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:35.016621 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:35.035023 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6f440510-a9b3-46e9-81bc-05fafbcca08c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '665a3f1daa4b4849a0f180ed29ebd3b3'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:35.044169 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6f440510-a9b3-46e9-81bc-05fafbcca08c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '665a3f1daa4b4849a0f180ed29ebd3b3'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:35.045087 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6f440510-a9b3-46e9-81bc-05fafbcca08c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '665a3f1daa4b4849a0f180ed29ebd3b3'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:35.045809 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6f440510-a9b3-46e9-81bc-05fafbcca08c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '665a3f1daa4b4849a0f180ed29ebd3b3'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:35.054809 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6f440510-a9b3-46e9-81bc-05fafbcca08c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '665a3f1daa4b4849a0f180ed29ebd3b3'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:35.074686 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1164/2328] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:41:34 2022] DELETE /identity/v3/users/665a3f1daa4b4849a0f180ed29ebd3b3 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:35.079663 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7128e-2b7a-423f-9e55-5c4aad2ae0c3 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:35.080168 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7128e-2b7a-423f-9e55-5c4aad2ae0c3 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:35.080307 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7128e-2b7a-423f-9e55-5c4aad2ae0c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:35.098728 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-a3d7128e-2b7a-423f-9e55-5c4aad2ae0c3 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:35.100077 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-a3d7128e-2b7a-423f-9e55-5c4aad2ae0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:35.149721 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:35.168727 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1165/2329] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:41:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:35.179396 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f440510-a9b3-46e9-81bc-05fafbcca08c admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:35.181505 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6f440510-a9b3-46e9-81bc-05fafbcca08c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:35.277910 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f440510-a9b3-46e9-81bc-05fafbcca08c admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:35.295138 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ddedb3-20ef-4d75-b9a3-2e9d99ff1dca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:35.296095 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ddedb3-20ef-4d75-b9a3-2e9d99ff1dca service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:35.296270 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ddedb3-20ef-4d75-b9a3-2e9d99ff1dca service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:35.296584 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ddedb3-20ef-4d75-b9a3-2e9d99ff1dca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:35.307407 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ddedb3-20ef-4d75-b9a3-2e9d99ff1dca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:35.308909 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ddedb3-20ef-4d75-b9a3-2e9d99ff1dca service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:35.319857 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1165/2330] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:41:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:41:35.620666 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7128e-2b7a-423f-9e55-5c4aad2ae0c3 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:35.622119 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-a3d7128e-2b7a-423f-9e55-5c4aad2ae0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:35.634721 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7128e-2b7a-423f-9e55-5c4aad2ae0c3 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:35.639506 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfba6a0-76cc-40e3-9c5f-687aa86ebc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:35.640532 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfba6a0-76cc-40e3-9c5f-687aa86ebc2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:35.640812 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfba6a0-76cc-40e3-9c5f-687aa86ebc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:35.641125 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfba6a0-76cc-40e3-9c5f-687aa86ebc2e admin admin] PATH_INFO: `/v3/projects/598f7a59790d4a0895ebdf51611b901f` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:35.642315 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfba6a0-76cc-40e3-9c5f-687aa86ebc2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=598f7a59790d4a0895ebdf51611b901f)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:35.644223 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfba6a0-76cc-40e3-9c5f-687aa86ebc2e admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:35.691854 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-1dfba6a0-76cc-40e3-9c5f-687aa86ebc2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '598f7a59790d4a0895ebdf51611b901f', 'request_id': 'req-1dfba6a0-76cc-40e3-9c5f-687aa86ebc2e'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:35.699611 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-1dfba6a0-76cc-40e3-9c5f-687aa86ebc2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '598f7a59790d4a0895ebdf51611b901f', 'request_id': 'req-1dfba6a0-76cc-40e3-9c5f-687aa86ebc2e'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:35.705838 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-1dfba6a0-76cc-40e3-9c5f-687aa86ebc2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '598f7a59790d4a0895ebdf51611b901f', 'request_id': 'req-1dfba6a0-76cc-40e3-9c5f-687aa86ebc2e'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:35.716953 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-1dfba6a0-76cc-40e3-9c5f-687aa86ebc2e admin admin] The token cache is being invalidate because project 598f7a59790d4a0895ebdf51611b901f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:41:35.717236 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-1dfba6a0-76cc-40e3-9c5f-687aa86ebc2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:35.717859 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-1dfba6a0-76cc-40e3-9c5f-687aa86ebc2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:35.719381 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1166/2331] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:41:35 2022] DELETE /identity/v3/projects/598f7a59790d4a0895ebdf51611b901f => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:35.723419 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ddedb3-20ef-4d75-b9a3-2e9d99ff1dca service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:35.733626 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ddedb3-20ef-4d75-b9a3-2e9d99ff1dca service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:35.788712 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf49ca9-45a1-4b68-ba65-0eba15a40e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:35.790085 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf49ca9-45a1-4b68-ba65-0eba15a40e39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:35.790372 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf49ca9-45a1-4b68-ba65-0eba15a40e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:35.790647 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf49ca9-45a1-4b68-ba65-0eba15a40e39 admin admin] PATH_INFO: `/v3/users/69d9907ee859435785e12aefe9b8f073` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:35.791819 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf49ca9-45a1-4b68-ba65-0eba15a40e39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69d9907ee859435785e12aefe9b8f073)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:35.793791 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf49ca9-45a1-4b68-ba65-0eba15a40e39 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:35.839330 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-edf49ca9-45a1-4b68-ba65-0eba15a40e39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69d9907ee859435785e12aefe9b8f073'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:35.846558 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-edf49ca9-45a1-4b68-ba65-0eba15a40e39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69d9907ee859435785e12aefe9b8f073'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:35.847254 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-edf49ca9-45a1-4b68-ba65-0eba15a40e39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69d9907ee859435785e12aefe9b8f073'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:35.847880 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-edf49ca9-45a1-4b68-ba65-0eba15a40e39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69d9907ee859435785e12aefe9b8f073'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:35.849113 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:35.859609 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-edf49ca9-45a1-4b68-ba65-0eba15a40e39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69d9907ee859435785e12aefe9b8f073'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:35.877415 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1166/2332] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:41:35 2022] DELETE /identity/v3/users/69d9907ee859435785e12aefe9b8f073 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:36.146132 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfba6a0-76cc-40e3-9c5f-687aa86ebc2e admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:36.147608 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-1dfba6a0-76cc-40e3-9c5f-687aa86ebc2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:36.162396 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfba6a0-76cc-40e3-9c5f-687aa86ebc2e admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:36.220068 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891776a2-d510-4623-af7f-45040f67ba1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:36.220982 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891776a2-d510-4623-af7f-45040f67ba1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:36.221264 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891776a2-d510-4623-af7f-45040f67ba1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:36.221535 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891776a2-d510-4623-af7f-45040f67ba1b admin admin] PATH_INFO: `/v3/projects/3d0c17ece0064a489d0c77b85c8ee8ff` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:36.222736 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891776a2-d510-4623-af7f-45040f67ba1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d0c17ece0064a489d0c77b85c8ee8ff)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:36.224640 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891776a2-d510-4623-af7f-45040f67ba1b admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:36.271590 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-891776a2-d510-4623-af7f-45040f67ba1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d0c17ece0064a489d0c77b85c8ee8ff', 'request_id': 'req-891776a2-d510-4623-af7f-45040f67ba1b'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:36.279347 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-891776a2-d510-4623-af7f-45040f67ba1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d0c17ece0064a489d0c77b85c8ee8ff', 'request_id': 'req-891776a2-d510-4623-af7f-45040f67ba1b'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:36.285514 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-891776a2-d510-4623-af7f-45040f67ba1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d0c17ece0064a489d0c77b85c8ee8ff', 'request_id': 'req-891776a2-d510-4623-af7f-45040f67ba1b'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:36.292482 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:36.296711 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-891776a2-d510-4623-af7f-45040f67ba1b admin admin] The token cache is being invalidate because project 3d0c17ece0064a489d0c77b85c8ee8ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:41:36.297088 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-891776a2-d510-4623-af7f-45040f67ba1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:36.297964 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-891776a2-d510-4623-af7f-45040f67ba1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:36.299859 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1167/2333] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:41:36 2022] DELETE /identity/v3/projects/3d0c17ece0064a489d0c77b85c8ee8ff => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:36.304769 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc19bc4-f741-40a3-a8eb-1c2495fcfa83 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:36.305838 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc19bc4-f741-40a3-a8eb-1c2495fcfa83 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:36.305967 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc19bc4-f741-40a3-a8eb-1c2495fcfa83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:36.324660 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-6bc19bc4-f741-40a3-a8eb-1c2495fcfa83 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:36.325857 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6bc19bc4-f741-40a3-a8eb-1c2495fcfa83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:36.387121 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1167/2334] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:41:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:36.394595 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29553b2c-007a-4912-805d-3c0efcd491fe None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:36.394837 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29553b2c-007a-4912-805d-3c0efcd491fe None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:36.395145 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29553b2c-007a-4912-805d-3c0efcd491fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:36.413565 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-29553b2c-007a-4912-805d-3c0efcd491fe None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:36.414784 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-29553b2c-007a-4912-805d-3c0efcd491fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:36.422721 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1168/2335] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:41:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:36.426842 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc19bc4-f741-40a3-a8eb-1c2495fcfa83 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:36.437239 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc19bc4-f741-40a3-a8eb-1c2495fcfa83 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:36.442234 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cef64d-44cf-4be4-bc90-a98a3f1bd338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:36.442877 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cef64d-44cf-4be4-bc90-a98a3f1bd338 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:36.443158 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cef64d-44cf-4be4-bc90-a98a3f1bd338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:36.443430 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cef64d-44cf-4be4-bc90-a98a3f1bd338 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:36.444146 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cef64d-44cf-4be4-bc90-a98a3f1bd338 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:41:36.444450 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cef64d-44cf-4be4-bc90-a98a3f1bd338 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:36.446718 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cef64d-44cf-4be4-bc90-a98a3f1bd338 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:36.457891 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1168/2336] 10.222.0.16 () {58 vars in 1152 bytes} [Thu May 26 12:41:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:41:36.462058 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29553b2c-007a-4912-805d-3c0efcd491fe None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:36.471003 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29553b2c-007a-4912-805d-3c0efcd491fe None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:36.475497 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4646ea-c62f-4223-ba79-98dc1f76835b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:36.476126 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4646ea-c62f-4223-ba79-98dc1f76835b admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:36.476404 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4646ea-c62f-4223-ba79-98dc1f76835b admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:36.476676 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4646ea-c62f-4223-ba79-98dc1f76835b admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:36.477407 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4646ea-c62f-4223-ba79-98dc1f76835b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:36.479293 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4646ea-c62f-4223-ba79-98dc1f76835b admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:36.504469 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1169/2337] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:41:36 2022] POST /identity/v3/projects => generated 363 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:41:36.509023 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cef64d-44cf-4be4-bc90-a98a3f1bd338 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:36.518786 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cef64d-44cf-4be4-bc90-a98a3f1bd338 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:36.573568 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf0397e-109a-497d-8956-694712a7e29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:36.574221 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0397e-109a-497d-8956-694712a7e29e admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:36.574501 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0397e-109a-497d-8956-694712a7e29e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:36.574824 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0397e-109a-497d-8956-694712a7e29e admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:36.575449 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf0397e-109a-497d-8956-694712a7e29e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:36.577398 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf0397e-109a-497d-8956-694712a7e29e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:36.596752 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1169/2338] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:41:36 2022] POST /identity/v3/users => generated 282 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:41:36.600825 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4646ea-c62f-4223-ba79-98dc1f76835b admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:36.611586 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4646ea-c62f-4223-ba79-98dc1f76835b admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:36.616076 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adcc026-2c88-4ed5-85d7-423b2d9acd66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:36.616711 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adcc026-2c88-4ed5-85d7-423b2d9acd66 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:36.617035 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adcc026-2c88-4ed5-85d7-423b2d9acd66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:36.617287 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adcc026-2c88-4ed5-85d7-423b2d9acd66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:36.618048 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adcc026-2c88-4ed5-85d7-423b2d9acd66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:36.619637 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adcc026-2c88-4ed5-85d7-423b2d9acd66 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:36.629975 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1170/2339] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:41:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:41:36.634062 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf0397e-109a-497d-8956-694712a7e29e admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:36.643896 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf0397e-109a-497d-8956-694712a7e29e admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:36.650229 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a6972-7664-4a7a-a006-6550e5a1c26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:36.650536 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a6972-7664-4a7a-a006-6550e5a1c26d admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:36.650823 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a6972-7664-4a7a-a006-6550e5a1c26d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:36.651145 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a6972-7664-4a7a-a006-6550e5a1c26d admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:36.651988 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a6972-7664-4a7a-a006-6550e5a1c26d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:36.653648 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a6972-7664-4a7a-a006-6550e5a1c26d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:36.664405 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1170/2340] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:41:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:41:36.669056 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adcc026-2c88-4ed5-85d7-423b2d9acd66 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:36.678956 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adcc026-2c88-4ed5-85d7-423b2d9acd66 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:36.683531 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c3690c-e473-457e-8970-20db17efa512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:36.684392 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3690c-e473-457e-8970-20db17efa512 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:36.684669 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3690c-e473-457e-8970-20db17efa512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:36.684975 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3690c-e473-457e-8970-20db17efa512 admin admin] PATH_INFO: `/v3/projects/cbf9b965f71d4f4dbb66c74f733edb64/users/3589c36e868a4466a86f5977bea1e335/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:36.699545 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c3690c-e473-457e-8970-20db17efa512 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbf9b965f71d4f4dbb66c74f733edb64, user_id=3589c36e868a4466a86f5977bea1e335, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:36.702225 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c3690c-e473-457e-8970-20db17efa512 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:36.716190 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1171/2341] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:41:36 2022] PUT /identity/v3/projects/cbf9b965f71d4f4dbb66c74f733edb64/users/3589c36e868a4466a86f5977bea1e335/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:36.726345 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab5e27-f16d-40f2-ba83-5ce1f65e01b2 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:36.726750 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab5e27-f16d-40f2-ba83-5ce1f65e01b2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:36.727202 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab5e27-f16d-40f2-ba83-5ce1f65e01b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:36.753359 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-44ab5e27-f16d-40f2-ba83-5ce1f65e01b2 None None] MFA Rules not processed for user `3589c36e868a4466a86f5977bea1e335`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:36.754569 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-44ab5e27-f16d-40f2-ba83-5ce1f65e01b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:36.782642 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:36.821325 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1171/2342] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:41:36 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:36.825905 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c3690c-e473-457e-8970-20db17efa512 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:36.886666 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c3690c-e473-457e-8970-20db17efa512 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:36.891289 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907d24c8-d18c-4f7b-819d-798522a46571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:36.891926 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d24c8-d18c-4f7b-819d-798522a46571 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:36.892206 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d24c8-d18c-4f7b-819d-798522a46571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:36.892480 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d24c8-d18c-4f7b-819d-798522a46571 admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:36.893186 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907d24c8-d18c-4f7b-819d-798522a46571 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:36.895079 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907d24c8-d18c-4f7b-819d-798522a46571 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:36.920449 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1172/2343] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:41:36 2022] POST /identity/v3/projects => generated 365 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:41:36.924492 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab5e27-f16d-40f2-ba83-5ce1f65e01b2 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:36.935692 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab5e27-f16d-40f2-ba83-5ce1f65e01b2 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:36.990051 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88d0a37-0ee7-4b14-bff0-4020526b085f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:36.990708 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d0a37-0ee7-4b14-bff0-4020526b085f admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:36.990995 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d0a37-0ee7-4b14-bff0-4020526b085f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:36.991274 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d0a37-0ee7-4b14-bff0-4020526b085f admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:36.991954 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88d0a37-0ee7-4b14-bff0-4020526b085f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:36.994443 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88d0a37-0ee7-4b14-bff0-4020526b085f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:37.013431 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1172/2344] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:41:36 2022] POST /identity/v3/users => generated 289 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:41:37.017397 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907d24c8-d18c-4f7b-819d-798522a46571 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:37.027698 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907d24c8-d18c-4f7b-819d-798522a46571 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:37.032246 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00ae17-9747-44c4-8d55-72f89105113e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:37.032932 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00ae17-9747-44c4-8d55-72f89105113e admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:37.033219 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00ae17-9747-44c4-8d55-72f89105113e admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:37.033500 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00ae17-9747-44c4-8d55-72f89105113e admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:37.034222 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc00ae17-9747-44c4-8d55-72f89105113e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:37.035820 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc00ae17-9747-44c4-8d55-72f89105113e admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:37.046921 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1173/2345] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:41:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:41:37.051049 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88d0a37-0ee7-4b14-bff0-4020526b085f admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:37.061366 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88d0a37-0ee7-4b14-bff0-4020526b085f admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:37.065975 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bfe7f8-7d8e-4a7c-8ecd-32123d3ad395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:37.066844 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfe7f8-7d8e-4a7c-8ecd-32123d3ad395 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:37.067128 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfe7f8-7d8e-4a7c-8ecd-32123d3ad395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:37.067403 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfe7f8-7d8e-4a7c-8ecd-32123d3ad395 admin admin] PATH_INFO: `/v3/projects/51b2c2394ba344f197548200f9db028e/users/915abcad6d9e4bad9b1f8c3299f3ea0b/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:37.081970 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bfe7f8-7d8e-4a7c-8ecd-32123d3ad395 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51b2c2394ba344f197548200f9db028e, user_id=915abcad6d9e4bad9b1f8c3299f3ea0b, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:37.084569 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bfe7f8-7d8e-4a7c-8ecd-32123d3ad395 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:37.097917 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1173/2346] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:41:37 2022] PUT /identity/v3/projects/51b2c2394ba344f197548200f9db028e/users/915abcad6d9e4bad9b1f8c3299f3ea0b/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:37.101704 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00ae17-9747-44c4-8d55-72f89105113e admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:37.111997 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00ae17-9747-44c4-8d55-72f89105113e admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:37.166871 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17facc1b-edab-4889-8dfa-6334431fcbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:37.167530 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17facc1b-edab-4889-8dfa-6334431fcbb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:37.167803 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17facc1b-edab-4889-8dfa-6334431fcbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:37.168080 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17facc1b-edab-4889-8dfa-6334431fcbb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:37.168801 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17facc1b-edab-4889-8dfa-6334431fcbb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:37.170425 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17facc1b-edab-4889-8dfa-6334431fcbb7 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:37.179937 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1174/2347] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:41:37 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:41:37.183989 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bfe7f8-7d8e-4a7c-8ecd-32123d3ad395 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:37.194179 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bfe7f8-7d8e-4a7c-8ecd-32123d3ad395 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:37.198884 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f08f9f-6418-4bd9-8bbd-ec92a5cfc7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:37.199753 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f08f9f-6418-4bd9-8bbd-ec92a5cfc7ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:37.200045 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f08f9f-6418-4bd9-8bbd-ec92a5cfc7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:37.200326 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f08f9f-6418-4bd9-8bbd-ec92a5cfc7ce admin admin] PATH_INFO: `/v3/projects/51b2c2394ba344f197548200f9db028e/users/915abcad6d9e4bad9b1f8c3299f3ea0b/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:37.202377 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f08f9f-6418-4bd9-8bbd-ec92a5cfc7ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=51b2c2394ba344f197548200f9db028e, user_id=915abcad6d9e4bad9b1f8c3299f3ea0b, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:37.205074 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f08f9f-6418-4bd9-8bbd-ec92a5cfc7ce admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:37.215706 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1174/2348] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:41:37 2022] PUT /identity/v3/projects/51b2c2394ba344f197548200f9db028e/users/915abcad6d9e4bad9b1f8c3299f3ea0b/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:37.226601 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7381b-99b0-42e3-bf98-0b8c96003b73 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:37.226898 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7381b-99b0-42e3-bf98-0b8c96003b73 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:37.227747 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7381b-99b0-42e3-bf98-0b8c96003b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:37.239948 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:37.255522 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-f9f7381b-99b0-42e3-bf98-0b8c96003b73 None None] MFA Rules not processed for user `915abcad6d9e4bad9b1f8c3299f3ea0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:37.256746 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-f9f7381b-99b0-42e3-bf98-0b8c96003b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:37.325594 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1175/2349] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:41:37 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:37.337057 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f08f9f-6418-4bd9-8bbd-ec92a5cfc7ce admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:37.338776 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e9f08f9f-6418-4bd9-8bbd-ec92a5cfc7ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:37.396527 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f08f9f-6418-4bd9-8bbd-ec92a5cfc7ce admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:37.400634 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4e9843-6a0b-47cd-b518-19e6aa539f00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:37.401319 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e9843-6a0b-47cd-b518-19e6aa539f00 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:37.401671 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e9843-6a0b-47cd-b518-19e6aa539f00 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:37.401953 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e9843-6a0b-47cd-b518-19e6aa539f00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:37.411058 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4e9843-6a0b-47cd-b518-19e6aa539f00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:37.412491 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4e9843-6a0b-47cd-b518-19e6aa539f00 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:37.421857 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1175/2350] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:41:37 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:41:37.493386 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f7381b-99b0-42e3-bf98-0b8c96003b73 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:37.503365 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f7381b-99b0-42e3-bf98-0b8c96003b73 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:37.507154 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cb59e1-bf0a-4f93-bb8b-a01194c0312d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:37.507785 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb59e1-bf0a-4f93-bb8b-a01194c0312d service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:37.508069 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb59e1-bf0a-4f93-bb8b-a01194c0312d service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:37.508387 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb59e1-bf0a-4f93-bb8b-a01194c0312d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:37.564531 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cb59e1-bf0a-4f93-bb8b-a01194c0312d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:37.566000 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cb59e1-bf0a-4f93-bb8b-a01194c0312d service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:37.575545 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1176/2351] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:41:37 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:41:40.299564 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4e9843-6a0b-47cd-b518-19e6aa539f00 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:40.325939 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:40.363537 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4e9843-6a0b-47cd-b518-19e6aa539f00 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:40.368864 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ac059-07cb-4a93-b6ff-67dd6e29faa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:40.369755 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ac059-07cb-4a93-b6ff-67dd6e29faa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:40.370034 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ac059-07cb-4a93-b6ff-67dd6e29faa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:40.370310 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ac059-07cb-4a93-b6ff-67dd6e29faa0 admin admin] PATH_INFO: `/v3/users/3589c36e868a4466a86f5977bea1e335` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:40.371543 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34ac059-07cb-4a93-b6ff-67dd6e29faa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3589c36e868a4466a86f5977bea1e335)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:40.373547 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34ac059-07cb-4a93-b6ff-67dd6e29faa0 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:40.428861 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c34ac059-07cb-4a93-b6ff-67dd6e29faa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3589c36e868a4466a86f5977bea1e335'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:40.437194 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c34ac059-07cb-4a93-b6ff-67dd6e29faa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3589c36e868a4466a86f5977bea1e335'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:40.437946 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c34ac059-07cb-4a93-b6ff-67dd6e29faa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3589c36e868a4466a86f5977bea1e335'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:40.438654 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c34ac059-07cb-4a93-b6ff-67dd6e29faa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3589c36e868a4466a86f5977bea1e335'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:40.446885 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c34ac059-07cb-4a93-b6ff-67dd6e29faa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3589c36e868a4466a86f5977bea1e335'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:40.465138 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1176/2352] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:41:40 2022] DELETE /identity/v3/users/3589c36e868a4466a86f5977bea1e335 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:40.469594 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1884a4f-cbb0-4163-a2e0-3b3894ff019c None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:40.471060 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1884a4f-cbb0-4163-a2e0-3b3894ff019c None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:40.471060 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1884a4f-cbb0-4163-a2e0-3b3894ff019c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:40.487721 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-d1884a4f-cbb0-4163-a2e0-3b3894ff019c None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:40.488974 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-d1884a4f-cbb0-4163-a2e0-3b3894ff019c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:40.560550 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1177/2353] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:41:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:40.570276 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ac059-07cb-4a93-b6ff-67dd6e29faa0 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:40.571818 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c34ac059-07cb-4a93-b6ff-67dd6e29faa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:40.631346 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ac059-07cb-4a93-b6ff-67dd6e29faa0 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:40.635585 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f43cd55-6df4-4ccb-b7b8-12c9d9b352b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:40.636227 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43cd55-6df4-4ccb-b7b8-12c9d9b352b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:40.636508 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43cd55-6df4-4ccb-b7b8-12c9d9b352b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:40.636784 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43cd55-6df4-4ccb-b7b8-12c9d9b352b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:40.646736 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f43cd55-6df4-4ccb-b7b8-12c9d9b352b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:40.648202 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f43cd55-6df4-4ccb-b7b8-12c9d9b352b0 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:40.658898 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1177/2354] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:41:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:41:40.944720 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1884a4f-cbb0-4163-a2e0-3b3894ff019c None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:40.946738 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-d1884a4f-cbb0-4163-a2e0-3b3894ff019c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:40.958657 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1884a4f-cbb0-4163-a2e0-3b3894ff019c None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:40.963912 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729ea85-f958-4b34-9a48-4e6b9451cc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:40.964773 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729ea85-f958-4b34-9a48-4e6b9451cc4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:40.965074 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729ea85-f958-4b34-9a48-4e6b9451cc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:40.965351 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729ea85-f958-4b34-9a48-4e6b9451cc4b admin admin] PATH_INFO: `/v3/projects/cbf9b965f71d4f4dbb66c74f733edb64` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:40.966559 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a729ea85-f958-4b34-9a48-4e6b9451cc4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbf9b965f71d4f4dbb66c74f733edb64)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:40.968477 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a729ea85-f958-4b34-9a48-4e6b9451cc4b admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:41.000165 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:41.016493 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-a729ea85-f958-4b34-9a48-4e6b9451cc4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbf9b965f71d4f4dbb66c74f733edb64', 'request_id': 'req-a729ea85-f958-4b34-9a48-4e6b9451cc4b'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:41.026985 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-a729ea85-f958-4b34-9a48-4e6b9451cc4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbf9b965f71d4f4dbb66c74f733edb64', 'request_id': 'req-a729ea85-f958-4b34-9a48-4e6b9451cc4b'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:41.033511 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-a729ea85-f958-4b34-9a48-4e6b9451cc4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbf9b965f71d4f4dbb66c74f733edb64', 'request_id': 'req-a729ea85-f958-4b34-9a48-4e6b9451cc4b'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:41.049208 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-a729ea85-f958-4b34-9a48-4e6b9451cc4b admin admin] The token cache is being invalidate because project cbf9b965f71d4f4dbb66c74f733edb64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:41:41.049496 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-a729ea85-f958-4b34-9a48-4e6b9451cc4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:41.050142 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-a729ea85-f958-4b34-9a48-4e6b9451cc4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:41.051683 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1178/2355] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:41:40 2022] DELETE /identity/v3/projects/cbf9b965f71d4f4dbb66c74f733edb64 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:41.055661 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f43cd55-6df4-4ccb-b7b8-12c9d9b352b0 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:41.065504 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f43cd55-6df4-4ccb-b7b8-12c9d9b352b0 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:41.107228 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:41.123525 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce1323-4f56-407f-a0f3-be907c9b85e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:41.124660 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce1323-4f56-407f-a0f3-be907c9b85e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:41.124974 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce1323-4f56-407f-a0f3-be907c9b85e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:41.125251 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce1323-4f56-407f-a0f3-be907c9b85e4 admin admin] PATH_INFO: `/v3/users/915abcad6d9e4bad9b1f8c3299f3ea0b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:41.126485 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ce1323-4f56-407f-a0f3-be907c9b85e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=915abcad6d9e4bad9b1f8c3299f3ea0b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:41.128450 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ce1323-4f56-407f-a0f3-be907c9b85e4 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:41.174222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d6ce1323-4f56-407f-a0f3-be907c9b85e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '915abcad6d9e4bad9b1f8c3299f3ea0b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:41.182325 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d6ce1323-4f56-407f-a0f3-be907c9b85e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '915abcad6d9e4bad9b1f8c3299f3ea0b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:41.183045 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d6ce1323-4f56-407f-a0f3-be907c9b85e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '915abcad6d9e4bad9b1f8c3299f3ea0b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:41.183652 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d6ce1323-4f56-407f-a0f3-be907c9b85e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '915abcad6d9e4bad9b1f8c3299f3ea0b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:41.190878 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d6ce1323-4f56-407f-a0f3-be907c9b85e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '915abcad6d9e4bad9b1f8c3299f3ea0b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:41.208483 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1178/2356] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:41:41 2022] DELETE /identity/v3/users/915abcad6d9e4bad9b1f8c3299f3ea0b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:41.484876 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729ea85-f958-4b34-9a48-4e6b9451cc4b admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:41.486427 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-a729ea85-f958-4b34-9a48-4e6b9451cc4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:41.500248 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729ea85-f958-4b34-9a48-4e6b9451cc4b admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:41.559834 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d27b72-5bfe-4da8-b9d0-67628ae5098b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:41.560752 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d27b72-5bfe-4da8-b9d0-67628ae5098b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:41.561009 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d27b72-5bfe-4da8-b9d0-67628ae5098b admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:41.561287 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d27b72-5bfe-4da8-b9d0-67628ae5098b admin admin] PATH_INFO: `/v3/projects/51b2c2394ba344f197548200f9db028e` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:41.562497 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d27b72-5bfe-4da8-b9d0-67628ae5098b admin admin] RBAC: Authorizing `identity:delete_project(project_id=51b2c2394ba344f197548200f9db028e)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:41.564403 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d27b72-5bfe-4da8-b9d0-67628ae5098b admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:41.612540 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-26d27b72-5bfe-4da8-b9d0-67628ae5098b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51b2c2394ba344f197548200f9db028e', 'request_id': 'req-26d27b72-5bfe-4da8-b9d0-67628ae5098b'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:41.621923 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-26d27b72-5bfe-4da8-b9d0-67628ae5098b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51b2c2394ba344f197548200f9db028e', 'request_id': 'req-26d27b72-5bfe-4da8-b9d0-67628ae5098b'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:41.628992 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-26d27b72-5bfe-4da8-b9d0-67628ae5098b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51b2c2394ba344f197548200f9db028e', 'request_id': 'req-26d27b72-5bfe-4da8-b9d0-67628ae5098b'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:41.642703 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-26d27b72-5bfe-4da8-b9d0-67628ae5098b admin admin] The token cache is being invalidate because project 51b2c2394ba344f197548200f9db028e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:41:41.642988 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-26d27b72-5bfe-4da8-b9d0-67628ae5098b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:41.643649 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-26d27b72-5bfe-4da8-b9d0-67628ae5098b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:41.645240 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1179/2357] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:41:41 2022] DELETE /identity/v3/projects/51b2c2394ba344f197548200f9db028e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:41:41.650861 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ad787-338c-44f1-87a7-2ddedc997a1f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:41.651376 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ad787-338c-44f1-87a7-2ddedc997a1f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:41.651480 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ad787-338c-44f1-87a7-2ddedc997a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:41.672326 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-000ad787-338c-44f1-87a7-2ddedc997a1f None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:41.673618 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-000ad787-338c-44f1-87a7-2ddedc997a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:41.743522 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1179/2358] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:41:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:41.752514 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220d1bb-bd5a-4897-bff8-4b67ab9493d3 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:41.753212 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220d1bb-bd5a-4897-bff8-4b67ab9493d3 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:41.753832 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220d1bb-bd5a-4897-bff8-4b67ab9493d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:41.773262 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-c220d1bb-bd5a-4897-bff8-4b67ab9493d3 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:41.775363 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-c220d1bb-bd5a-4897-bff8-4b67ab9493d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:41.783559 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1180/2359] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:41:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:41.787649 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ad787-338c-44f1-87a7-2ddedc997a1f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:41.798321 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ad787-338c-44f1-87a7-2ddedc997a1f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:41.803011 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10806be3-4947-4a33-9a2b-545ba8f9b8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:41.803659 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10806be3-4947-4a33-9a2b-545ba8f9b8b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:41.803940 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10806be3-4947-4a33-9a2b-545ba8f9b8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:41.804213 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10806be3-4947-4a33-9a2b-545ba8f9b8b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:41.804968 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10806be3-4947-4a33-9a2b-545ba8f9b8b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:41:41.805325 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10806be3-4947-4a33-9a2b-545ba8f9b8b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:41.806955 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10806be3-4947-4a33-9a2b-545ba8f9b8b5 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:41.818580 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1180/2360] 10.222.0.16 () {58 vars in 1152 bytes} [Thu May 26 12:41:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:41:41.822720 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c220d1bb-bd5a-4897-bff8-4b67ab9493d3 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:41.832076 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c220d1bb-bd5a-4897-bff8-4b67ab9493d3 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:41.837303 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3467eb49-44fa-45b5-b962-1912250d3741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:41.837940 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3467eb49-44fa-45b5-b962-1912250d3741 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:41.838222 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3467eb49-44fa-45b5-b962-1912250d3741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:41.838497 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3467eb49-44fa-45b5-b962-1912250d3741 admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:41.839192 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3467eb49-44fa-45b5-b962-1912250d3741 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:41.841118 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3467eb49-44fa-45b5-b962-1912250d3741 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:41.866701 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1181/2361] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:41:41 2022] POST /identity/v3/projects => generated 379 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:41:41.870755 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10806be3-4947-4a33-9a2b-545ba8f9b8b5 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:41.880958 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10806be3-4947-4a33-9a2b-545ba8f9b8b5 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:41.927319 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:41.938329 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee0b9f-3a8e-4571-835c-4a8d2714011e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:41.939025 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee0b9f-3a8e-4571-835c-4a8d2714011e admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:41.939308 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee0b9f-3a8e-4571-835c-4a8d2714011e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:41.939581 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee0b9f-3a8e-4571-835c-4a8d2714011e admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:41.940274 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ee0b9f-3a8e-4571-835c-4a8d2714011e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:41.942239 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ee0b9f-3a8e-4571-835c-4a8d2714011e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:41.964671 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1181/2362] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:41:41 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:41:41.968915 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3467eb49-44fa-45b5-b962-1912250d3741 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:41.979272 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3467eb49-44fa-45b5-b962-1912250d3741 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:41.985792 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28079af7-7220-461c-b441-b86c4823f417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:41.986447 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28079af7-7220-461c-b441-b86c4823f417 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:41.986728 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28079af7-7220-461c-b441-b86c4823f417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:41.987000 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28079af7-7220-461c-b441-b86c4823f417 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:41.987723 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28079af7-7220-461c-b441-b86c4823f417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:41.989356 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28079af7-7220-461c-b441-b86c4823f417 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:42.001464 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1182/2363] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:41:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:41:42.005726 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee0b9f-3a8e-4571-835c-4a8d2714011e admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:42.016600 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee0b9f-3a8e-4571-835c-4a8d2714011e admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:42.021526 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c465814b-ebef-47bc-ad3d-4746b7784d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:42.022181 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c465814b-ebef-47bc-ad3d-4746b7784d09 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:42.022468 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c465814b-ebef-47bc-ad3d-4746b7784d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:42.022741 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c465814b-ebef-47bc-ad3d-4746b7784d09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:42.023461 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c465814b-ebef-47bc-ad3d-4746b7784d09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:42.025686 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c465814b-ebef-47bc-ad3d-4746b7784d09 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:42.038450 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1182/2364] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:41:42.042953 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28079af7-7220-461c-b441-b86c4823f417 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:42.049584 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:42.053840 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28079af7-7220-461c-b441-b86c4823f417 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:42.060241 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4893c1-c81a-459e-92b4-bb02dbec2a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:42.061386 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4893c1-c81a-459e-92b4-bb02dbec2a17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:42.061620 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4893c1-c81a-459e-92b4-bb02dbec2a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:42.062103 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4893c1-c81a-459e-92b4-bb02dbec2a17 admin admin] PATH_INFO: `/v3/projects/5b9e974faa624070b0a48cf41ca50987/users/ea141794eee742bd864811a68156eea9/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:42.079380 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4893c1-c81a-459e-92b4-bb02dbec2a17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b9e974faa624070b0a48cf41ca50987, user_id=ea141794eee742bd864811a68156eea9, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:42.082648 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4893c1-c81a-459e-92b4-bb02dbec2a17 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:42.097747 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1183/2365] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:41:42 2022] PUT /identity/v3/projects/5b9e974faa624070b0a48cf41ca50987/users/ea141794eee742bd864811a68156eea9/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:42.108202 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb97d4-68d7-45cd-a9d7-d8e2411430b2 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:42.108487 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb97d4-68d7-45cd-a9d7-d8e2411430b2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:42.108788 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb97d4-68d7-45cd-a9d7-d8e2411430b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:42.137032 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-2beb97d4-68d7-45cd-a9d7-d8e2411430b2 None None] MFA Rules not processed for user `ea141794eee742bd864811a68156eea9`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:42.138260 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2beb97d4-68d7-45cd-a9d7-d8e2411430b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:42.205451 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1183/2366] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:41:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:42.209974 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4893c1-c81a-459e-92b4-bb02dbec2a17 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:42.275006 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4893c1-c81a-459e-92b4-bb02dbec2a17 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:42.279852 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd56034f-a13b-465e-a938-c7c1097dc798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:42.280509 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56034f-a13b-465e-a938-c7c1097dc798 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:42.280785 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56034f-a13b-465e-a938-c7c1097dc798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:42.281087 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56034f-a13b-465e-a938-c7c1097dc798 admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:42.281785 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd56034f-a13b-465e-a938-c7c1097dc798 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:42.283683 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd56034f-a13b-465e-a938-c7c1097dc798 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:42.310187 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1184/2367] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:41:42 2022] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:41:42.314211 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb97d4-68d7-45cd-a9d7-d8e2411430b2 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:42.326810 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb97d4-68d7-45cd-a9d7-d8e2411430b2 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:42.384751 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d2e8b-d0b7-48d6-a43a-5da6285be4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:42.385370 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d2e8b-d0b7-48d6-a43a-5da6285be4c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:42.385654 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d2e8b-d0b7-48d6-a43a-5da6285be4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:42.385928 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d2e8b-d0b7-48d6-a43a-5da6285be4c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:42.386625 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552d2e8b-d0b7-48d6-a43a-5da6285be4c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:42.388575 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552d2e8b-d0b7-48d6-a43a-5da6285be4c7 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:42.413214 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1184/2368] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:41:42 2022] POST /identity/v3/users => generated 297 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:41:42.417448 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd56034f-a13b-465e-a938-c7c1097dc798 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:42.427782 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd56034f-a13b-465e-a938-c7c1097dc798 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:42.433062 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c33e2-386f-498c-92a6-5e4214555c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:42.433710 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c33e2-386f-498c-92a6-5e4214555c30 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:42.433990 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c33e2-386f-498c-92a6-5e4214555c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:42.434262 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c33e2-386f-498c-92a6-5e4214555c30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:42.434990 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c33e2-386f-498c-92a6-5e4214555c30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:42.436617 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c33e2-386f-498c-92a6-5e4214555c30 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:42.448061 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1185/2369] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:41:42.452380 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d2e8b-d0b7-48d6-a43a-5da6285be4c7 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:42.462552 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d2e8b-d0b7-48d6-a43a-5da6285be4c7 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:42.467339 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb68758c-56b8-49fd-ae26-b4e04545fbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:42.468220 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68758c-56b8-49fd-ae26-b4e04545fbeb admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:42.468499 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68758c-56b8-49fd-ae26-b4e04545fbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:42.468773 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68758c-56b8-49fd-ae26-b4e04545fbeb admin admin] PATH_INFO: `/v3/projects/32e7fe9231a94eefbab574d02bf2f082/users/30d94d27df7f4a91abb199d7e6e10d11/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:42.483600 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb68758c-56b8-49fd-ae26-b4e04545fbeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=32e7fe9231a94eefbab574d02bf2f082, user_id=30d94d27df7f4a91abb199d7e6e10d11, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:42.486326 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb68758c-56b8-49fd-ae26-b4e04545fbeb admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:42.502185 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1185/2370] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:41:42 2022] PUT /identity/v3/projects/32e7fe9231a94eefbab574d02bf2f082/users/30d94d27df7f4a91abb199d7e6e10d11/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:42.506312 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c33e2-386f-498c-92a6-5e4214555c30 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:42.518014 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c33e2-386f-498c-92a6-5e4214555c30 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:42.575590 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a941911-3bf7-4e2c-b428-a12f4a1b3af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:42.576252 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a941911-3bf7-4e2c-b428-a12f4a1b3af3 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:42.576534 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a941911-3bf7-4e2c-b428-a12f4a1b3af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:42.576805 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a941911-3bf7-4e2c-b428-a12f4a1b3af3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:42.577558 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a941911-3bf7-4e2c-b428-a12f4a1b3af3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:42.579144 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a941911-3bf7-4e2c-b428-a12f4a1b3af3 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:42.589203 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1186/2371] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:41:42.593588 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb68758c-56b8-49fd-ae26-b4e04545fbeb admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:42.604788 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb68758c-56b8-49fd-ae26-b4e04545fbeb admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:42.610622 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aafaf2-11a9-4a86-8e96-419189c63a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:42.611544 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aafaf2-11a9-4a86-8e96-419189c63a22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:42.611831 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aafaf2-11a9-4a86-8e96-419189c63a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:42.612109 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aafaf2-11a9-4a86-8e96-419189c63a22 admin admin] PATH_INFO: `/v3/projects/32e7fe9231a94eefbab574d02bf2f082/users/30d94d27df7f4a91abb199d7e6e10d11/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:42.614114 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aafaf2-11a9-4a86-8e96-419189c63a22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32e7fe9231a94eefbab574d02bf2f082, user_id=30d94d27df7f4a91abb199d7e6e10d11, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:42.616798 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aafaf2-11a9-4a86-8e96-419189c63a22 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:42.628379 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1186/2372] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:41:42 2022] PUT /identity/v3/projects/32e7fe9231a94eefbab574d02bf2f082/users/30d94d27df7f4a91abb199d7e6e10d11/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:42.641702 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b764ac3-9706-4526-910b-7ae111ae1001 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:42.641917 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b764ac3-9706-4526-910b-7ae111ae1001 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:42.642219 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b764ac3-9706-4526-910b-7ae111ae1001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:42.669464 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-1b764ac3-9706-4526-910b-7ae111ae1001 None None] MFA Rules not processed for user `30d94d27df7f4a91abb199d7e6e10d11`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:42.670676 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-1b764ac3-9706-4526-910b-7ae111ae1001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:42.712096 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:42.741928 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1187/2373] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:41:42 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:42.774597 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aafaf2-11a9-4a86-8e96-419189c63a22 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:42.776669 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-64aafaf2-11a9-4a86-8e96-419189c63a22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:42.794119 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:42.849931 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aafaf2-11a9-4a86-8e96-419189c63a22 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:42.853946 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a06aa-c53f-491d-97bb-75c33647bd01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:42.854634 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a06aa-c53f-491d-97bb-75c33647bd01 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:42.854951 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a06aa-c53f-491d-97bb-75c33647bd01 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:42.855235 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a06aa-c53f-491d-97bb-75c33647bd01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:42.865332 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857a06aa-c53f-491d-97bb-75c33647bd01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:42.866955 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857a06aa-c53f-491d-97bb-75c33647bd01 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:42.877826 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1187/2374] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:41:42 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:41:43.210855 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b764ac3-9706-4526-910b-7ae111ae1001 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:43.222444 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b764ac3-9706-4526-910b-7ae111ae1001 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:43.228432 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1d0aaf-539e-4b34-a6de-99b822029f5e tempest-VolumeQuotaClassesTest-2032267832 tempest-VolumeQuotaClassesTest-2032267832-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d94d27df7f4a91abb199d7e6e10d11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32e7fe9231a94eefbab574d02bf2f082', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:43.229263 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d0aaf-539e-4b34-a6de-99b822029f5e tempest-VolumeQuotaClassesTest-2032267832 tempest-VolumeQuotaClassesTest-2032267832-project-admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:43.229631 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d0aaf-539e-4b34-a6de-99b822029f5e tempest-VolumeQuotaClassesTest-2032267832 tempest-VolumeQuotaClassesTest-2032267832-project-admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:43.229918 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d0aaf-539e-4b34-a6de-99b822029f5e tempest-VolumeQuotaClassesTest-2032267832 tempest-VolumeQuotaClassesTest-2032267832-project-admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:43.230743 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1d0aaf-539e-4b34-a6de-99b822029f5e tempest-VolumeQuotaClassesTest-2032267832 tempest-VolumeQuotaClassesTest-2032267832-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:41:43.231144 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1d0aaf-539e-4b34-a6de-99b822029f5e tempest-VolumeQuotaClassesTest-2032267832 tempest-VolumeQuotaClassesTest-2032267832-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:43.232974 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1d0aaf-539e-4b34-a6de-99b822029f5e tempest-VolumeQuotaClassesTest-2032267832 tempest-VolumeQuotaClassesTest-2032267832-project-admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:43.246609 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1188/2375] 10.222.0.16 () {58 vars in 1152 bytes} [Thu May 26 12:41:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:41:43.251113 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a06aa-c53f-491d-97bb-75c33647bd01 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:43.260355 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a06aa-c53f-491d-97bb-75c33647bd01 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:43.264977 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c86abd-dee3-4f85-92ba-f4db78a35fe9 tempest-VolumeQuotaClassesTest-2032267832 tempest-VolumeQuotaClassesTest-2032267832-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d94d27df7f4a91abb199d7e6e10d11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32e7fe9231a94eefbab574d02bf2f082', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:43.265626 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c86abd-dee3-4f85-92ba-f4db78a35fe9 tempest-VolumeQuotaClassesTest-2032267832 tempest-VolumeQuotaClassesTest-2032267832-project-admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:43.265913 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c86abd-dee3-4f85-92ba-f4db78a35fe9 tempest-VolumeQuotaClassesTest-2032267832 tempest-VolumeQuotaClassesTest-2032267832-project-admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:43.266194 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c86abd-dee3-4f85-92ba-f4db78a35fe9 tempest-VolumeQuotaClassesTest-2032267832 tempest-VolumeQuotaClassesTest-2032267832-project-admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:43.266886 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c86abd-dee3-4f85-92ba-f4db78a35fe9 tempest-VolumeQuotaClassesTest-2032267832 tempest-VolumeQuotaClassesTest-2032267832-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:43.268807 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c86abd-dee3-4f85-92ba-f4db78a35fe9 tempest-VolumeQuotaClassesTest-2032267832 tempest-VolumeQuotaClassesTest-2032267832-project-admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:43.295591 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1188/2376] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:41:43 2022] POST /identity/v3/projects => generated 353 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:41:43.299826 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1d0aaf-539e-4b34-a6de-99b822029f5e tempest-VolumeQuotaClassesTest-2032267832 tempest-VolumeQuotaClassesTest-2032267832-project-admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:43.310325 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1d0aaf-539e-4b34-a6de-99b822029f5e tempest-VolumeQuotaClassesTest-2032267832 tempest-VolumeQuotaClassesTest-2032267832-project-admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:43.371639 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21383251-6208-4740-986e-1466a820506a tempest-VolumeQuotaClassesTest-2032267832 tempest-VolumeQuotaClassesTest-2032267832-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d94d27df7f4a91abb199d7e6e10d11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32e7fe9231a94eefbab574d02bf2f082', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:43.372296 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21383251-6208-4740-986e-1466a820506a tempest-VolumeQuotaClassesTest-2032267832 tempest-VolumeQuotaClassesTest-2032267832-project-admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:43.372584 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21383251-6208-4740-986e-1466a820506a tempest-VolumeQuotaClassesTest-2032267832 tempest-VolumeQuotaClassesTest-2032267832-project-admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:43.372886 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21383251-6208-4740-986e-1466a820506a tempest-VolumeQuotaClassesTest-2032267832 tempest-VolumeQuotaClassesTest-2032267832-project-admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:43.373616 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21383251-6208-4740-986e-1466a820506a tempest-VolumeQuotaClassesTest-2032267832 tempest-VolumeQuotaClassesTest-2032267832-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:41:43.373925 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21383251-6208-4740-986e-1466a820506a tempest-VolumeQuotaClassesTest-2032267832 tempest-VolumeQuotaClassesTest-2032267832-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:43.375798 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21383251-6208-4740-986e-1466a820506a tempest-VolumeQuotaClassesTest-2032267832 tempest-VolumeQuotaClassesTest-2032267832-project-admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:43.388712 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1189/2377] 10.222.0.16 () {58 vars in 1152 bytes} [Thu May 26 12:41:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:41:43.423478 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c86abd-dee3-4f85-92ba-f4db78a35fe9 tempest-VolumeQuotaClassesTest-2032267832 tempest-VolumeQuotaClassesTest-2032267832-project-admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:43.434361 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c86abd-dee3-4f85-92ba-f4db78a35fe9 tempest-VolumeQuotaClassesTest-2032267832 tempest-VolumeQuotaClassesTest-2032267832-project-admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:43.439395 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7078bfa-b5da-4383-8d66-9b3840a0cf62 tempest-VolumeQuotaClassesTest-2032267832 tempest-VolumeQuotaClassesTest-2032267832-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d94d27df7f4a91abb199d7e6e10d11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32e7fe9231a94eefbab574d02bf2f082', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:43.440701 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7078bfa-b5da-4383-8d66-9b3840a0cf62 tempest-VolumeQuotaClassesTest-2032267832 tempest-VolumeQuotaClassesTest-2032267832-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:43.441058 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7078bfa-b5da-4383-8d66-9b3840a0cf62 tempest-VolumeQuotaClassesTest-2032267832 tempest-VolumeQuotaClassesTest-2032267832-project-admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:43.441343 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7078bfa-b5da-4383-8d66-9b3840a0cf62 tempest-VolumeQuotaClassesTest-2032267832 tempest-VolumeQuotaClassesTest-2032267832-project-admin] PATH_INFO: `/v3/projects/77215271ec59448db355f67426f360e9` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:43.442579 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7078bfa-b5da-4383-8d66-9b3840a0cf62 tempest-VolumeQuotaClassesTest-2032267832 tempest-VolumeQuotaClassesTest-2032267832-project-admin] RBAC: Authorizing `identity:delete_project(project_id=77215271ec59448db355f67426f360e9)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:43.444528 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7078bfa-b5da-4383-8d66-9b3840a0cf62 tempest-VolumeQuotaClassesTest-2032267832 tempest-VolumeQuotaClassesTest-2032267832-project-admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:43.491506 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c7078bfa-b5da-4383-8d66-9b3840a0cf62 tempest-VolumeQuotaClassesTest-2032267832 tempest-VolumeQuotaClassesTest-2032267832-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77215271ec59448db355f67426f360e9', 'request_id': 'req-c7078bfa-b5da-4383-8d66-9b3840a0cf62'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:43.497577 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c7078bfa-b5da-4383-8d66-9b3840a0cf62 tempest-VolumeQuotaClassesTest-2032267832 tempest-VolumeQuotaClassesTest-2032267832-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77215271ec59448db355f67426f360e9', 'request_id': 'req-c7078bfa-b5da-4383-8d66-9b3840a0cf62'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:43.504439 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c7078bfa-b5da-4383-8d66-9b3840a0cf62 tempest-VolumeQuotaClassesTest-2032267832 tempest-VolumeQuotaClassesTest-2032267832-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77215271ec59448db355f67426f360e9', 'request_id': 'req-c7078bfa-b5da-4383-8d66-9b3840a0cf62'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:43.517416 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c7078bfa-b5da-4383-8d66-9b3840a0cf62 tempest-VolumeQuotaClassesTest-2032267832 tempest-VolumeQuotaClassesTest-2032267832-project-admin] The token cache is being invalidate because project 77215271ec59448db355f67426f360e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:41:43.517705 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c7078bfa-b5da-4383-8d66-9b3840a0cf62 tempest-VolumeQuotaClassesTest-2032267832 tempest-VolumeQuotaClassesTest-2032267832-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:43.518355 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c7078bfa-b5da-4383-8d66-9b3840a0cf62 tempest-VolumeQuotaClassesTest-2032267832 tempest-VolumeQuotaClassesTest-2032267832-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:43.520347 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1189/2378] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:41:43 2022] DELETE /identity/v3/projects/77215271ec59448db355f67426f360e9 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:43.708910 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21383251-6208-4740-986e-1466a820506a tempest-VolumeQuotaClassesTest-2032267832 tempest-VolumeQuotaClassesTest-2032267832-project-admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:43.710772 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-21383251-6208-4740-986e-1466a820506a tempest-VolumeQuotaClassesTest-2032267832 tempest-VolumeQuotaClassesTest-2032267832-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:43.778490 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21383251-6208-4740-986e-1466a820506a tempest-VolumeQuotaClassesTest-2032267832 tempest-VolumeQuotaClassesTest-2032267832-project-admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:43.834012 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb5b02-820e-4eb4-b4f8-5633427355d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:43.834882 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb5b02-820e-4eb4-b4f8-5633427355d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:43.835165 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb5b02-820e-4eb4-b4f8-5633427355d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:43.835439 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb5b02-820e-4eb4-b4f8-5633427355d1 admin admin] PATH_INFO: `/v3/users/ea141794eee742bd864811a68156eea9` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:43.836644 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fb5b02-820e-4eb4-b4f8-5633427355d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea141794eee742bd864811a68156eea9)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:43.838602 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fb5b02-820e-4eb4-b4f8-5633427355d1 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:43.843132 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:43.885880 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-f6fb5b02-820e-4eb4-b4f8-5633427355d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea141794eee742bd864811a68156eea9'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:43.886537 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-f6fb5b02-820e-4eb4-b4f8-5633427355d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea141794eee742bd864811a68156eea9'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:43.887274 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-f6fb5b02-820e-4eb4-b4f8-5633427355d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea141794eee742bd864811a68156eea9'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:43.895076 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-f6fb5b02-820e-4eb4-b4f8-5633427355d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea141794eee742bd864811a68156eea9'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:43.907543 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-f6fb5b02-820e-4eb4-b4f8-5633427355d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea141794eee742bd864811a68156eea9'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:43.919831 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1190/2379] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:41:43 2022] DELETE /identity/v3/users/ea141794eee742bd864811a68156eea9 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:43.924584 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c14e5-9c1f-4925-9a71-3c6d6cbc278e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:43.925120 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c14e5-9c1f-4925-9a71-3c6d6cbc278e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:43.925216 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c14e5-9c1f-4925-9a71-3c6d6cbc278e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:43.942936 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-df7c14e5-9c1f-4925-9a71-3c6d6cbc278e None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:43.944075 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-df7c14e5-9c1f-4925-9a71-3c6d6cbc278e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:44.004359 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1190/2380] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:41:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:44.015136 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb5b02-820e-4eb4-b4f8-5633427355d1 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:44.016541 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-f6fb5b02-820e-4eb4-b4f8-5633427355d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:44.077360 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb5b02-820e-4eb4-b4f8-5633427355d1 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:44.081216 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f90f1-a21c-4296-885c-a527046ec9da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:44.081865 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f90f1-a21c-4296-885c-a527046ec9da service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:44.082141 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f90f1-a21c-4296-885c-a527046ec9da service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:44.082412 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f90f1-a21c-4296-885c-a527046ec9da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:44.091797 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5f90f1-a21c-4296-885c-a527046ec9da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:44.093257 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5f90f1-a21c-4296-885c-a527046ec9da service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:44.102927 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1191/2381] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:41:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:41:44.375186 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c14e5-9c1f-4925-9a71-3c6d6cbc278e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:44.378042 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-df7c14e5-9c1f-4925-9a71-3c6d6cbc278e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:44.389943 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c14e5-9c1f-4925-9a71-3c6d6cbc278e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:44.394656 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d95d1-f103-407e-95f3-9fee42f316b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:44.395597 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d95d1-f103-407e-95f3-9fee42f316b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:44.395952 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d95d1-f103-407e-95f3-9fee42f316b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:44.396318 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d95d1-f103-407e-95f3-9fee42f316b4 admin admin] PATH_INFO: `/v3/projects/5b9e974faa624070b0a48cf41ca50987` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:44.397613 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157d95d1-f103-407e-95f3-9fee42f316b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b9e974faa624070b0a48cf41ca50987)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:44.399826 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157d95d1-f103-407e-95f3-9fee42f316b4 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:44.411490 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:44.452375 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-157d95d1-f103-407e-95f3-9fee42f316b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b9e974faa624070b0a48cf41ca50987', 'request_id': 'req-157d95d1-f103-407e-95f3-9fee42f316b4'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:44.457744 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-157d95d1-f103-407e-95f3-9fee42f316b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b9e974faa624070b0a48cf41ca50987', 'request_id': 'req-157d95d1-f103-407e-95f3-9fee42f316b4'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:44.463910 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-157d95d1-f103-407e-95f3-9fee42f316b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b9e974faa624070b0a48cf41ca50987', 'request_id': 'req-157d95d1-f103-407e-95f3-9fee42f316b4'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:44.478023 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-157d95d1-f103-407e-95f3-9fee42f316b4 admin admin] The token cache is being invalidate because project 5b9e974faa624070b0a48cf41ca50987 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:41:44.478310 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-157d95d1-f103-407e-95f3-9fee42f316b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:44.478935 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-157d95d1-f103-407e-95f3-9fee42f316b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:44.480516 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1191/2382] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:41:44 2022] DELETE /identity/v3/projects/5b9e974faa624070b0a48cf41ca50987 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:44.484502 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f90f1-a21c-4296-885c-a527046ec9da service neutron] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:44.494938 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f90f1-a21c-4296-885c-a527046ec9da service neutron] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:44.553504 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934883f5-e8d7-4244-aea6-e41a55504d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:44.554376 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934883f5-e8d7-4244-aea6-e41a55504d8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:44.554659 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934883f5-e8d7-4244-aea6-e41a55504d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:44.554932 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934883f5-e8d7-4244-aea6-e41a55504d8d admin admin] PATH_INFO: `/v3/users/30d94d27df7f4a91abb199d7e6e10d11` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:44.556689 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934883f5-e8d7-4244-aea6-e41a55504d8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=30d94d27df7f4a91abb199d7e6e10d11)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:44.558664 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934883f5-e8d7-4244-aea6-e41a55504d8d admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:44.587465 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:44.607232 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-934883f5-e8d7-4244-aea6-e41a55504d8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30d94d27df7f4a91abb199d7e6e10d11'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:44.607896 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-934883f5-e8d7-4244-aea6-e41a55504d8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30d94d27df7f4a91abb199d7e6e10d11'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:44.608520 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-934883f5-e8d7-4244-aea6-e41a55504d8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30d94d27df7f4a91abb199d7e6e10d11'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:44.615871 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-934883f5-e8d7-4244-aea6-e41a55504d8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30d94d27df7f4a91abb199d7e6e10d11'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:44.628568 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-934883f5-e8d7-4244-aea6-e41a55504d8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30d94d27df7f4a91abb199d7e6e10d11'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:44.640746 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1192/2383] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:41:44 2022] DELETE /identity/v3/users/30d94d27df7f4a91abb199d7e6e10d11 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:44.917480 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d95d1-f103-407e-95f3-9fee42f316b4 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:44.919046 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-157d95d1-f103-407e-95f3-9fee42f316b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:44.933769 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d95d1-f103-407e-95f3-9fee42f316b4 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:44.991717 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851085c-449d-44a5-a1af-249dc0ffb9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:44.992609 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851085c-449d-44a5-a1af-249dc0ffb9a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:44.993464 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851085c-449d-44a5-a1af-249dc0ffb9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:44.993745 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851085c-449d-44a5-a1af-249dc0ffb9a6 admin admin] PATH_INFO: `/v3/projects/32e7fe9231a94eefbab574d02bf2f082` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:44.994971 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7851085c-449d-44a5-a1af-249dc0ffb9a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32e7fe9231a94eefbab574d02bf2f082)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:44.996966 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7851085c-449d-44a5-a1af-249dc0ffb9a6 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:45.045583 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7851085c-449d-44a5-a1af-249dc0ffb9a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32e7fe9231a94eefbab574d02bf2f082', 'request_id': 'req-7851085c-449d-44a5-a1af-249dc0ffb9a6'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:45.051068 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7851085c-449d-44a5-a1af-249dc0ffb9a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32e7fe9231a94eefbab574d02bf2f082', 'request_id': 'req-7851085c-449d-44a5-a1af-249dc0ffb9a6'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:45.057310 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7851085c-449d-44a5-a1af-249dc0ffb9a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32e7fe9231a94eefbab574d02bf2f082', 'request_id': 'req-7851085c-449d-44a5-a1af-249dc0ffb9a6'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:45.070077 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7851085c-449d-44a5-a1af-249dc0ffb9a6 admin admin] The token cache is being invalidate because project 32e7fe9231a94eefbab574d02bf2f082 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:41:45.070366 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7851085c-449d-44a5-a1af-249dc0ffb9a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:45.071507 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7851085c-449d-44a5-a1af-249dc0ffb9a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:45.073097 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1192/2384] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:41:44 2022] DELETE /identity/v3/projects/32e7fe9231a94eefbab574d02bf2f082 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:45.078072 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0401445-f27e-4298-b345-d05bfc2ced85 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:45.078552 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0401445-f27e-4298-b345-d05bfc2ced85 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:45.078642 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0401445-f27e-4298-b345-d05bfc2ced85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:45.097904 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-b0401445-f27e-4298-b345-d05bfc2ced85 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:45.099113 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-b0401445-f27e-4298-b345-d05bfc2ced85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:45.166530 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1193/2385] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:41:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:41:45.174273 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146837d7-9f4d-4c88-8b0a-f158727c460e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:45.174560 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146837d7-9f4d-4c88-8b0a-f158727c460e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:45.174838 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146837d7-9f4d-4c88-8b0a-f158727c460e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:45.193082 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-146837d7-9f4d-4c88-8b0a-f158727c460e None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:45.194288 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-146837d7-9f4d-4c88-8b0a-f158727c460e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:45.202829 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1193/2386] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:41:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:45.207184 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0401445-f27e-4298-b345-d05bfc2ced85 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:45.217398 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0401445-f27e-4298-b345-d05bfc2ced85 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:45.222032 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67aca7f-d147-462f-8be5-a672ce716d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:45.222677 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67aca7f-d147-462f-8be5-a672ce716d1e admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:45.222960 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67aca7f-d147-462f-8be5-a672ce716d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:45.223236 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67aca7f-d147-462f-8be5-a672ce716d1e admin admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:45.223956 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67aca7f-d147-462f-8be5-a672ce716d1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:41:45.224259 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67aca7f-d147-462f-8be5-a672ce716d1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:45.225881 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67aca7f-d147-462f-8be5-a672ce716d1e admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:45.238624 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1194/2387] 10.222.0.16 () {58 vars in 1152 bytes} [Thu May 26 12:41:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:41:45.243787 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146837d7-9f4d-4c88-8b0a-f158727c460e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:45.253346 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146837d7-9f4d-4c88-8b0a-f158727c460e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:45.258295 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a60c59-a564-46a5-a700-54fcf2771c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:45.258951 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a60c59-a564-46a5-a700-54fcf2771c92 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:45.259232 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a60c59-a564-46a5-a700-54fcf2771c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:45.259498 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a60c59-a564-46a5-a700-54fcf2771c92 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:45.260193 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a60c59-a564-46a5-a700-54fcf2771c92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:45.262187 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a60c59-a564-46a5-a700-54fcf2771c92 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:45.281703 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:45.292411 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1194/2388] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:41:45 2022] POST /identity/v3/projects => generated 389 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:41:45.293815 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67aca7f-d147-462f-8be5-a672ce716d1e admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:45.303791 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67aca7f-d147-462f-8be5-a672ce716d1e admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:45.365037 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f6321b-ff1c-41fd-a8cf-a4522ac9dbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:45.365706 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f6321b-ff1c-41fd-a8cf-a4522ac9dbb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:45.365993 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f6321b-ff1c-41fd-a8cf-a4522ac9dbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:45.366272 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f6321b-ff1c-41fd-a8cf-a4522ac9dbb8 admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:45.366973 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f6321b-ff1c-41fd-a8cf-a4522ac9dbb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:45.368931 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f6321b-ff1c-41fd-a8cf-a4522ac9dbb8 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:45.387662 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1195/2389] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:41:45 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:41:45.391798 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a60c59-a564-46a5-a700-54fcf2771c92 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:45.402984 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a60c59-a564-46a5-a700-54fcf2771c92 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:45.407621 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa0d5e6-7f63-42ab-ae8d-b8aff085ba17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:45.408273 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa0d5e6-7f63-42ab-ae8d-b8aff085ba17 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:45.408585 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa0d5e6-7f63-42ab-ae8d-b8aff085ba17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:45.408879 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa0d5e6-7f63-42ab-ae8d-b8aff085ba17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:45.409603 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa0d5e6-7f63-42ab-ae8d-b8aff085ba17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:45.411198 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa0d5e6-7f63-42ab-ae8d-b8aff085ba17 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:45.423333 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1195/2390] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:41:45.427426 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f6321b-ff1c-41fd-a8cf-a4522ac9dbb8 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:45.437506 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f6321b-ff1c-41fd-a8cf-a4522ac9dbb8 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:45.442161 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f56f76-b299-4ce0-9f01-afededea9ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:45.442821 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f56f76-b299-4ce0-9f01-afededea9ea9 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:45.443108 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f56f76-b299-4ce0-9f01-afededea9ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:45.443389 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f56f76-b299-4ce0-9f01-afededea9ea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:45.444114 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f56f76-b299-4ce0-9f01-afededea9ea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:45.445769 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f56f76-b299-4ce0-9f01-afededea9ea9 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:45.457047 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1196/2391] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:41:45.461338 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa0d5e6-7f63-42ab-ae8d-b8aff085ba17 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:45.472427 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa0d5e6-7f63-42ab-ae8d-b8aff085ba17 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:45.477888 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c3bacc-e62a-4920-9757-22644ba6d205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:45.478777 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3bacc-e62a-4920-9757-22644ba6d205 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:45.479076 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3bacc-e62a-4920-9757-22644ba6d205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:45.479338 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3bacc-e62a-4920-9757-22644ba6d205 admin admin] PATH_INFO: `/v3/projects/2775dfef1dd348f0af0c460661aa9a8c/users/9cb196024e9e4aca9363910f836b0e3f/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:45.494157 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c3bacc-e62a-4920-9757-22644ba6d205 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2775dfef1dd348f0af0c460661aa9a8c, user_id=9cb196024e9e4aca9363910f836b0e3f, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:45.496760 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c3bacc-e62a-4920-9757-22644ba6d205 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:45.509829 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1196/2392] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:41:45 2022] PUT /identity/v3/projects/2775dfef1dd348f0af0c460661aa9a8c/users/9cb196024e9e4aca9363910f836b0e3f/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:45.520433 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d93141-7f84-4a20-94fe-a81f2b013c58 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:45.520721 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d93141-7f84-4a20-94fe-a81f2b013c58 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:45.521048 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d93141-7f84-4a20-94fe-a81f2b013c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:45.541058 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:45.550891 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-11d93141-7f84-4a20-94fe-a81f2b013c58 None None] MFA Rules not processed for user `9cb196024e9e4aca9363910f836b0e3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:45.552903 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-11d93141-7f84-4a20-94fe-a81f2b013c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:45.617472 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1197/2393] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:41:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:45.622677 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c3bacc-e62a-4920-9757-22644ba6d205 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:45.684551 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c3bacc-e62a-4920-9757-22644ba6d205 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:45.689281 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f222f-cf0b-4cfd-b7dc-274191a43568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:45.689938 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f222f-cf0b-4cfd-b7dc-274191a43568 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:45.690221 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f222f-cf0b-4cfd-b7dc-274191a43568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:45.690495 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f222f-cf0b-4cfd-b7dc-274191a43568 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:45.691185 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238f222f-cf0b-4cfd-b7dc-274191a43568 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:45.693134 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238f222f-cf0b-4cfd-b7dc-274191a43568 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:45.719667 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1197/2394] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:41:45 2022] POST /identity/v3/projects => generated 389 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:41:45.724752 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d93141-7f84-4a20-94fe-a81f2b013c58 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:45.739159 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d93141-7f84-4a20-94fe-a81f2b013c58 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:45.797846 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086bbde-c2d7-487e-97e8-27858c0cd12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:45.798510 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086bbde-c2d7-487e-97e8-27858c0cd12b admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:45.798796 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086bbde-c2d7-487e-97e8-27858c0cd12b admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:45.799073 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086bbde-c2d7-487e-97e8-27858c0cd12b admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:45.799812 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0086bbde-c2d7-487e-97e8-27858c0cd12b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:45.801756 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0086bbde-c2d7-487e-97e8-27858c0cd12b admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:45.821932 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1198/2395] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:41:45 2022] POST /identity/v3/users => generated 301 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:41:45.826178 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f222f-cf0b-4cfd-b7dc-274191a43568 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:45.836411 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f222f-cf0b-4cfd-b7dc-274191a43568 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:45.841269 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02c585-3606-4158-9672-ac54f0932a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:45.841930 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02c585-3606-4158-9672-ac54f0932a27 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:45.842215 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02c585-3606-4158-9672-ac54f0932a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:45.842514 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02c585-3606-4158-9672-ac54f0932a27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:45.843222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f02c585-3606-4158-9672-ac54f0932a27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:45.844912 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f02c585-3606-4158-9672-ac54f0932a27 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:45.855930 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1198/2396] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:41:45.859972 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086bbde-c2d7-487e-97e8-27858c0cd12b admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:45.870243 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086bbde-c2d7-487e-97e8-27858c0cd12b admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:45.875060 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128517b1-d26d-48fa-ad8d-849eca53c5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:45.875920 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128517b1-d26d-48fa-ad8d-849eca53c5c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:45.876203 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128517b1-d26d-48fa-ad8d-849eca53c5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:45.876480 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128517b1-d26d-48fa-ad8d-849eca53c5c7 admin admin] PATH_INFO: `/v3/projects/bee40791a24248a49e3dec8de32553a0/users/bed9cdace14d4a78bbd6df706d5b2bb7/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:45.891591 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128517b1-d26d-48fa-ad8d-849eca53c5c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bee40791a24248a49e3dec8de32553a0, user_id=bed9cdace14d4a78bbd6df706d5b2bb7, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:45.894305 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128517b1-d26d-48fa-ad8d-849eca53c5c7 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:45.907716 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1199/2397] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:41:45 2022] PUT /identity/v3/projects/bee40791a24248a49e3dec8de32553a0/users/bed9cdace14d4a78bbd6df706d5b2bb7/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:41:45.911616 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02c585-3606-4158-9672-ac54f0932a27 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:45.921440 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02c585-3606-4158-9672-ac54f0932a27 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:45.977481 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a72895c-6a1d-4317-8207-eed8db4c72b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:45.978161 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72895c-6a1d-4317-8207-eed8db4c72b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:45.978427 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72895c-6a1d-4317-8207-eed8db4c72b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:45.978886 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72895c-6a1d-4317-8207-eed8db4c72b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:45.979435 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a72895c-6a1d-4317-8207-eed8db4c72b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:45.981065 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a72895c-6a1d-4317-8207-eed8db4c72b8 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:45.993699 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1199/2398] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:41:45.997898 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128517b1-d26d-48fa-ad8d-849eca53c5c7 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:46.008912 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128517b1-d26d-48fa-ad8d-849eca53c5c7 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:46.013768 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708b31d-437b-45e8-9917-d9a68cc3fb0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:46.014654 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708b31d-437b-45e8-9917-d9a68cc3fb0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:46.014940 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708b31d-437b-45e8-9917-d9a68cc3fb0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:46.015225 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708b31d-437b-45e8-9917-d9a68cc3fb0c admin admin] PATH_INFO: `/v3/projects/bee40791a24248a49e3dec8de32553a0/users/bed9cdace14d4a78bbd6df706d5b2bb7/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:46.017229 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4708b31d-437b-45e8-9917-d9a68cc3fb0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bee40791a24248a49e3dec8de32553a0, user_id=bed9cdace14d4a78bbd6df706d5b2bb7, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:46.019931 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4708b31d-437b-45e8-9917-d9a68cc3fb0c admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:46.030966 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1200/2399] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:41:45 2022] PUT /identity/v3/projects/bee40791a24248a49e3dec8de32553a0/users/bed9cdace14d4a78bbd6df706d5b2bb7/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:46.042503 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4dac5c-d2bd-424f-b86f-87372d50bfc6 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:46.042800 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4dac5c-d2bd-424f-b86f-87372d50bfc6 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:46.043086 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4dac5c-d2bd-424f-b86f-87372d50bfc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:46.070919 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-4b4dac5c-d2bd-424f-b86f-87372d50bfc6 None None] MFA Rules not processed for user `bed9cdace14d4a78bbd6df706d5b2bb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:46.072616 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4b4dac5c-d2bd-424f-b86f-87372d50bfc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:46.098542 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:46.144579 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1200/2400] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:41:46 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:41:46.156487 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708b31d-437b-45e8-9917-d9a68cc3fb0c admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:46.158219 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-4708b31d-437b-45e8-9917-d9a68cc3fb0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:46.214955 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708b31d-437b-45e8-9917-d9a68cc3fb0c admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:46.218618 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5361b670-d632-4abe-b24d-3415a44eaa63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:46.219252 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361b670-d632-4abe-b24d-3415a44eaa63 service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:46.219538 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361b670-d632-4abe-b24d-3415a44eaa63 service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:46.219814 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361b670-d632-4abe-b24d-3415a44eaa63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:46.226716 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:46.229671 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5361b670-d632-4abe-b24d-3415a44eaa63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:46.231533 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5361b670-d632-4abe-b24d-3415a44eaa63 service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:46.241905 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1201/2401] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:41:46 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:41:46.371509 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4dac5c-d2bd-424f-b86f-87372d50bfc6 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:46.462217 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4dac5c-d2bd-424f-b86f-87372d50bfc6 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:46.466765 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf6d52-3bde-4c3c-838e-1d9ba997f966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:46.467668 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf6d52-3bde-4c3c-838e-1d9ba997f966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:46.467949 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf6d52-3bde-4c3c-838e-1d9ba997f966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:46.468224 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf6d52-3bde-4c3c-838e-1d9ba997f966 admin admin] PATH_INFO: `/v3/users/9cb196024e9e4aca9363910f836b0e3f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:46.469476 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bf6d52-3bde-4c3c-838e-1d9ba997f966 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cb196024e9e4aca9363910f836b0e3f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:46.471419 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bf6d52-3bde-4c3c-838e-1d9ba997f966 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:46.519114 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-96bf6d52-3bde-4c3c-838e-1d9ba997f966 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cb196024e9e4aca9363910f836b0e3f'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:46.534975 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-96bf6d52-3bde-4c3c-838e-1d9ba997f966 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cb196024e9e4aca9363910f836b0e3f'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:46.535645 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-96bf6d52-3bde-4c3c-838e-1d9ba997f966 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cb196024e9e4aca9363910f836b0e3f'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:46.536258 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-96bf6d52-3bde-4c3c-838e-1d9ba997f966 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cb196024e9e4aca9363910f836b0e3f'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:46.544050 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-96bf6d52-3bde-4c3c-838e-1d9ba997f966 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cb196024e9e4aca9363910f836b0e3f'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:46.561744 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1201/2402] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:41:46 2022] DELETE /identity/v3/users/9cb196024e9e4aca9363910f836b0e3f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:46.566386 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917bc2a-806a-4c12-884c-93967aefb693 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:46.566679 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917bc2a-806a-4c12-884c-93967aefb693 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:46.566960 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917bc2a-806a-4c12-884c-93967aefb693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:46.584280 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-f917bc2a-806a-4c12-884c-93967aefb693 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:46.585530 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-f917bc2a-806a-4c12-884c-93967aefb693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:46.647262 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1202/2403] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:41:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:46.657698 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf6d52-3bde-4c3c-838e-1d9ba997f966 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:46.659136 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-96bf6d52-3bde-4c3c-838e-1d9ba997f966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:46.709325 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:46.726316 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf6d52-3bde-4c3c-838e-1d9ba997f966 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:46.730786 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd9e3e-7f7d-4b09-bb85-5bc0d4fad534 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:46.731540 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd9e3e-7f7d-4b09-bb85-5bc0d4fad534 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:46.731925 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd9e3e-7f7d-4b09-bb85-5bc0d4fad534 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:46.732240 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd9e3e-7f7d-4b09-bb85-5bc0d4fad534 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:46.741956 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cd9e3e-7f7d-4b09-bb85-5bc0d4fad534 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:46.743959 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cd9e3e-7f7d-4b09-bb85-5bc0d4fad534 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:46.759678 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1202/2404] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:41:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:41:47.042698 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917bc2a-806a-4c12-884c-93967aefb693 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:47.044202 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-f917bc2a-806a-4c12-884c-93967aefb693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:47.063640 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917bc2a-806a-4c12-884c-93967aefb693 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:47.068418 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5245a-2e59-4080-8d3f-07fbd8b04ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:47.069317 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5245a-2e59-4080-8d3f-07fbd8b04ea7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:47.069660 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5245a-2e59-4080-8d3f-07fbd8b04ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:47.069971 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5245a-2e59-4080-8d3f-07fbd8b04ea7 admin admin] PATH_INFO: `/v3/projects/2775dfef1dd348f0af0c460661aa9a8c` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:47.071782 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec5245a-2e59-4080-8d3f-07fbd8b04ea7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2775dfef1dd348f0af0c460661aa9a8c)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:47.073671 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec5245a-2e59-4080-8d3f-07fbd8b04ea7 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:47.120904 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-7ec5245a-2e59-4080-8d3f-07fbd8b04ea7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2775dfef1dd348f0af0c460661aa9a8c', 'request_id': 'req-7ec5245a-2e59-4080-8d3f-07fbd8b04ea7'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:47.128886 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-7ec5245a-2e59-4080-8d3f-07fbd8b04ea7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2775dfef1dd348f0af0c460661aa9a8c', 'request_id': 'req-7ec5245a-2e59-4080-8d3f-07fbd8b04ea7'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:47.135839 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-7ec5245a-2e59-4080-8d3f-07fbd8b04ea7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2775dfef1dd348f0af0c460661aa9a8c', 'request_id': 'req-7ec5245a-2e59-4080-8d3f-07fbd8b04ea7'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:47.146103 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-7ec5245a-2e59-4080-8d3f-07fbd8b04ea7 admin admin] The token cache is being invalidate because project 2775dfef1dd348f0af0c460661aa9a8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:41:47.146388 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-7ec5245a-2e59-4080-8d3f-07fbd8b04ea7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:47.147006 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-7ec5245a-2e59-4080-8d3f-07fbd8b04ea7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:47.148556 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1203/2405] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:41:47 2022] DELETE /identity/v3/projects/2775dfef1dd348f0af0c460661aa9a8c => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:47.152492 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd9e3e-7f7d-4b09-bb85-5bc0d4fad534 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:47.162079 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd9e3e-7f7d-4b09-bb85-5bc0d4fad534 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:47.218709 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac1f0d-eb24-4be6-b149-ad8ca24f9a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:47.219578 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac1f0d-eb24-4be6-b149-ad8ca24f9a6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:47.219861 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac1f0d-eb24-4be6-b149-ad8ca24f9a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:47.220130 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac1f0d-eb24-4be6-b149-ad8ca24f9a6a admin admin] PATH_INFO: `/v3/users/bed9cdace14d4a78bbd6df706d5b2bb7` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:47.221549 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ac1f0d-eb24-4be6-b149-ad8ca24f9a6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bed9cdace14d4a78bbd6df706d5b2bb7)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:47.223839 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ac1f0d-eb24-4be6-b149-ad8ca24f9a6a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:47.269951 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-45ac1f0d-eb24-4be6-b149-ad8ca24f9a6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bed9cdace14d4a78bbd6df706d5b2bb7'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:47.277313 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-45ac1f0d-eb24-4be6-b149-ad8ca24f9a6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bed9cdace14d4a78bbd6df706d5b2bb7'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:47.277936 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-45ac1f0d-eb24-4be6-b149-ad8ca24f9a6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bed9cdace14d4a78bbd6df706d5b2bb7'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:47.278645 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-45ac1f0d-eb24-4be6-b149-ad8ca24f9a6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bed9cdace14d4a78bbd6df706d5b2bb7'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:47.285886 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-45ac1f0d-eb24-4be6-b149-ad8ca24f9a6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bed9cdace14d4a78bbd6df706d5b2bb7'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:47.307268 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1203/2406] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:41:47 2022] DELETE /identity/v3/users/bed9cdace14d4a78bbd6df706d5b2bb7 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:47.591535 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5245a-2e59-4080-8d3f-07fbd8b04ea7 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:47.593019 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-7ec5245a-2e59-4080-8d3f-07fbd8b04ea7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:47.610639 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5245a-2e59-4080-8d3f-07fbd8b04ea7 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:47.685799 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825a5b6-9ca5-4a86-99a2-ecad870b42fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:47.686220 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825a5b6-9ca5-4a86-99a2-ecad870b42fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:47.686508 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825a5b6-9ca5-4a86-99a2-ecad870b42fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:47.686792 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825a5b6-9ca5-4a86-99a2-ecad870b42fd admin admin] PATH_INFO: `/v3/projects/bee40791a24248a49e3dec8de32553a0` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:47.688026 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e825a5b6-9ca5-4a86-99a2-ecad870b42fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=bee40791a24248a49e3dec8de32553a0)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:47.690114 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e825a5b6-9ca5-4a86-99a2-ecad870b42fd admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:47.728222 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:47.758148 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-e825a5b6-9ca5-4a86-99a2-ecad870b42fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bee40791a24248a49e3dec8de32553a0', 'request_id': 'req-e825a5b6-9ca5-4a86-99a2-ecad870b42fd'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:47.766379 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-e825a5b6-9ca5-4a86-99a2-ecad870b42fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bee40791a24248a49e3dec8de32553a0', 'request_id': 'req-e825a5b6-9ca5-4a86-99a2-ecad870b42fd'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:47.772982 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-e825a5b6-9ca5-4a86-99a2-ecad870b42fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bee40791a24248a49e3dec8de32553a0', 'request_id': 'req-e825a5b6-9ca5-4a86-99a2-ecad870b42fd'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:47.783673 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-e825a5b6-9ca5-4a86-99a2-ecad870b42fd admin admin] The token cache is being invalidate because project bee40791a24248a49e3dec8de32553a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:41:47.783959 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-e825a5b6-9ca5-4a86-99a2-ecad870b42fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:47.784579 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-e825a5b6-9ca5-4a86-99a2-ecad870b42fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:47.786145 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1204/2407] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:41:47 2022] DELETE /identity/v3/projects/bee40791a24248a49e3dec8de32553a0 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:47.791073 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3ebe4-1a4a-4ab5-9b1a-bd273f3b02e9 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:47.791354 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3ebe4-1a4a-4ab5-9b1a-bd273f3b02e9 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:47.791623 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3ebe4-1a4a-4ab5-9b1a-bd273f3b02e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:47.809772 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-87a3ebe4-1a4a-4ab5-9b1a-bd273f3b02e9 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:47.810897 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-87a3ebe4-1a4a-4ab5-9b1a-bd273f3b02e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:47.868779 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1204/2408] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:41:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:47.876919 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b791ae-df7a-431e-bba7-77210a77d6ca None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:47.877207 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b791ae-df7a-431e-bba7-77210a77d6ca None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:47.877482 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b791ae-df7a-431e-bba7-77210a77d6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:47.895814 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-a0b791ae-df7a-431e-bba7-77210a77d6ca None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:47.897036 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-a0b791ae-df7a-431e-bba7-77210a77d6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:47.905024 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1205/2409] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:41:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:47.909145 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3ebe4-1a4a-4ab5-9b1a-bd273f3b02e9 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:47.913956 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:47.920535 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3ebe4-1a4a-4ab5-9b1a-bd273f3b02e9 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:47.926174 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf978e7-57fc-4133-8960-cf79c2d3a345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:47.926822 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf978e7-57fc-4133-8960-cf79c2d3a345 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:47.927102 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf978e7-57fc-4133-8960-cf79c2d3a345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:47.927374 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf978e7-57fc-4133-8960-cf79c2d3a345 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:47.928090 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf978e7-57fc-4133-8960-cf79c2d3a345 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:41:47.928391 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf978e7-57fc-4133-8960-cf79c2d3a345 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:47.930641 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf978e7-57fc-4133-8960-cf79c2d3a345 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:47.942049 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1205/2410] 10.222.0.16 () {58 vars in 1152 bytes} [Thu May 26 12:41:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:41:47.947016 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b791ae-df7a-431e-bba7-77210a77d6ca None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:47.956274 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b791ae-df7a-431e-bba7-77210a77d6ca None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:47.960992 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d00510-d8be-48f7-8108-0ab53e2be402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:47.961637 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d00510-d8be-48f7-8108-0ab53e2be402 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:47.961920 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d00510-d8be-48f7-8108-0ab53e2be402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:47.962197 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d00510-d8be-48f7-8108-0ab53e2be402 admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:47.962890 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d00510-d8be-48f7-8108-0ab53e2be402 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:47.964793 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d00510-d8be-48f7-8108-0ab53e2be402 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:47.990384 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1206/2411] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:41:47 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:41:47.995412 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf978e7-57fc-4133-8960-cf79c2d3a345 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:48.005805 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf978e7-57fc-4133-8960-cf79c2d3a345 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:48.078467 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ac633-459b-43ff-8f7d-9e3c57b38b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:48.079048 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ac633-459b-43ff-8f7d-9e3c57b38b9c admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:48.079334 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ac633-459b-43ff-8f7d-9e3c57b38b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:48.079645 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ac633-459b-43ff-8f7d-9e3c57b38b9c admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:48.080346 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2ac633-459b-43ff-8f7d-9e3c57b38b9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:48.082330 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2ac633-459b-43ff-8f7d-9e3c57b38b9c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:48.102891 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1206/2412] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:41:47 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:41:48.106738 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d00510-d8be-48f7-8108-0ab53e2be402 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:48.117363 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d00510-d8be-48f7-8108-0ab53e2be402 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:48.123029 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef66b4-e858-42a5-9cc7-766e42090335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:48.123683 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef66b4-e858-42a5-9cc7-766e42090335 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:48.123968 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef66b4-e858-42a5-9cc7-766e42090335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:48.124242 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef66b4-e858-42a5-9cc7-766e42090335 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:48.125267 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef66b4-e858-42a5-9cc7-766e42090335 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:48.126931 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef66b4-e858-42a5-9cc7-766e42090335 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:48.138400 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1207/2413] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:41:48.142479 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ac633-459b-43ff-8f7d-9e3c57b38b9c admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:48.153335 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ac633-459b-43ff-8f7d-9e3c57b38b9c admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:48.158085 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e1a68-a65f-4bfa-9f13-dab53d3408ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:48.158732 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e1a68-a65f-4bfa-9f13-dab53d3408ba admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:48.159014 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e1a68-a65f-4bfa-9f13-dab53d3408ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:48.159286 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e1a68-a65f-4bfa-9f13-dab53d3408ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:48.159993 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6e1a68-a65f-4bfa-9f13-dab53d3408ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:48.161744 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6e1a68-a65f-4bfa-9f13-dab53d3408ba admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:48.171475 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1207/2414] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:41:48.177409 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef66b4-e858-42a5-9cc7-766e42090335 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:48.188120 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef66b4-e858-42a5-9cc7-766e42090335 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:48.193999 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6a2cf-3c4e-407d-bdea-ae834ec462ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:48.195682 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6a2cf-3c4e-407d-bdea-ae834ec462ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:48.196491 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6a2cf-3c4e-407d-bdea-ae834ec462ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:48.196762 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6a2cf-3c4e-407d-bdea-ae834ec462ec admin admin] PATH_INFO: `/v3/projects/0d2f8c0311eb43f9944c4267e0241dd1/users/76a5ec3eb97f41afb4a0489ebf4ef58c/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:48.213278 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e6a2cf-3c4e-407d-bdea-ae834ec462ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d2f8c0311eb43f9944c4267e0241dd1, user_id=76a5ec3eb97f41afb4a0489ebf4ef58c, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:48.215930 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e6a2cf-3c4e-407d-bdea-ae834ec462ec admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:48.230068 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1208/2415] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:41:48 2022] PUT /identity/v3/projects/0d2f8c0311eb43f9944c4267e0241dd1/users/76a5ec3eb97f41afb4a0489ebf4ef58c/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:48.241321 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a11a41-99ba-41fa-8ef3-c26b4cca937e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:48.241623 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a11a41-99ba-41fa-8ef3-c26b4cca937e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:48.241892 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a11a41-99ba-41fa-8ef3-c26b4cca937e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:48.272393 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-80a11a41-99ba-41fa-8ef3-c26b4cca937e None None] MFA Rules not processed for user `76a5ec3eb97f41afb4a0489ebf4ef58c`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:48.273643 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-80a11a41-99ba-41fa-8ef3-c26b4cca937e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:48.343106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1208/2416] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:41:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:48.347497 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6a2cf-3c4e-407d-bdea-ae834ec462ec admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:48.409203 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6a2cf-3c4e-407d-bdea-ae834ec462ec admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:48.413843 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b15fad-5a71-47af-9a3f-db2744fa9144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:48.414550 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b15fad-5a71-47af-9a3f-db2744fa9144 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:48.415373 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b15fad-5a71-47af-9a3f-db2744fa9144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:48.415650 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b15fad-5a71-47af-9a3f-db2744fa9144 admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:48.416341 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b15fad-5a71-47af-9a3f-db2744fa9144 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:48.418293 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b15fad-5a71-47af-9a3f-db2744fa9144 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:48.444361 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1209/2417] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:41:48 2022] POST /identity/v3/projects => generated 375 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:41:48.448946 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a11a41-99ba-41fa-8ef3-c26b4cca937e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:48.463100 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a11a41-99ba-41fa-8ef3-c26b4cca937e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:48.539011 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:48.547094 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6993ad-b54b-4348-a4ba-3a401e8a97b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:48.547765 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6993ad-b54b-4348-a4ba-3a401e8a97b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:48.548045 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6993ad-b54b-4348-a4ba-3a401e8a97b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:48.548320 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6993ad-b54b-4348-a4ba-3a401e8a97b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:48.549051 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6993ad-b54b-4348-a4ba-3a401e8a97b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:48.550985 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6993ad-b54b-4348-a4ba-3a401e8a97b8 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:48.570911 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1209/2418] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:41:48 2022] POST /identity/v3/users => generated 294 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:41:48.574878 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b15fad-5a71-47af-9a3f-db2744fa9144 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:48.585512 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b15fad-5a71-47af-9a3f-db2744fa9144 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:48.590847 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6eb3f3-1a69-4cdb-a0d3-894627e98876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:48.591510 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6eb3f3-1a69-4cdb-a0d3-894627e98876 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:48.591798 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6eb3f3-1a69-4cdb-a0d3-894627e98876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:48.592330 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6eb3f3-1a69-4cdb-a0d3-894627e98876 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:48.592799 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6eb3f3-1a69-4cdb-a0d3-894627e98876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:48.594500 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6eb3f3-1a69-4cdb-a0d3-894627e98876 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:48.607399 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1210/2419] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:41:48.611762 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6993ad-b54b-4348-a4ba-3a401e8a97b8 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:48.621871 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6993ad-b54b-4348-a4ba-3a401e8a97b8 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:48.626788 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df3376e-b139-4cb0-a02d-3e76bfe98022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:48.627668 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3376e-b139-4cb0-a02d-3e76bfe98022 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:48.627950 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3376e-b139-4cb0-a02d-3e76bfe98022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:48.628228 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3376e-b139-4cb0-a02d-3e76bfe98022 admin admin] PATH_INFO: `/v3/projects/898ef21dfac94d778784f2f676b935a3/users/3139f1385cfe4b85ad3a3de43f69998e/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:48.643219 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df3376e-b139-4cb0-a02d-3e76bfe98022 admin admin] RBAC: Authorizing `identity:create_grant(project_id=898ef21dfac94d778784f2f676b935a3, user_id=3139f1385cfe4b85ad3a3de43f69998e, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:48.646388 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df3376e-b139-4cb0-a02d-3e76bfe98022 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:48.661301 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1210/2420] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:41:48 2022] PUT /identity/v3/projects/898ef21dfac94d778784f2f676b935a3/users/3139f1385cfe4b85ad3a3de43f69998e/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:48.666231 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6eb3f3-1a69-4cdb-a0d3-894627e98876 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:48.676622 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6eb3f3-1a69-4cdb-a0d3-894627e98876 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:48.695131 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:48.742167 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b876232f-b524-4c0f-9b21-88632bbac4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:48.742853 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876232f-b524-4c0f-9b21-88632bbac4dc admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:48.743113 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876232f-b524-4c0f-9b21-88632bbac4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:48.743385 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876232f-b524-4c0f-9b21-88632bbac4dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:48.744110 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b876232f-b524-4c0f-9b21-88632bbac4dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:48.745744 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b876232f-b524-4c0f-9b21-88632bbac4dc admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:48.763639 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1211/2421] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:41:48.768874 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df3376e-b139-4cb0-a02d-3e76bfe98022 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:48.784618 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df3376e-b139-4cb0-a02d-3e76bfe98022 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:48.791548 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692cec1b-a5af-4ebc-9a43-ef947360c007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:48.793172 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692cec1b-a5af-4ebc-9a43-ef947360c007 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:48.793470 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692cec1b-a5af-4ebc-9a43-ef947360c007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:48.793933 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692cec1b-a5af-4ebc-9a43-ef947360c007 admin admin] PATH_INFO: `/v3/projects/898ef21dfac94d778784f2f676b935a3/users/3139f1385cfe4b85ad3a3de43f69998e/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:48.797055 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692cec1b-a5af-4ebc-9a43-ef947360c007 admin admin] RBAC: Authorizing `identity:create_grant(project_id=898ef21dfac94d778784f2f676b935a3, user_id=3139f1385cfe4b85ad3a3de43f69998e, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:48.800793 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692cec1b-a5af-4ebc-9a43-ef947360c007 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:48.813754 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1211/2422] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:41:48 2022] PUT /identity/v3/projects/898ef21dfac94d778784f2f676b935a3/users/3139f1385cfe4b85ad3a3de43f69998e/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:41:48.825839 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0776f-1a71-4d72-9d24-44af47b90ccd None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:48.826262 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0776f-1a71-4d72-9d24-44af47b90ccd None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:48.826593 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0776f-1a71-4d72-9d24-44af47b90ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:48.864301 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-23d0776f-1a71-4d72-9d24-44af47b90ccd None None] MFA Rules not processed for user `3139f1385cfe4b85ad3a3de43f69998e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:48.866389 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-23d0776f-1a71-4d72-9d24-44af47b90ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:48.940796 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1212/2423] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:41:48 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:41:48.952522 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692cec1b-a5af-4ebc-9a43-ef947360c007 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:48.954423 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-692cec1b-a5af-4ebc-9a43-ef947360c007 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:49.015079 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692cec1b-a5af-4ebc-9a43-ef947360c007 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:49.018747 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59745fb-68f2-44e3-bd85-0a632dfa05df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:49.019408 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59745fb-68f2-44e3-bd85-0a632dfa05df service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:49.019693 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59745fb-68f2-44e3-bd85-0a632dfa05df service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:49.019974 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59745fb-68f2-44e3-bd85-0a632dfa05df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:49.076810 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59745fb-68f2-44e3-bd85-0a632dfa05df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:49.078299 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59745fb-68f2-44e3-bd85-0a632dfa05df service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:49.087352 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1212/2424] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:41:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:41:51.607944 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d0776f-1a71-4d72-9d24-44af47b90ccd None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:51.670596 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d0776f-1a71-4d72-9d24-44af47b90ccd None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:51.675109 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7949e25b-a1ca-4636-be07-f84209fb8699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:51.675962 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7949e25b-a1ca-4636-be07-f84209fb8699 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:51.676248 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7949e25b-a1ca-4636-be07-f84209fb8699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:51.676526 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7949e25b-a1ca-4636-be07-f84209fb8699 admin admin] PATH_INFO: `/v3/users/76a5ec3eb97f41afb4a0489ebf4ef58c` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:51.677745 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7949e25b-a1ca-4636-be07-f84209fb8699 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76a5ec3eb97f41afb4a0489ebf4ef58c)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:51.679669 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7949e25b-a1ca-4636-be07-f84209fb8699 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:51.729087 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:51.732333 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-7949e25b-a1ca-4636-be07-f84209fb8699 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76a5ec3eb97f41afb4a0489ebf4ef58c'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:51.733231 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-7949e25b-a1ca-4636-be07-f84209fb8699 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76a5ec3eb97f41afb4a0489ebf4ef58c'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:51.734084 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-7949e25b-a1ca-4636-be07-f84209fb8699 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76a5ec3eb97f41afb4a0489ebf4ef58c'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:51.741257 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-7949e25b-a1ca-4636-be07-f84209fb8699 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76a5ec3eb97f41afb4a0489ebf4ef58c'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:51.755023 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-7949e25b-a1ca-4636-be07-f84209fb8699 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76a5ec3eb97f41afb4a0489ebf4ef58c'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:51.771457 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1213/2425] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:41:51 2022] DELETE /identity/v3/users/76a5ec3eb97f41afb4a0489ebf4ef58c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:41:51.776579 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3ade6-9dec-45ed-a0d4-9e5d30a1b373 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:51.777089 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3ade6-9dec-45ed-a0d4-9e5d30a1b373 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:51.777246 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3ade6-9dec-45ed-a0d4-9e5d30a1b373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:51.795236 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c7b3ade6-9dec-45ed-a0d4-9e5d30a1b373 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:51.796476 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c7b3ade6-9dec-45ed-a0d4-9e5d30a1b373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:51.861881 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1213/2426] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:41:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:51.871857 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7949e25b-a1ca-4636-be07-f84209fb8699 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:51.873307 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-7949e25b-a1ca-4636-be07-f84209fb8699 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:51.933365 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7949e25b-a1ca-4636-be07-f84209fb8699 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:51.937094 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5ee99-0c77-49d1-9cd8-66467b008e32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:51.937737 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5ee99-0c77-49d1-9cd8-66467b008e32 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:51.938011 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5ee99-0c77-49d1-9cd8-66467b008e32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:51.938284 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5ee99-0c77-49d1-9cd8-66467b008e32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:51.947667 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b5ee99-0c77-49d1-9cd8-66467b008e32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:51.949144 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b5ee99-0c77-49d1-9cd8-66467b008e32 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:51.958796 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1214/2427] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:41:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:41:52.240424 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3ade6-9dec-45ed-a0d4-9e5d30a1b373 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:52.241913 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c7b3ade6-9dec-45ed-a0d4-9e5d30a1b373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:52.250940 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:52.255344 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3ade6-9dec-45ed-a0d4-9e5d30a1b373 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:52.267360 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e2f2e-7547-46ca-96aa-d1e50937a172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:52.268953 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e2f2e-7547-46ca-96aa-d1e50937a172 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:52.268953 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e2f2e-7547-46ca-96aa-d1e50937a172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:52.268953 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e2f2e-7547-46ca-96aa-d1e50937a172 admin admin] PATH_INFO: `/v3/projects/0d2f8c0311eb43f9944c4267e0241dd1` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:52.271486 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8e2f2e-7547-46ca-96aa-d1e50937a172 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d2f8c0311eb43f9944c4267e0241dd1)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:52.273030 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8e2f2e-7547-46ca-96aa-d1e50937a172 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:52.332734 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3e8e2f2e-7547-46ca-96aa-d1e50937a172 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d2f8c0311eb43f9944c4267e0241dd1', 'request_id': 'req-3e8e2f2e-7547-46ca-96aa-d1e50937a172'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:52.340990 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3e8e2f2e-7547-46ca-96aa-d1e50937a172 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d2f8c0311eb43f9944c4267e0241dd1', 'request_id': 'req-3e8e2f2e-7547-46ca-96aa-d1e50937a172'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:52.349429 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3e8e2f2e-7547-46ca-96aa-d1e50937a172 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d2f8c0311eb43f9944c4267e0241dd1', 'request_id': 'req-3e8e2f2e-7547-46ca-96aa-d1e50937a172'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:52.369527 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3e8e2f2e-7547-46ca-96aa-d1e50937a172 admin admin] The token cache is being invalidate because project 0d2f8c0311eb43f9944c4267e0241dd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:41:52.369825 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3e8e2f2e-7547-46ca-96aa-d1e50937a172 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:52.370486 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3e8e2f2e-7547-46ca-96aa-d1e50937a172 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:52.372079 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1214/2428] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:41:52 2022] DELETE /identity/v3/projects/0d2f8c0311eb43f9944c4267e0241dd1 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:52.376522 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5ee99-0c77-49d1-9cd8-66467b008e32 service neutron] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:52.386962 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5ee99-0c77-49d1-9cd8-66467b008e32 service neutron] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:52.450867 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fc4307-7705-4282-adee-0547576c1f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:52.452005 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc4307-7705-4282-adee-0547576c1f9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:52.452280 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc4307-7705-4282-adee-0547576c1f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:52.452548 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc4307-7705-4282-adee-0547576c1f9f admin admin] PATH_INFO: `/v3/users/3139f1385cfe4b85ad3a3de43f69998e` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:52.453815 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fc4307-7705-4282-adee-0547576c1f9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3139f1385cfe4b85ad3a3de43f69998e)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:52.455732 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fc4307-7705-4282-adee-0547576c1f9f admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:52.522119 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-06fc4307-7705-4282-adee-0547576c1f9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3139f1385cfe4b85ad3a3de43f69998e'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:52.522893 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-06fc4307-7705-4282-adee-0547576c1f9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3139f1385cfe4b85ad3a3de43f69998e'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:52.523574 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-06fc4307-7705-4282-adee-0547576c1f9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3139f1385cfe4b85ad3a3de43f69998e'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:52.533503 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-06fc4307-7705-4282-adee-0547576c1f9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3139f1385cfe4b85ad3a3de43f69998e'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:52.547256 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:52.553121 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-06fc4307-7705-4282-adee-0547576c1f9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3139f1385cfe4b85ad3a3de43f69998e'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:52.568061 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1215/2429] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:41:52 2022] DELETE /identity/v3/users/3139f1385cfe4b85ad3a3de43f69998e => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:52.865958 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e2f2e-7547-46ca-96aa-d1e50937a172 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:52.867578 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3e8e2f2e-7547-46ca-96aa-d1e50937a172 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:52.882307 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e2f2e-7547-46ca-96aa-d1e50937a172 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:52.946906 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fce6c7-e7c9-4c10-be18-5244fa0483fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:52.947679 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fce6c7-e7c9-4c10-be18-5244fa0483fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:52.947957 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fce6c7-e7c9-4c10-be18-5244fa0483fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:52.948227 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fce6c7-e7c9-4c10-be18-5244fa0483fa admin admin] PATH_INFO: `/v3/projects/898ef21dfac94d778784f2f676b935a3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:52.949446 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fce6c7-e7c9-4c10-be18-5244fa0483fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=898ef21dfac94d778784f2f676b935a3)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:52.951379 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fce6c7-e7c9-4c10-be18-5244fa0483fa admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:53.000541 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e0fce6c7-e7c9-4c10-be18-5244fa0483fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '898ef21dfac94d778784f2f676b935a3', 'request_id': 'req-e0fce6c7-e7c9-4c10-be18-5244fa0483fa'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:53.005988 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e0fce6c7-e7c9-4c10-be18-5244fa0483fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '898ef21dfac94d778784f2f676b935a3', 'request_id': 'req-e0fce6c7-e7c9-4c10-be18-5244fa0483fa'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:53.012918 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e0fce6c7-e7c9-4c10-be18-5244fa0483fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '898ef21dfac94d778784f2f676b935a3', 'request_id': 'req-e0fce6c7-e7c9-4c10-be18-5244fa0483fa'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:53.026770 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e0fce6c7-e7c9-4c10-be18-5244fa0483fa admin admin] The token cache is being invalidate because project 898ef21dfac94d778784f2f676b935a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:41:53.027063 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e0fce6c7-e7c9-4c10-be18-5244fa0483fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:53.027700 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e0fce6c7-e7c9-4c10-be18-5244fa0483fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:53.029283 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1215/2430] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:41:52 2022] DELETE /identity/v3/projects/898ef21dfac94d778784f2f676b935a3 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:53.034174 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790b16c-614c-448b-94f9-f5f28c3e2415 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:53.034673 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790b16c-614c-448b-94f9-f5f28c3e2415 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:53.034777 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790b16c-614c-448b-94f9-f5f28c3e2415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:53.052793 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-5790b16c-614c-448b-94f9-f5f28c3e2415 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:53.054037 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-5790b16c-614c-448b-94f9-f5f28c3e2415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:53.114870 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1216/2431] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:41:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:53.123367 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1a275-4eed-424e-aeba-671267487771 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:53.123654 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1a275-4eed-424e-aeba-671267487771 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:53.123932 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1a275-4eed-424e-aeba-671267487771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:53.144103 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-27a1a275-4eed-424e-aeba-671267487771 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:53.145370 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-27a1a275-4eed-424e-aeba-671267487771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:53.153460 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1216/2432] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:41:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:53.157755 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5790b16c-614c-448b-94f9-f5f28c3e2415 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:53.168087 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5790b16c-614c-448b-94f9-f5f28c3e2415 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:53.172646 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d016a7-f1ad-4f4d-8212-59c585a8e8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:53.173345 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d016a7-f1ad-4f4d-8212-59c585a8e8f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:53.173625 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d016a7-f1ad-4f4d-8212-59c585a8e8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:53.173922 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d016a7-f1ad-4f4d-8212-59c585a8e8f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:53.174647 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d016a7-f1ad-4f4d-8212-59c585a8e8f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:41:53.174951 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d016a7-f1ad-4f4d-8212-59c585a8e8f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:53.176545 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d016a7-f1ad-4f4d-8212-59c585a8e8f8 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:53.189714 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1217/2433] 10.222.0.16 () {58 vars in 1152 bytes} [Thu May 26 12:41:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:41:53.194090 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a1a275-4eed-424e-aeba-671267487771 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:53.204492 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a1a275-4eed-424e-aeba-671267487771 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:53.209183 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9913f441-3b82-4dd1-b048-ba61f1716bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:53.209833 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913f441-3b82-4dd1-b048-ba61f1716bb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:53.210114 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913f441-3b82-4dd1-b048-ba61f1716bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:53.210388 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913f441-3b82-4dd1-b048-ba61f1716bb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:53.211083 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9913f441-3b82-4dd1-b048-ba61f1716bb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:53.213026 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9913f441-3b82-4dd1-b048-ba61f1716bb4 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:53.221332 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:53.242688 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1217/2434] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:41:53 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:41:53.247645 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d016a7-f1ad-4f4d-8212-59c585a8e8f8 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:53.258275 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d016a7-f1ad-4f4d-8212-59c585a8e8f8 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:53.315657 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c654698-89cb-4e05-83ad-c655b13aee38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:53.316331 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c654698-89cb-4e05-83ad-c655b13aee38 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:53.316616 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c654698-89cb-4e05-83ad-c655b13aee38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:53.316927 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c654698-89cb-4e05-83ad-c655b13aee38 admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:53.317634 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c654698-89cb-4e05-83ad-c655b13aee38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:53.319559 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c654698-89cb-4e05-83ad-c655b13aee38 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:53.341255 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1218/2435] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:41:53 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:41:53.345232 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9913f441-3b82-4dd1-b048-ba61f1716bb4 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:53.357319 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9913f441-3b82-4dd1-b048-ba61f1716bb4 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:53.362151 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638ba58c-5b32-4819-bf64-dc06871bbc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:53.362816 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ba58c-5b32-4819-bf64-dc06871bbc4a admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:53.363104 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ba58c-5b32-4819-bf64-dc06871bbc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:53.363385 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ba58c-5b32-4819-bf64-dc06871bbc4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:53.364117 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638ba58c-5b32-4819-bf64-dc06871bbc4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:53.365784 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638ba58c-5b32-4819-bf64-dc06871bbc4a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:53.376960 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1218/2436] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:41:53.381274 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c654698-89cb-4e05-83ad-c655b13aee38 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:53.391526 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c654698-89cb-4e05-83ad-c655b13aee38 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:53.396372 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab6691-dbc8-4e15-94dd-cdf8c8e40fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:53.397057 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab6691-dbc8-4e15-94dd-cdf8c8e40fda admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:53.397339 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab6691-dbc8-4e15-94dd-cdf8c8e40fda admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:53.397611 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab6691-dbc8-4e15-94dd-cdf8c8e40fda admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:53.398332 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab6691-dbc8-4e15-94dd-cdf8c8e40fda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:53.399992 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab6691-dbc8-4e15-94dd-cdf8c8e40fda admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:53.411196 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1219/2437] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:41:53.415975 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638ba58c-5b32-4819-bf64-dc06871bbc4a admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:53.426068 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638ba58c-5b32-4819-bf64-dc06871bbc4a admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:53.431365 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb80a91-6597-4754-96cb-cdd0ef128233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:53.432244 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb80a91-6597-4754-96cb-cdd0ef128233 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:53.432525 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb80a91-6597-4754-96cb-cdd0ef128233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:53.432800 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb80a91-6597-4754-96cb-cdd0ef128233 admin admin] PATH_INFO: `/v3/projects/ecfa6e6a0d05405db6acc46d3d2ce04d/users/1b01296a077d41c482b6d2153c73da9e/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:53.447813 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb80a91-6597-4754-96cb-cdd0ef128233 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecfa6e6a0d05405db6acc46d3d2ce04d, user_id=1b01296a077d41c482b6d2153c73da9e, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:53.450582 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb80a91-6597-4754-96cb-cdd0ef128233 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:53.465961 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1219/2438] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:41:53 2022] PUT /identity/v3/projects/ecfa6e6a0d05405db6acc46d3d2ce04d/users/1b01296a077d41c482b6d2153c73da9e/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:53.532233 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d0150-0a4d-44f8-a4fb-76c06fbb6882 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:53.532513 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d0150-0a4d-44f8-a4fb-76c06fbb6882 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:53.532792 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d0150-0a4d-44f8-a4fb-76c06fbb6882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:53.566968 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-6c8d0150-0a4d-44f8-a4fb-76c06fbb6882 None None] MFA Rules not processed for user `1b01296a077d41c482b6d2153c73da9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:53.568757 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-6c8d0150-0a4d-44f8-a4fb-76c06fbb6882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:53.610390 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:53.648147 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1220/2439] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:41:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:53.659760 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb80a91-6597-4754-96cb-cdd0ef128233 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:53.661584 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-acb80a91-6597-4754-96cb-cdd0ef128233 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:53.723812 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb80a91-6597-4754-96cb-cdd0ef128233 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:53.728560 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278842b7-c880-4e06-8197-67d2b15bc108 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:53.729433 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278842b7-c880-4e06-8197-67d2b15bc108 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:53.729715 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278842b7-c880-4e06-8197-67d2b15bc108 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:53.729994 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278842b7-c880-4e06-8197-67d2b15bc108 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:53.739031 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278842b7-c880-4e06-8197-67d2b15bc108 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:53.740516 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278842b7-c880-4e06-8197-67d2b15bc108 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:53.750028 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1220/2440] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:41:53 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:41:53.774970 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8d0150-0a4d-44f8-a4fb-76c06fbb6882 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:53.838487 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8d0150-0a4d-44f8-a4fb-76c06fbb6882 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:53.844421 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9772dc-4522-4d06-b2e9-fb00f1d50f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:53.845355 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9772dc-4522-4d06-b2e9-fb00f1d50f6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:53.845639 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9772dc-4522-4d06-b2e9-fb00f1d50f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:53.845917 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9772dc-4522-4d06-b2e9-fb00f1d50f6a admin admin] PATH_INFO: `/v3/users/1b01296a077d41c482b6d2153c73da9e` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:53.847137 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9772dc-4522-4d06-b2e9-fb00f1d50f6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b01296a077d41c482b6d2153c73da9e)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:53.849099 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9772dc-4522-4d06-b2e9-fb00f1d50f6a admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:53.898119 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-6d9772dc-4522-4d06-b2e9-fb00f1d50f6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b01296a077d41c482b6d2153c73da9e'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:53.898874 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-6d9772dc-4522-4d06-b2e9-fb00f1d50f6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b01296a077d41c482b6d2153c73da9e'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:53.900023 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-6d9772dc-4522-4d06-b2e9-fb00f1d50f6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b01296a077d41c482b6d2153c73da9e'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:53.908540 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-6d9772dc-4522-4d06-b2e9-fb00f1d50f6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b01296a077d41c482b6d2153c73da9e'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:53.921782 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-6d9772dc-4522-4d06-b2e9-fb00f1d50f6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b01296a077d41c482b6d2153c73da9e'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:53.934070 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1221/2441] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:41:53 2022] DELETE /identity/v3/users/1b01296a077d41c482b6d2153c73da9e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:53.938626 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce72fe-70f6-4870-94ef-81f0eb84f2db None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:53.939300 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce72fe-70f6-4870-94ef-81f0eb84f2db None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:53.939300 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce72fe-70f6-4870-94ef-81f0eb84f2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:53.956916 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-9dce72fe-70f6-4870-94ef-81f0eb84f2db None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:53.958134 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9dce72fe-70f6-4870-94ef-81f0eb84f2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:54.019124 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1221/2442] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:41:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:54.028768 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9772dc-4522-4d06-b2e9-fb00f1d50f6a admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:54.030195 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-6d9772dc-4522-4d06-b2e9-fb00f1d50f6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:54.089251 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9772dc-4522-4d06-b2e9-fb00f1d50f6a admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:54.093294 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb76c387-db51-4d5e-baa6-c7681dd65de8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:54.093953 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76c387-db51-4d5e-baa6-c7681dd65de8 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:54.094238 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76c387-db51-4d5e-baa6-c7681dd65de8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:54.094516 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76c387-db51-4d5e-baa6-c7681dd65de8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:54.105352 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb76c387-db51-4d5e-baa6-c7681dd65de8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:54.106975 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb76c387-db51-4d5e-baa6-c7681dd65de8 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:54.112598 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:54.118759 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1222/2443] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:41:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:41:54.395740 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce72fe-70f6-4870-94ef-81f0eb84f2db None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:54.397803 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9dce72fe-70f6-4870-94ef-81f0eb84f2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:54.413435 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce72fe-70f6-4870-94ef-81f0eb84f2db None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:54.418945 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef1c5f-cd20-430c-947c-7ec18b8454a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:54.419866 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef1c5f-cd20-430c-947c-7ec18b8454a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:54.420164 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef1c5f-cd20-430c-947c-7ec18b8454a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:54.420443 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef1c5f-cd20-430c-947c-7ec18b8454a3 admin admin] PATH_INFO: `/v3/projects/ecfa6e6a0d05405db6acc46d3d2ce04d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:54.421698 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef1c5f-cd20-430c-947c-7ec18b8454a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecfa6e6a0d05405db6acc46d3d2ce04d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:54.423687 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef1c5f-cd20-430c-947c-7ec18b8454a3 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:54.473289 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d2ef1c5f-cd20-430c-947c-7ec18b8454a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecfa6e6a0d05405db6acc46d3d2ce04d', 'request_id': 'req-d2ef1c5f-cd20-430c-947c-7ec18b8454a3'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:54.475493 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:54.482450 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d2ef1c5f-cd20-430c-947c-7ec18b8454a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecfa6e6a0d05405db6acc46d3d2ce04d', 'request_id': 'req-d2ef1c5f-cd20-430c-947c-7ec18b8454a3'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:54.491187 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d2ef1c5f-cd20-430c-947c-7ec18b8454a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecfa6e6a0d05405db6acc46d3d2ce04d', 'request_id': 'req-d2ef1c5f-cd20-430c-947c-7ec18b8454a3'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:54.509211 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d2ef1c5f-cd20-430c-947c-7ec18b8454a3 admin admin] The token cache is being invalidate because project ecfa6e6a0d05405db6acc46d3d2ce04d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:41:54.509749 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d2ef1c5f-cd20-430c-947c-7ec18b8454a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:54.510854 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d2ef1c5f-cd20-430c-947c-7ec18b8454a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:54.513661 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1222/2444] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:41:54 2022] DELETE /identity/v3/projects/ecfa6e6a0d05405db6acc46d3d2ce04d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:54.518967 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de03a9-d1e7-4806-8410-568be7956196 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:54.519251 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de03a9-d1e7-4806-8410-568be7956196 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:54.519549 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de03a9-d1e7-4806-8410-568be7956196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:54.537980 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-40de03a9-d1e7-4806-8410-568be7956196 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:54.539092 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-40de03a9-d1e7-4806-8410-568be7956196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:54.608347 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1223/2445] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:41:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:54.616405 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e1e51-e617-4d9d-a466-7346ca4b4ced None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:54.616693 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e1e51-e617-4d9d-a466-7346ca4b4ced None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:54.617035 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e1e51-e617-4d9d-a466-7346ca4b4ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:54.637885 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-3c1e1e51-e617-4d9d-a466-7346ca4b4ced None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:54.639093 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3c1e1e51-e617-4d9d-a466-7346ca4b4ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:54.648266 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1223/2446] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:41:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:54.653136 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de03a9-d1e7-4806-8410-568be7956196 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:54.662895 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de03a9-d1e7-4806-8410-568be7956196 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:54.668290 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5c41f-5d16-4c99-a6d4-986d1bc6e1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:54.668962 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5c41f-5d16-4c99-a6d4-986d1bc6e1df admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:54.669247 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5c41f-5d16-4c99-a6d4-986d1bc6e1df admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:54.669522 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5c41f-5d16-4c99-a6d4-986d1bc6e1df admin admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:54.670246 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba5c41f-5d16-4c99-a6d4-986d1bc6e1df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:41:54.670551 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba5c41f-5d16-4c99-a6d4-986d1bc6e1df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:54.672144 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba5c41f-5d16-4c99-a6d4-986d1bc6e1df admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:54.687934 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1224/2447] 10.222.0.16 () {58 vars in 1152 bytes} [Thu May 26 12:41:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:41:54.692449 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e1e51-e617-4d9d-a466-7346ca4b4ced None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:54.702773 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e1e51-e617-4d9d-a466-7346ca4b4ced None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:54.707930 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d41d06-98d5-407d-90a6-64a5c2c7249f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:54.708684 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d41d06-98d5-407d-90a6-64a5c2c7249f admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:54.709034 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d41d06-98d5-407d-90a6-64a5c2c7249f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:54.709362 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d41d06-98d5-407d-90a6-64a5c2c7249f admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:54.710055 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d41d06-98d5-407d-90a6-64a5c2c7249f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:54.712658 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d41d06-98d5-407d-90a6-64a5c2c7249f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:54.747778 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1224/2448] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:41:54 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:41:54.752651 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5c41f-5d16-4c99-a6d4-986d1bc6e1df admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:54.765879 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5c41f-5d16-4c99-a6d4-986d1bc6e1df admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:54.831294 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b312c9-6163-4bdb-aef7-b45d7463eaf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:54.831964 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b312c9-6163-4bdb-aef7-b45d7463eaf9 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:54.832249 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b312c9-6163-4bdb-aef7-b45d7463eaf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:54.832526 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b312c9-6163-4bdb-aef7-b45d7463eaf9 admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:54.833272 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b312c9-6163-4bdb-aef7-b45d7463eaf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:54.835254 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b312c9-6163-4bdb-aef7-b45d7463eaf9 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:54.857556 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1225/2449] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:41:54 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:41:54.862874 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d41d06-98d5-407d-90a6-64a5c2c7249f admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:54.873820 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d41d06-98d5-407d-90a6-64a5c2c7249f admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:54.878779 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad508ecf-f2e8-4b10-a949-49f9f33191c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:54.879438 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad508ecf-f2e8-4b10-a949-49f9f33191c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:54.879724 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad508ecf-f2e8-4b10-a949-49f9f33191c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:54.880002 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad508ecf-f2e8-4b10-a949-49f9f33191c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:54.880724 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad508ecf-f2e8-4b10-a949-49f9f33191c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:54.882387 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad508ecf-f2e8-4b10-a949-49f9f33191c8 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:54.893101 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1225/2450] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:41:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:41:54.897281 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b312c9-6163-4bdb-aef7-b45d7463eaf9 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:54.910445 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b312c9-6163-4bdb-aef7-b45d7463eaf9 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:54.915779 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d747f8-d0d9-4f67-a6d7-1676211f58ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:54.916435 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d747f8-d0d9-4f67-a6d7-1676211f58ca admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:54.916717 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d747f8-d0d9-4f67-a6d7-1676211f58ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:54.917032 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d747f8-d0d9-4f67-a6d7-1676211f58ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:54.917763 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d747f8-d0d9-4f67-a6d7-1676211f58ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:54.919385 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d747f8-d0d9-4f67-a6d7-1676211f58ca admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:54.929825 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1226/2451] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:41:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:41:54.935307 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad508ecf-f2e8-4b10-a949-49f9f33191c8 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:54.946256 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad508ecf-f2e8-4b10-a949-49f9f33191c8 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:54.951731 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c648d-87f3-492f-97d7-3399d194d418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:54.952673 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c648d-87f3-492f-97d7-3399d194d418 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:54.953063 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c648d-87f3-492f-97d7-3399d194d418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:54.953387 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c648d-87f3-492f-97d7-3399d194d418 admin admin] PATH_INFO: `/v3/projects/785423a906614dc580ba25f27a356020/users/72acc7b23f594627b3e66d4c380e6e60/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:54.970120 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483c648d-87f3-492f-97d7-3399d194d418 admin admin] RBAC: Authorizing `identity:create_grant(project_id=785423a906614dc580ba25f27a356020, user_id=72acc7b23f594627b3e66d4c380e6e60, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:54.972794 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483c648d-87f3-492f-97d7-3399d194d418 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:54.988963 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1226/2452] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:41:54 2022] PUT /identity/v3/projects/785423a906614dc580ba25f27a356020/users/72acc7b23f594627b3e66d4c380e6e60/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:54.994724 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981dc3a-d124-4382-b296-c2fc1c1f4e00 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:54.994952 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981dc3a-d124-4382-b296-c2fc1c1f4e00 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:54.995228 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981dc3a-d124-4382-b296-c2fc1c1f4e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:55.013264 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-d981dc3a-d124-4382-b296-c2fc1c1f4e00 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:55.014570 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-d981dc3a-d124-4382-b296-c2fc1c1f4e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:55.078062 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1227/2453] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:41:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:55.088204 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c648d-87f3-492f-97d7-3399d194d418 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:55.089981 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-483c648d-87f3-492f-97d7-3399d194d418 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:55.149855 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c648d-87f3-492f-97d7-3399d194d418 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:55.153600 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df92184c-6e7e-4c05-adf5-91f5ad802c17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:55.154254 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92184c-6e7e-4c05-adf5-91f5ad802c17 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:55.154541 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92184c-6e7e-4c05-adf5-91f5ad802c17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:55.154821 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92184c-6e7e-4c05-adf5-91f5ad802c17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:55.165310 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df92184c-6e7e-4c05-adf5-91f5ad802c17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:55.166768 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df92184c-6e7e-4c05-adf5-91f5ad802c17 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:55.176917 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1227/2454] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:41:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:41:55.852103 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f3319f-41fd-4698-862a-1c4e9410e736 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:55.854641 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f3319f-41fd-4698-862a-1c4e9410e736 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:55.855122 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f3319f-41fd-4698-862a-1c4e9410e736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:55.868384 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:55.886462 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-a7f3319f-41fd-4698-862a-1c4e9410e736 None None] MFA Rules not processed for user `72acc7b23f594627b3e66d4c380e6e60`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:55.888030 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-a7f3319f-41fd-4698-862a-1c4e9410e736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:55.983551 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1228/2455] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:41:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:55.993127 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df92184c-6e7e-4c05-adf5-91f5ad802c17 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:55.994637 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-df92184c-6e7e-4c05-adf5-91f5ad802c17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:56.067981 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df92184c-6e7e-4c05-adf5-91f5ad802c17 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:56.072417 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e18e8e-5eff-4e71-b061-b225f9dfc3e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:56.072866 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e18e8e-5eff-4e71-b061-b225f9dfc3e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:56.073201 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e18e8e-5eff-4e71-b061-b225f9dfc3e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:56.073477 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e18e8e-5eff-4e71-b061-b225f9dfc3e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:56.082810 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e18e8e-5eff-4e71-b061-b225f9dfc3e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:56.084259 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e18e8e-5eff-4e71-b061-b225f9dfc3e2 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:56.095828 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1228/2456] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:41:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:41:57.467559 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d14808-90e2-4df5-bd21-0d7db6f83ad1 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:57.468120 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d14808-90e2-4df5-bd21-0d7db6f83ad1 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:57.468120 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d14808-90e2-4df5-bd21-0d7db6f83ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:57.486152 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-a4d14808-90e2-4df5-bd21-0d7db6f83ad1 None None] MFA Rules not processed for user `72acc7b23f594627b3e66d4c380e6e60`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:57.489303 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-a4d14808-90e2-4df5-bd21-0d7db6f83ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:57.495237 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1229/2457] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:41:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:42:01.592728 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4161a96-ab71-47e1-ac24-5d9f1df9a557 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:01.593314 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4161a96-ab71-47e1-ac24-5d9f1df9a557 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:01.593314 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4161a96-ab71-47e1-ac24-5d9f1df9a557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:01.613831 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b4161a96-ab71-47e1-ac24-5d9f1df9a557 None None] MFA Rules not processed for user `512b4337083145f9ae57948a63444ced`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:42:01.615093 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b4161a96-ab71-47e1-ac24-5d9f1df9a557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:42:01.635222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:01.676022 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d14808-90e2-4df5-bd21-0d7db6f83ad1 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:42:01.677473 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-a4d14808-90e2-4df5-bd21-0d7db6f83ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:42:01.679988 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1229/2458] 10.222.0.16 () {58 vars in 1009 bytes} [Thu May 26 12:42:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:42:01.737351 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4161a96-ab71-47e1-ac24-5d9f1df9a557 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:42:01.739200 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b4161a96-ab71-47e1-ac24-5d9f1df9a557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:42:01.766876 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d14808-90e2-4df5-bd21-0d7db6f83ad1 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:42:01.774046 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b62bb31-5b79-40a2-b84e-6d0eb27b01ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536f68ff77794352adf41aaacdc0645c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:42:01.774739 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62bb31-5b79-40a2-b84e-6d0eb27b01ea service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:01.775021 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62bb31-5b79-40a2-b84e-6d0eb27b01ea service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:01.775542 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62bb31-5b79-40a2-b84e-6d0eb27b01ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:01.777425 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-0b62bb31-5b79-40a2-b84e-6d0eb27b01ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:42:01.826781 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4161a96-ab71-47e1-ac24-5d9f1df9a557 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:42:01.833279 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2ca8cc-e76c-4a6f-9c1f-3fde8fe7ca48 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02767dcbd1574e08a9e82a775ac2b289', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:42:01.833937 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ca8cc-e76c-4a6f-9c1f-3fde8fe7ca48 service swift] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:01.834221 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ca8cc-e76c-4a6f-9c1f-3fde8fe7ca48 service swift] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:01.834495 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ca8cc-e76c-4a6f-9c1f-3fde8fe7ca48 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:01.844591 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2ca8cc-e76c-4a6f-9c1f-3fde8fe7ca48 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:42:01.846463 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2ca8cc-e76c-4a6f-9c1f-3fde8fe7ca48 service swift] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:42:01.848191 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b62bb31-5b79-40a2-b84e-6d0eb27b01ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:42:01.849866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b62bb31-5b79-40a2-b84e-6d0eb27b01ea service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:42:01.855999 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1230/2459] 10.222.0.16 () {60 vars in 1384 bytes} [Thu May 26 12:42:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:42:01.863777 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1230/2460] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:42:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:42:11.851924 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=47 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:11.857219 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=88 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:16.634585 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde0df5-476d-4b86-94a1-3903df642ac5 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:16.635155 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde0df5-476d-4b86-94a1-3903df642ac5 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:16.635155 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde0df5-476d-4b86-94a1-3903df642ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:16.657125 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-1cde0df5-476d-4b86-94a1-3903df642ac5 None None] MFA Rules not processed for user `41661c29981b4667a1621e894e3f3d29`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:42:16.658579 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1cde0df5-476d-4b86-94a1-3903df642ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:42:16.668299 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1231/2461] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:42:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:42:16.995845 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b62bb31-5b79-40a2-b84e-6d0eb27b01ea service nova] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:42:16.997386 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-0b62bb31-5b79-40a2-b84e-6d0eb27b01ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:42:17.013321 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b62bb31-5b79-40a2-b84e-6d0eb27b01ea service nova] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:42:17.017197 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e48f1d-2bcc-4ed6-a736-572c943c565f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:42:17.017835 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e48f1d-2bcc-4ed6-a736-572c943c565f service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:17.018119 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e48f1d-2bcc-4ed6-a736-572c943c565f service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:17.018390 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e48f1d-2bcc-4ed6-a736-572c943c565f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:17.020159 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-a1e48f1d-2bcc-4ed6-a736-572c943c565f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:42:17.030829 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e48f1d-2bcc-4ed6-a736-572c943c565f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:42:17.032275 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e48f1d-2bcc-4ed6-a736-572c943c565f service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:42:17.041164 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1231/2462] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:42:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:42:19.505201 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24471190-c1d7-4da2-9dfa-2b32b099ce0e None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:19.505631 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24471190-c1d7-4da2-9dfa-2b32b099ce0e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:19.505781 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24471190-c1d7-4da2-9dfa-2b32b099ce0e None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:19.507179 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1232/2463] 10.222.0.16 () {54 vars in 921 bytes} [Thu May 26 12:42:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:42:19.512550 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd69758-0976-48f8-a21e-f7dfd4a0cece None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:19.513056 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd69758-0976-48f8-a21e-f7dfd4a0cece None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:19.513290 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd69758-0976-48f8-a21e-f7dfd4a0cece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:19.544453 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-6cd69758-0976-48f8-a21e-f7dfd4a0cece None None] MFA Rules not processed for user `536f68ff77794352adf41aaacdc0645c`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:42:19.545911 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-6cd69758-0976-48f8-a21e-f7dfd4a0cece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:42:19.564333 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1232/2464] 10.222.0.16 () {58 vars in 1018 bytes} [Thu May 26 12:42:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:42:19.579729 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24471190-c1d7-4da2-9dfa-2b32b099ce0e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:42:19.581568 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-24471190-c1d7-4da2-9dfa-2b32b099ce0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:42:19.697608 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24471190-c1d7-4da2-9dfa-2b32b099ce0e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:42:19.704151 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537502f-5cd3-4bbc-a097-8d99c9f8b773 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad8cfccd3a4d42d381ce62ea90849f19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:42:19.705000 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537502f-5cd3-4bbc-a097-8d99c9f8b773 service glance] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:19.705401 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537502f-5cd3-4bbc-a097-8d99c9f8b773 service glance] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:19.705782 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537502f-5cd3-4bbc-a097-8d99c9f8b773 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:19.732558 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7537502f-5cd3-4bbc-a097-8d99c9f8b773 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:42:19.734085 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7537502f-5cd3-4bbc-a097-8d99c9f8b773 service glance] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:42:19.748032 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1233/2465] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:42:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:42:24.202136 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59d1d6-3bb6-4491-906b-d351fa1e6e9a None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:24.202590 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59d1d6-3bb6-4491-906b-d351fa1e6e9a None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:24.202705 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59d1d6-3bb6-4491-906b-d351fa1e6e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:24.220706 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-eb59d1d6-3bb6-4491-906b-d351fa1e6e9a None None] MFA Rules not processed for user `512b4337083145f9ae57948a63444ced`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:42:24.221949 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-eb59d1d6-3bb6-4491-906b-d351fa1e6e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:42:24.229282 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1233/2466] 10.222.0.16 () {58 vars in 1009 bytes} [Thu May 26 12:42:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:42:24.241150 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537502f-5cd3-4bbc-a097-8d99c9f8b773 service glance] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:42:24.253693 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537502f-5cd3-4bbc-a097-8d99c9f8b773 service glance] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:42:24.259323 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36167d-9123-4140-984b-5fceef6aac38 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02767dcbd1574e08a9e82a775ac2b289', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:42:24.259916 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36167d-9123-4140-984b-5fceef6aac38 service swift] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:24.260208 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36167d-9123-4140-984b-5fceef6aac38 service swift] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:24.260489 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36167d-9123-4140-984b-5fceef6aac38 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:24.269715 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da36167d-9123-4140-984b-5fceef6aac38 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:42:24.271559 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da36167d-9123-4140-984b-5fceef6aac38 service swift] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:42:24.282354 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1234/2467] 10.222.0.16 () {60 vars in 1384 bytes} [Thu May 26 12:42:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:42:34.215843 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=12 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:34.278034 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=35 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:36.707903 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb59d1d6-3bb6-4491-906b-d351fa1e6e9a None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:42:36.718461 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb59d1d6-3bb6-4491-906b-d351fa1e6e9a None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:42:36.724716 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b49f601-06a9-4b48-bbb9-b26f799d6282 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:42:36.725502 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b49f601-06a9-4b48-bbb9-b26f799d6282 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:36.725894 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b49f601-06a9-4b48-bbb9-b26f799d6282 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:36.726370 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b49f601-06a9-4b48-bbb9-b26f799d6282 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:36.728369 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-8b49f601-06a9-4b48-bbb9-b26f799d6282 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:42:36.805048 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b49f601-06a9-4b48-bbb9-b26f799d6282 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:42:36.807284 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b49f601-06a9-4b48-bbb9-b26f799d6282 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:42:36.818546 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1234/2468] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:42:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:42:46.443824 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76362f65-7c47-4719-99db-d1c65056cfa2 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:46.444818 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76362f65-7c47-4719-99db-d1c65056cfa2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:46.445321 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76362f65-7c47-4719-99db-d1c65056cfa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:46.481831 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-76362f65-7c47-4719-99db-d1c65056cfa2 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:42:46.483256 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-76362f65-7c47-4719-99db-d1c65056cfa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:42:46.491763 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1235/2469] 10.222.0.73 () {58 vars in 1016 bytes} [Thu May 26 12:42:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:42:46.514458 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b49f601-06a9-4b48-bbb9-b26f799d6282 service neutron] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:42:46.518012 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-8b49f601-06a9-4b48-bbb9-b26f799d6282 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:42:46.545827 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b49f601-06a9-4b48-bbb9-b26f799d6282 service neutron] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:42:46.555148 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f879d957-048f-4e54-b941-32e4fea4c6e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536f68ff77794352adf41aaacdc0645c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:42:46.556646 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879d957-048f-4e54-b941-32e4fea4c6e3 service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:46.557101 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879d957-048f-4e54-b941-32e4fea4c6e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:46.557390 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879d957-048f-4e54-b941-32e4fea4c6e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:46.575080 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f879d957-048f-4e54-b941-32e4fea4c6e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:42:46.577916 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f879d957-048f-4e54-b941-32e4fea4c6e3 service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:42:46.592960 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1235/2470] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:42:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:42:47.168568 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76362f65-7c47-4719-99db-d1c65056cfa2 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:42:47.179302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76362f65-7c47-4719-99db-d1c65056cfa2 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:42:47.183873 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d77bb0-8d83-4237-9c64-373b9f5b7b00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:42:47.184530 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d77bb0-8d83-4237-9c64-373b9f5b7b00 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:47.184809 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d77bb0-8d83-4237-9c64-373b9f5b7b00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:47.185108 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d77bb0-8d83-4237-9c64-373b9f5b7b00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:47.186898 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f3d77bb0-8d83-4237-9c64-373b9f5b7b00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:42:47.202697 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d77bb0-8d83-4237-9c64-373b9f5b7b00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:42:47.205040 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d77bb0-8d83-4237-9c64-373b9f5b7b00 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:42:47.216961 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1236/2471] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:42:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:42:47.884231 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7589d0-06cf-4674-bfb2-c78846432461 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:47.884779 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7589d0-06cf-4674-bfb2-c78846432461 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:47.884779 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7589d0-06cf-4674-bfb2-c78846432461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:47.915384 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-3a7589d0-06cf-4674-bfb2-c78846432461 None None] MFA Rules not processed for user `512b4337083145f9ae57948a63444ced`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:42:47.917215 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-3a7589d0-06cf-4674-bfb2-c78846432461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:42:47.934853 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1236/2472] 10.222.0.16 () {58 vars in 967 bytes} [Thu May 26 12:42:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:42:47.950658 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d77bb0-8d83-4237-9c64-373b9f5b7b00 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:42:47.967010 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d77bb0-8d83-4237-9c64-373b9f5b7b00 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:42:47.972635 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85171e-ee5d-49aa-8146-7c69a4ff031e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02767dcbd1574e08a9e82a775ac2b289', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:42:47.973850 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85171e-ee5d-49aa-8146-7c69a4ff031e service swift] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:47.975537 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85171e-ee5d-49aa-8146-7c69a4ff031e service swift] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:47.976041 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85171e-ee5d-49aa-8146-7c69a4ff031e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:47.991598 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd85171e-ee5d-49aa-8146-7c69a4ff031e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:42:47.993868 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd85171e-ee5d-49aa-8146-7c69a4ff031e service swift] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:42:48.008310 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1237/2473] 10.222.0.16 () {60 vars in 1384 bytes} [Thu May 26 12:42:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:42:50.627537 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7133773-ecbe-450e-ba8b-3c55737f0da4 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:50.628052 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7133773-ecbe-450e-ba8b-3c55737f0da4 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:50.628169 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7133773-ecbe-450e-ba8b-3c55737f0da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:50.652319 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-c7133773-ecbe-450e-ba8b-3c55737f0da4 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:42:50.653582 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-c7133773-ecbe-450e-ba8b-3c55737f0da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:42:50.662542 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1237/2474] 10.222.0.73 () {58 vars in 1016 bytes} [Thu May 26 12:42:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:42:50.684219 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85171e-ee5d-49aa-8146-7c69a4ff031e service swift] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:42:50.700049 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85171e-ee5d-49aa-8146-7c69a4ff031e service swift] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:42:50.709892 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccbda1b-7100-4b14-a8c3-0d898afc229b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536f68ff77794352adf41aaacdc0645c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:42:50.710565 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbda1b-7100-4b14-a8c3-0d898afc229b service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:50.710900 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbda1b-7100-4b14-a8c3-0d898afc229b service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:50.711213 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbda1b-7100-4b14-a8c3-0d898afc229b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:50.726769 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccbda1b-7100-4b14-a8c3-0d898afc229b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:42:50.729065 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccbda1b-7100-4b14-a8c3-0d898afc229b service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:42:50.740938 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1238/2475] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:42:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:42:54.636171 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7133773-ecbe-450e-ba8b-3c55737f0da4 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:42:54.637809 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-c7133773-ecbe-450e-ba8b-3c55737f0da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:42:54.661809 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7133773-ecbe-450e-ba8b-3c55737f0da4 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:42:54.673394 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba6299-12e6-4e31-aace-b0e5a4831d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:42:54.674315 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba6299-12e6-4e31-aace-b0e5a4831d72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:54.674592 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba6299-12e6-4e31-aace-b0e5a4831d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:54.675136 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba6299-12e6-4e31-aace-b0e5a4831d72 admin admin] PATH_INFO: `/v3/users/bdba02b8e51c463b9ba36e0ff7cccdc3` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:54.678065 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dba6299-12e6-4e31-aace-b0e5a4831d72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdba02b8e51c463b9ba36e0ff7cccdc3)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:42:54.680412 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dba6299-12e6-4e31-aace-b0e5a4831d72 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:42:54.750920 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-4dba6299-12e6-4e31-aace-b0e5a4831d72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdba02b8e51c463b9ba36e0ff7cccdc3'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:42:54.751961 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-4dba6299-12e6-4e31-aace-b0e5a4831d72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdba02b8e51c463b9ba36e0ff7cccdc3'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:42:54.752985 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-4dba6299-12e6-4e31-aace-b0e5a4831d72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdba02b8e51c463b9ba36e0ff7cccdc3'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:42:54.763490 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-4dba6299-12e6-4e31-aace-b0e5a4831d72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdba02b8e51c463b9ba36e0ff7cccdc3'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:42:54.784203 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-4dba6299-12e6-4e31-aace-b0e5a4831d72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdba02b8e51c463b9ba36e0ff7cccdc3'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:42:54.796296 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1238/2476] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:42:54 2022] DELETE /identity/v3/users/bdba02b8e51c463b9ba36e0ff7cccdc3 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:42:54.993954 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccbda1b-7100-4b14-a8c3-0d898afc229b service nova] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:42:55.013782 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccbda1b-7100-4b14-a8c3-0d898afc229b service nova] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:42:55.089414 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc65389-d94c-4727-8c68-23b1a4b5b2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:42:55.090682 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc65389-d94c-4727-8c68-23b1a4b5b2b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:55.091143 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc65389-d94c-4727-8c68-23b1a4b5b2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:55.091517 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc65389-d94c-4727-8c68-23b1a4b5b2b0 admin admin] PATH_INFO: `/v3/projects/a7ec5ce3eac943739d13c7c7fc2eaf85` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:55.093205 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc65389-d94c-4727-8c68-23b1a4b5b2b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7ec5ce3eac943739d13c7c7fc2eaf85)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:42:55.095791 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc65389-d94c-4727-8c68-23b1a4b5b2b0 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:42:55.145322 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ebc65389-d94c-4727-8c68-23b1a4b5b2b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7ec5ce3eac943739d13c7c7fc2eaf85', 'request_id': 'req-ebc65389-d94c-4727-8c68-23b1a4b5b2b0'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:42:55.152072 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ebc65389-d94c-4727-8c68-23b1a4b5b2b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7ec5ce3eac943739d13c7c7fc2eaf85', 'request_id': 'req-ebc65389-d94c-4727-8c68-23b1a4b5b2b0'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:42:55.158690 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ebc65389-d94c-4727-8c68-23b1a4b5b2b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7ec5ce3eac943739d13c7c7fc2eaf85', 'request_id': 'req-ebc65389-d94c-4727-8c68-23b1a4b5b2b0'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:42:55.172040 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ebc65389-d94c-4727-8c68-23b1a4b5b2b0 admin admin] The token cache is being invalidate because project a7ec5ce3eac943739d13c7c7fc2eaf85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:42:55.172333 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ebc65389-d94c-4727-8c68-23b1a4b5b2b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:42:55.173045 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ebc65389-d94c-4727-8c68-23b1a4b5b2b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:42:55.174650 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1239/2477] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:42:54 2022] DELETE /identity/v3/projects/a7ec5ce3eac943739d13c7c7fc2eaf85 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:42:55.178816 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba6299-12e6-4e31-aace-b0e5a4831d72 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:42:55.180806 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-4dba6299-12e6-4e31-aace-b0e5a4831d72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:42:55.194552 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba6299-12e6-4e31-aace-b0e5a4831d72 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:42:55.246173 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:55.263667 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880b0160-f50f-4b9a-9f23-109751a30823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:42:55.264477 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b0160-f50f-4b9a-9f23-109751a30823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:55.264763 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b0160-f50f-4b9a-9f23-109751a30823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:55.265083 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b0160-f50f-4b9a-9f23-109751a30823 admin admin] PATH_INFO: `/v3/users/7ecf1c752f744460978f311c2a5faa13` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:55.266323 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880b0160-f50f-4b9a-9f23-109751a30823 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ecf1c752f744460978f311c2a5faa13)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:42:55.268302 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880b0160-f50f-4b9a-9f23-109751a30823 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:42:55.322896 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-880b0160-f50f-4b9a-9f23-109751a30823 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ecf1c752f744460978f311c2a5faa13'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:42:55.323574 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-880b0160-f50f-4b9a-9f23-109751a30823 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ecf1c752f744460978f311c2a5faa13'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:42:55.324192 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-880b0160-f50f-4b9a-9f23-109751a30823 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ecf1c752f744460978f311c2a5faa13'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:42:55.332476 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-880b0160-f50f-4b9a-9f23-109751a30823 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ecf1c752f744460978f311c2a5faa13'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:42:55.344915 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-880b0160-f50f-4b9a-9f23-109751a30823 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ecf1c752f744460978f311c2a5faa13'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:42:55.357810 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1239/2478] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:42:55 2022] DELETE /identity/v3/users/7ecf1c752f744460978f311c2a5faa13 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:42:55.536005 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc65389-d94c-4727-8c68-23b1a4b5b2b0 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:42:55.537520 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ebc65389-d94c-4727-8c68-23b1a4b5b2b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:42:55.552339 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc65389-d94c-4727-8c68-23b1a4b5b2b0 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:42:55.596472 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:55.613219 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4574349e-1f58-4f7d-b80b-f1bb2fd4911c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:42:55.614129 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574349e-1f58-4f7d-b80b-f1bb2fd4911c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:55.614409 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574349e-1f58-4f7d-b80b-f1bb2fd4911c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:55.614795 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574349e-1f58-4f7d-b80b-f1bb2fd4911c admin admin] PATH_INFO: `/v3/projects/e52e523cdbac4cfb8e4cc1456404d854` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:55.615938 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4574349e-1f58-4f7d-b80b-f1bb2fd4911c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e52e523cdbac4cfb8e4cc1456404d854)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:42:55.617938 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4574349e-1f58-4f7d-b80b-f1bb2fd4911c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:42:55.663581 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-4574349e-1f58-4f7d-b80b-f1bb2fd4911c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e52e523cdbac4cfb8e4cc1456404d854', 'request_id': 'req-4574349e-1f58-4f7d-b80b-f1bb2fd4911c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:42:55.669642 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-4574349e-1f58-4f7d-b80b-f1bb2fd4911c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e52e523cdbac4cfb8e4cc1456404d854', 'request_id': 'req-4574349e-1f58-4f7d-b80b-f1bb2fd4911c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:42:55.676442 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-4574349e-1f58-4f7d-b80b-f1bb2fd4911c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e52e523cdbac4cfb8e4cc1456404d854', 'request_id': 'req-4574349e-1f58-4f7d-b80b-f1bb2fd4911c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:42:55.690250 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-4574349e-1f58-4f7d-b80b-f1bb2fd4911c admin admin] The token cache is being invalidate because project e52e523cdbac4cfb8e4cc1456404d854 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:42:55.690731 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-4574349e-1f58-4f7d-b80b-f1bb2fd4911c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:42:55.691397 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-4574349e-1f58-4f7d-b80b-f1bb2fd4911c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:42:55.693275 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1240/2479] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:42:55 2022] DELETE /identity/v3/projects/e52e523cdbac4cfb8e4cc1456404d854 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:42:56.029522 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888479f-df8f-4d0c-9021-aff6ebad0b9a None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:56.030512 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888479f-df8f-4d0c-9021-aff6ebad0b9a None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:56.030802 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888479f-df8f-4d0c-9021-aff6ebad0b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:56.053206 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-f888479f-df8f-4d0c-9021-aff6ebad0b9a None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:42:56.054474 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-f888479f-df8f-4d0c-9021-aff6ebad0b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:42:56.135252 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1240/2480] 10.222.0.73 () {58 vars in 1016 bytes} [Thu May 26 12:42:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:42:56.157941 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4574349e-1f58-4f7d-b80b-f1bb2fd4911c admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:42:56.159763 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4574349e-1f58-4f7d-b80b-f1bb2fd4911c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:42:56.246092 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4574349e-1f58-4f7d-b80b-f1bb2fd4911c admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:42:56.252130 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c170b271-9918-400f-82f2-cc19d17251a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536f68ff77794352adf41aaacdc0645c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:42:56.252942 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170b271-9918-400f-82f2-cc19d17251a6 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:56.253224 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170b271-9918-400f-82f2-cc19d17251a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:56.253523 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170b271-9918-400f-82f2-cc19d17251a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:56.263601 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c170b271-9918-400f-82f2-cc19d17251a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:42:56.265298 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c170b271-9918-400f-82f2-cc19d17251a6 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:42:56.275932 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1241/2481] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:42:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:43:01.163309 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2554fc9-b16d-48a4-b64b-583cd234a02a None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:01.164396 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2554fc9-b16d-48a4-b64b-583cd234a02a None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:01.164870 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2554fc9-b16d-48a4-b64b-583cd234a02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:01.210107 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-c2554fc9-b16d-48a4-b64b-583cd234a02a None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:43:01.222212 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-c2554fc9-b16d-48a4-b64b-583cd234a02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:01.223965 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1241/2482] 10.222.0.73 () {58 vars in 1016 bytes} [Thu May 26 12:43:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:43:01.249290 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c170b271-9918-400f-82f2-cc19d17251a6 service nova] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:01.265370 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c170b271-9918-400f-82f2-cc19d17251a6 service nova] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:01.273871 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba0be8c-b6d1-4b82-8eda-9faaa04e0c15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536f68ff77794352adf41aaacdc0645c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:01.274801 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0be8c-b6d1-4b82-8eda-9faaa04e0c15 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:01.275195 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0be8c-b6d1-4b82-8eda-9faaa04e0c15 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:01.275568 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0be8c-b6d1-4b82-8eda-9faaa04e0c15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:01.290414 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba0be8c-b6d1-4b82-8eda-9faaa04e0c15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:01.292689 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba0be8c-b6d1-4b82-8eda-9faaa04e0c15 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:01.307548 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1242/2483] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:43:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:43:05.345153 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359017a5-710b-456b-a9c5-ca65ef338dec None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:05.345788 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359017a5-710b-456b-a9c5-ca65ef338dec None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:05.345788 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359017a5-710b-456b-a9c5-ca65ef338dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:05.366371 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-359017a5-710b-456b-a9c5-ca65ef338dec None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:43:05.367671 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-359017a5-710b-456b-a9c5-ca65ef338dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:05.377423 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1242/2484] 10.222.0.73 () {58 vars in 1016 bytes} [Thu May 26 12:43:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:43:05.410062 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba0be8c-b6d1-4b82-8eda-9faaa04e0c15 service nova] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:05.422251 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba0be8c-b6d1-4b82-8eda-9faaa04e0c15 service nova] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:05.428113 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fdc34a-4dcc-4d59-86e9-86216562dcce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536f68ff77794352adf41aaacdc0645c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:05.429438 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fdc34a-4dcc-4d59-86e9-86216562dcce service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:05.429766 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fdc34a-4dcc-4d59-86e9-86216562dcce service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:05.430112 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fdc34a-4dcc-4d59-86e9-86216562dcce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:05.438574 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fdc34a-4dcc-4d59-86e9-86216562dcce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:05.440148 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fdc34a-4dcc-4d59-86e9-86216562dcce service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:05.449451 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1243/2485] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:43:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:43:07.693644 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359017a5-710b-456b-a9c5-ca65ef338dec None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:07.695027 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-359017a5-710b-456b-a9c5-ca65ef338dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:07.751588 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359017a5-710b-456b-a9c5-ca65ef338dec None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:07.755299 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a06fca-593c-4231-a764-97ccd06e5b1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:07.755939 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a06fca-593c-4231-a764-97ccd06e5b1e service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:07.756223 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a06fca-593c-4231-a764-97ccd06e5b1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:07.756503 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a06fca-593c-4231-a764-97ccd06e5b1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:07.758332 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-e7a06fca-593c-4231-a764-97ccd06e5b1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:07.766854 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:07.771865 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a06fca-593c-4231-a764-97ccd06e5b1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:07.773805 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a06fca-593c-4231-a764-97ccd06e5b1e service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:07.784213 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1243/2486] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:43:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:43:09.537118 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b700224-2aae-48f2-a104-93bed27593cf None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:09.537731 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b700224-2aae-48f2-a104-93bed27593cf None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:09.537731 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b700224-2aae-48f2-a104-93bed27593cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:09.557080 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-7b700224-2aae-48f2-a104-93bed27593cf None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:43:09.558317 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7b700224-2aae-48f2-a104-93bed27593cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:09.567448 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1244/2487] 10.222.0.73 () {58 vars in 1016 bytes} [Thu May 26 12:43:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:43:09.591203 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a06fca-593c-4231-a764-97ccd06e5b1e service neutron] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:09.592796 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-e7a06fca-593c-4231-a764-97ccd06e5b1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:09.610983 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a06fca-593c-4231-a764-97ccd06e5b1e service neutron] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:09.619400 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f16aa4c-6817-4113-834f-d8f18bebd026 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536f68ff77794352adf41aaacdc0645c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:09.620158 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16aa4c-6817-4113-834f-d8f18bebd026 service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:09.620513 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16aa4c-6817-4113-834f-d8f18bebd026 service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:09.620944 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16aa4c-6817-4113-834f-d8f18bebd026 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:09.631411 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f16aa4c-6817-4113-834f-d8f18bebd026 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:09.632961 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f16aa4c-6817-4113-834f-d8f18bebd026 service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:09.644547 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1244/2488] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:43:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:43:10.959674 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b700224-2aae-48f2-a104-93bed27593cf None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:10.961340 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7b700224-2aae-48f2-a104-93bed27593cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:10.978486 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b700224-2aae-48f2-a104-93bed27593cf None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:10.983841 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae4d66f-b7f2-4867-97bc-d05d62de841d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:10.984742 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4d66f-b7f2-4867-97bc-d05d62de841d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:10.985669 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4d66f-b7f2-4867-97bc-d05d62de841d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:10.985955 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4d66f-b7f2-4867-97bc-d05d62de841d admin admin] PATH_INFO: `/v3/users/ae9585c4fe0c4d0eb1a820c9dc096a89` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:10.987222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae4d66f-b7f2-4867-97bc-d05d62de841d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae9585c4fe0c4d0eb1a820c9dc096a89)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:10.989226 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae4d66f-b7f2-4867-97bc-d05d62de841d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:11.014322 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:11.041767 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0ae4d66f-b7f2-4867-97bc-d05d62de841d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae9585c4fe0c4d0eb1a820c9dc096a89'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:11.049387 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0ae4d66f-b7f2-4867-97bc-d05d62de841d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae9585c4fe0c4d0eb1a820c9dc096a89'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:11.050011 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0ae4d66f-b7f2-4867-97bc-d05d62de841d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae9585c4fe0c4d0eb1a820c9dc096a89'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:11.050615 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0ae4d66f-b7f2-4867-97bc-d05d62de841d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae9585c4fe0c4d0eb1a820c9dc096a89'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:11.057662 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0ae4d66f-b7f2-4867-97bc-d05d62de841d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae9585c4fe0c4d0eb1a820c9dc096a89'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:11.075653 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1245/2489] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:43:10 2022] DELETE /identity/v3/users/ae9585c4fe0c4d0eb1a820c9dc096a89 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:43:11.252244 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f16aa4c-6817-4113-834f-d8f18bebd026 service nova] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:11.264473 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f16aa4c-6817-4113-834f-d8f18bebd026 service nova] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:11.329123 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8882296c-4783-410d-a0ef-fe8e97f51070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:11.329984 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882296c-4783-410d-a0ef-fe8e97f51070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:11.330267 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882296c-4783-410d-a0ef-fe8e97f51070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:11.330542 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882296c-4783-410d-a0ef-fe8e97f51070 admin admin] PATH_INFO: `/v3/projects/d73ca88003e44889b870613430f4d51e` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:11.331715 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8882296c-4783-410d-a0ef-fe8e97f51070 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d73ca88003e44889b870613430f4d51e)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:11.333646 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8882296c-4783-410d-a0ef-fe8e97f51070 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:11.395829 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-8882296c-4783-410d-a0ef-fe8e97f51070 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd73ca88003e44889b870613430f4d51e', 'request_id': 'req-8882296c-4783-410d-a0ef-fe8e97f51070'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:11.405238 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-8882296c-4783-410d-a0ef-fe8e97f51070 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd73ca88003e44889b870613430f4d51e', 'request_id': 'req-8882296c-4783-410d-a0ef-fe8e97f51070'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:11.412554 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-8882296c-4783-410d-a0ef-fe8e97f51070 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd73ca88003e44889b870613430f4d51e', 'request_id': 'req-8882296c-4783-410d-a0ef-fe8e97f51070'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:11.423918 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-8882296c-4783-410d-a0ef-fe8e97f51070 admin admin] The token cache is being invalidate because project d73ca88003e44889b870613430f4d51e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:43:11.424206 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-8882296c-4783-410d-a0ef-fe8e97f51070 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:11.424897 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-8882296c-4783-410d-a0ef-fe8e97f51070 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:11.426441 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1245/2490] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:43:11 2022] DELETE /identity/v3/projects/d73ca88003e44889b870613430f4d51e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:43:11.431422 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fccd86e-48b9-4355-82a0-de4ad93ca8cc None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:11.431714 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fccd86e-48b9-4355-82a0-de4ad93ca8cc None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:11.431993 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fccd86e-48b9-4355-82a0-de4ad93ca8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:11.450431 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-6fccd86e-48b9-4355-82a0-de4ad93ca8cc None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:43:11.451611 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6fccd86e-48b9-4355-82a0-de4ad93ca8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:11.513365 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1246/2491] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:43:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:43:11.521086 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a9587-0492-429b-9417-7f162f999955 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:11.521375 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a9587-0492-429b-9417-7f162f999955 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:11.521653 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a9587-0492-429b-9417-7f162f999955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:11.540867 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-7a5a9587-0492-429b-9417-7f162f999955 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:43:11.542079 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-7a5a9587-0492-429b-9417-7f162f999955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:11.550016 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1246/2492] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:43:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:43:11.554693 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fccd86e-48b9-4355-82a0-de4ad93ca8cc None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:11.564401 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fccd86e-48b9-4355-82a0-de4ad93ca8cc None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:11.569650 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9194b394-3eee-4421-a84d-4516f0e92a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:11.570314 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194b394-3eee-4421-a84d-4516f0e92a63 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:11.570600 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194b394-3eee-4421-a84d-4516f0e92a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:11.570881 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194b394-3eee-4421-a84d-4516f0e92a63 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:11.571613 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9194b394-3eee-4421-a84d-4516f0e92a63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:43:11.571925 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9194b394-3eee-4421-a84d-4516f0e92a63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:11.573571 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9194b394-3eee-4421-a84d-4516f0e92a63 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:11.585781 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1247/2493] 10.222.0.16 () {58 vars in 1152 bytes} [Thu May 26 12:43:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:43:11.589846 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a9587-0492-429b-9417-7f162f999955 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:11.599120 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a9587-0492-429b-9417-7f162f999955 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:11.604268 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee43f2b-f291-4866-b34a-92d306c6a6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:11.604937 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee43f2b-f291-4866-b34a-92d306c6a6c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:11.605223 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee43f2b-f291-4866-b34a-92d306c6a6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:11.605495 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee43f2b-f291-4866-b34a-92d306c6a6c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:11.606187 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee43f2b-f291-4866-b34a-92d306c6a6c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:11.608106 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee43f2b-f291-4866-b34a-92d306c6a6c9 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:11.633689 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1247/2494] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:43:11 2022] POST /identity/v3/projects => generated 369 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:43:11.637859 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9194b394-3eee-4421-a84d-4516f0e92a63 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:11.648583 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9194b394-3eee-4421-a84d-4516f0e92a63 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:11.708111 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e6056-7c03-4962-9589-b187d52ec90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:11.708799 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e6056-7c03-4962-9589-b187d52ec90a admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:11.709127 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e6056-7c03-4962-9589-b187d52ec90a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:11.709405 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e6056-7c03-4962-9589-b187d52ec90a admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:11.710113 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e6056-7c03-4962-9589-b187d52ec90a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:11.712109 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e6056-7c03-4962-9589-b187d52ec90a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:11.733764 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1248/2495] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:43:11 2022] POST /identity/v3/users => generated 285 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:43:11.738085 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee43f2b-f291-4866-b34a-92d306c6a6c9 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:11.749701 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee43f2b-f291-4866-b34a-92d306c6a6c9 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:11.755613 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4c9f88-5beb-46c5-b6f7-3fe97cb4f2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:11.755758 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c9f88-5beb-46c5-b6f7-3fe97cb4f2f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:11.756241 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c9f88-5beb-46c5-b6f7-3fe97cb4f2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:11.757132 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c9f88-5beb-46c5-b6f7-3fe97cb4f2f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:11.757990 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4c9f88-5beb-46c5-b6f7-3fe97cb4f2f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:11.759691 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4c9f88-5beb-46c5-b6f7-3fe97cb4f2f3 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:11.771514 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1248/2496] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:43:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:43:11.775798 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e6056-7c03-4962-9589-b187d52ec90a admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:11.786292 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e6056-7c03-4962-9589-b187d52ec90a admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:11.791451 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23b76b0-a8e2-4865-969a-dfe209cb92a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:11.792174 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b76b0-a8e2-4865-969a-dfe209cb92a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:11.792462 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b76b0-a8e2-4865-969a-dfe209cb92a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:11.792743 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b76b0-a8e2-4865-969a-dfe209cb92a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:11.793513 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23b76b0-a8e2-4865-969a-dfe209cb92a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:11.795137 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23b76b0-a8e2-4865-969a-dfe209cb92a1 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:11.806611 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1249/2497] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:43:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:43:11.810811 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4c9f88-5beb-46c5-b6f7-3fe97cb4f2f3 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:11.821626 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4c9f88-5beb-46c5-b6f7-3fe97cb4f2f3 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:11.826881 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20baf1b5-d190-4405-87f9-93a73f0cd94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:11.827913 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20baf1b5-d190-4405-87f9-93a73f0cd94e admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:11.828202 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20baf1b5-d190-4405-87f9-93a73f0cd94e admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:11.828482 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20baf1b5-d190-4405-87f9-93a73f0cd94e admin admin] PATH_INFO: `/v3/projects/6b9185b5f3424a73a30f7712572818a8/users/07cc8d992ce646a8b1afbe649e774477/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:11.847070 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20baf1b5-d190-4405-87f9-93a73f0cd94e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b9185b5f3424a73a30f7712572818a8, user_id=07cc8d992ce646a8b1afbe649e774477, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:11.850009 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20baf1b5-d190-4405-87f9-93a73f0cd94e admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:11.864152 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1249/2498] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:43:11 2022] PUT /identity/v3/projects/6b9185b5f3424a73a30f7712572818a8/users/07cc8d992ce646a8b1afbe649e774477/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:43:11.875956 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df703d8-14be-46ff-add7-e76606d40109 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:11.876271 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df703d8-14be-46ff-add7-e76606d40109 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:11.876554 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df703d8-14be-46ff-add7-e76606d40109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:11.884319 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:11.905891 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-7df703d8-14be-46ff-add7-e76606d40109 None None] MFA Rules not processed for user `07cc8d992ce646a8b1afbe649e774477`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:43:11.907028 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7df703d8-14be-46ff-add7-e76606d40109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:11.969822 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1250/2499] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:43:11 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:43:11.974327 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20baf1b5-d190-4405-87f9-93a73f0cd94e admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:11.983451 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:12.038766 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20baf1b5-d190-4405-87f9-93a73f0cd94e admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:12.043577 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe616d9-a750-49f8-bcfa-435d71c21dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:12.044257 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe616d9-a750-49f8-bcfa-435d71c21dce admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:12.044546 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe616d9-a750-49f8-bcfa-435d71c21dce admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:12.044826 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe616d9-a750-49f8-bcfa-435d71c21dce admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:12.045558 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe616d9-a750-49f8-bcfa-435d71c21dce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:12.047462 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe616d9-a750-49f8-bcfa-435d71c21dce admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:12.073212 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1250/2500] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:43:11 2022] POST /identity/v3/projects => generated 367 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:43:12.077703 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df703d8-14be-46ff-add7-e76606d40109 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:12.089513 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df703d8-14be-46ff-add7-e76606d40109 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:12.146005 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa7a20-50c8-45e1-a3f0-1c5530a80be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:12.146677 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa7a20-50c8-45e1-a3f0-1c5530a80be7 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:12.146964 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa7a20-50c8-45e1-a3f0-1c5530a80be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:12.147240 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa7a20-50c8-45e1-a3f0-1c5530a80be7 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:12.147932 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa7a20-50c8-45e1-a3f0-1c5530a80be7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:12.149917 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa7a20-50c8-45e1-a3f0-1c5530a80be7 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:12.169273 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1251/2501] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:43:12 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:43:12.173195 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe616d9-a750-49f8-bcfa-435d71c21dce admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:12.184433 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe616d9-a750-49f8-bcfa-435d71c21dce admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:12.189049 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b30f1a-f73d-4079-85cb-e2aff010f591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:12.189699 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b30f1a-f73d-4079-85cb-e2aff010f591 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:12.189979 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b30f1a-f73d-4079-85cb-e2aff010f591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:12.190251 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b30f1a-f73d-4079-85cb-e2aff010f591 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:12.190971 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b30f1a-f73d-4079-85cb-e2aff010f591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:12.192577 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b30f1a-f73d-4079-85cb-e2aff010f591 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:12.204509 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1251/2502] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:43:12.208820 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa7a20-50c8-45e1-a3f0-1c5530a80be7 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:12.220545 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa7a20-50c8-45e1-a3f0-1c5530a80be7 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:12.225240 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e5c2e8-02a4-43fa-a655-3ff32dafb32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:12.226081 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e5c2e8-02a4-43fa-a655-3ff32dafb32c admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:12.226384 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e5c2e8-02a4-43fa-a655-3ff32dafb32c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:12.226683 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e5c2e8-02a4-43fa-a655-3ff32dafb32c admin admin] PATH_INFO: `/v3/projects/53e5b1b618fa45c7964480eade1d135e/users/1be82f997bf54e329df309fc7e40a854/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:12.242801 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e5c2e8-02a4-43fa-a655-3ff32dafb32c admin admin] RBAC: Authorizing `identity:create_grant(project_id=53e5b1b618fa45c7964480eade1d135e, user_id=1be82f997bf54e329df309fc7e40a854, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:12.245721 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e5c2e8-02a4-43fa-a655-3ff32dafb32c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:12.263008 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1252/2503] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:43:12 2022] PUT /identity/v3/projects/53e5b1b618fa45c7964480eade1d135e/users/1be82f997bf54e329df309fc7e40a854/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:43:12.266937 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b30f1a-f73d-4079-85cb-e2aff010f591 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:12.278920 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b30f1a-f73d-4079-85cb-e2aff010f591 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:12.341644 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8be2f2-ddd5-4ab3-b50f-5d9592c1e4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:12.342308 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8be2f2-ddd5-4ab3-b50f-5d9592c1e4d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:12.342615 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8be2f2-ddd5-4ab3-b50f-5d9592c1e4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:12.342886 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8be2f2-ddd5-4ab3-b50f-5d9592c1e4d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:12.343613 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8be2f2-ddd5-4ab3-b50f-5d9592c1e4d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:12.345261 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8be2f2-ddd5-4ab3-b50f-5d9592c1e4d1 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:12.355758 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1252/2504] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:43:12.359946 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e5c2e8-02a4-43fa-a655-3ff32dafb32c admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:12.370975 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e5c2e8-02a4-43fa-a655-3ff32dafb32c admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:12.375959 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d02a1e-235f-44b2-9f05-00ff5ffc4220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:12.376853 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d02a1e-235f-44b2-9f05-00ff5ffc4220 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:12.377155 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d02a1e-235f-44b2-9f05-00ff5ffc4220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:12.377431 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d02a1e-235f-44b2-9f05-00ff5ffc4220 admin admin] PATH_INFO: `/v3/projects/53e5b1b618fa45c7964480eade1d135e/users/1be82f997bf54e329df309fc7e40a854/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:12.379514 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d02a1e-235f-44b2-9f05-00ff5ffc4220 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53e5b1b618fa45c7964480eade1d135e, user_id=1be82f997bf54e329df309fc7e40a854, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:12.382246 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d02a1e-235f-44b2-9f05-00ff5ffc4220 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:12.393234 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1253/2505] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:43:12 2022] PUT /identity/v3/projects/53e5b1b618fa45c7964480eade1d135e/users/1be82f997bf54e329df309fc7e40a854/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:43:12.404025 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee80adc-f03d-4596-a4d8-533d1bd0b11d None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:12.404401 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee80adc-f03d-4596-a4d8-533d1bd0b11d None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:12.404742 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee80adc-f03d-4596-a4d8-533d1bd0b11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:12.442637 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-eee80adc-f03d-4596-a4d8-533d1bd0b11d None None] MFA Rules not processed for user `1be82f997bf54e329df309fc7e40a854`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:43:12.444411 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-eee80adc-f03d-4596-a4d8-533d1bd0b11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:12.515987 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1253/2506] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:43:12 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:43:12.527406 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d02a1e-235f-44b2-9f05-00ff5ffc4220 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:12.529239 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-43d02a1e-235f-44b2-9f05-00ff5ffc4220 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:12.583348 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:12.590152 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d02a1e-235f-44b2-9f05-00ff5ffc4220 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:12.594247 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf61fb-1f61-4cd1-bed1-970a4b367eea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:12.594906 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf61fb-1f61-4cd1-bed1-970a4b367eea service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:12.595191 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf61fb-1f61-4cd1-bed1-970a4b367eea service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:12.595467 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf61fb-1f61-4cd1-bed1-970a4b367eea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:12.605425 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bf61fb-1f61-4cd1-bed1-970a4b367eea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:12.606869 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bf61fb-1f61-4cd1-bed1-970a4b367eea service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:12.616939 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1254/2507] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:43:12 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:43:13.948772 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee80adc-f03d-4596-a4d8-533d1bd0b11d None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:13.953055 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:14.013612 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee80adc-f03d-4596-a4d8-533d1bd0b11d None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:14.018181 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd2664-e766-4b6a-9691-5bdbacb60752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:14.019060 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd2664-e766-4b6a-9691-5bdbacb60752 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:14.019342 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd2664-e766-4b6a-9691-5bdbacb60752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:14.019618 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd2664-e766-4b6a-9691-5bdbacb60752 admin admin] PATH_INFO: `/v3/users/07cc8d992ce646a8b1afbe649e774477` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:14.021082 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dd2664-e766-4b6a-9691-5bdbacb60752 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07cc8d992ce646a8b1afbe649e774477)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:14.023378 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dd2664-e766-4b6a-9691-5bdbacb60752 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:14.071750 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-d5dd2664-e766-4b6a-9691-5bdbacb60752 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07cc8d992ce646a8b1afbe649e774477'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:14.072237 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-d5dd2664-e766-4b6a-9691-5bdbacb60752 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07cc8d992ce646a8b1afbe649e774477'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:14.072914 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-d5dd2664-e766-4b6a-9691-5bdbacb60752 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07cc8d992ce646a8b1afbe649e774477'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:14.081127 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-d5dd2664-e766-4b6a-9691-5bdbacb60752 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07cc8d992ce646a8b1afbe649e774477'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:14.093871 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-d5dd2664-e766-4b6a-9691-5bdbacb60752 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07cc8d992ce646a8b1afbe649e774477'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:14.105913 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1254/2508] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:43:13 2022] DELETE /identity/v3/users/07cc8d992ce646a8b1afbe649e774477 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:43:14.110431 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e21f1-4539-49af-969a-768d012c2a47 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:14.110939 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e21f1-4539-49af-969a-768d012c2a47 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:14.110939 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e21f1-4539-49af-969a-768d012c2a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:14.129751 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-799e21f1-4539-49af-969a-768d012c2a47 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:43:14.130963 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-799e21f1-4539-49af-969a-768d012c2a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:14.191165 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1255/2509] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:43:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:43:14.201167 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd2664-e766-4b6a-9691-5bdbacb60752 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:14.202575 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-d5dd2664-e766-4b6a-9691-5bdbacb60752 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:14.260632 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd2664-e766-4b6a-9691-5bdbacb60752 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:14.264330 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4eba3-25e8-4cd3-a311-e3ef37b560a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:14.265003 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4eba3-25e8-4cd3-a311-e3ef37b560a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:14.265289 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4eba3-25e8-4cd3-a311-e3ef37b560a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:14.265559 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4eba3-25e8-4cd3-a311-e3ef37b560a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:14.274618 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee4eba3-25e8-4cd3-a311-e3ef37b560a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:14.276034 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee4eba3-25e8-4cd3-a311-e3ef37b560a6 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:14.285461 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1255/2510] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:43:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:43:14.560665 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e21f1-4539-49af-969a-768d012c2a47 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:14.562381 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-799e21f1-4539-49af-969a-768d012c2a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:14.576671 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e21f1-4539-49af-969a-768d012c2a47 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:14.582455 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7363dd9-1ddb-4b35-8be9-9cd935f8c343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:14.583758 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7363dd9-1ddb-4b35-8be9-9cd935f8c343 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:14.584090 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7363dd9-1ddb-4b35-8be9-9cd935f8c343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:14.585051 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7363dd9-1ddb-4b35-8be9-9cd935f8c343 admin admin] PATH_INFO: `/v3/projects/6b9185b5f3424a73a30f7712572818a8` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:14.586491 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7363dd9-1ddb-4b35-8be9-9cd935f8c343 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b9185b5f3424a73a30f7712572818a8)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:14.588470 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7363dd9-1ddb-4b35-8be9-9cd935f8c343 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:14.640859 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e7363dd9-1ddb-4b35-8be9-9cd935f8c343 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b9185b5f3424a73a30f7712572818a8', 'request_id': 'req-e7363dd9-1ddb-4b35-8be9-9cd935f8c343'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:14.646319 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e7363dd9-1ddb-4b35-8be9-9cd935f8c343 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b9185b5f3424a73a30f7712572818a8', 'request_id': 'req-e7363dd9-1ddb-4b35-8be9-9cd935f8c343'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:14.656123 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e7363dd9-1ddb-4b35-8be9-9cd935f8c343 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b9185b5f3424a73a30f7712572818a8', 'request_id': 'req-e7363dd9-1ddb-4b35-8be9-9cd935f8c343'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:14.669079 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e7363dd9-1ddb-4b35-8be9-9cd935f8c343 admin admin] The token cache is being invalidate because project 6b9185b5f3424a73a30f7712572818a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:43:14.669367 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e7363dd9-1ddb-4b35-8be9-9cd935f8c343 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:14.670043 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e7363dd9-1ddb-4b35-8be9-9cd935f8c343 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:14.671670 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1256/2511] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:43:14 2022] DELETE /identity/v3/projects/6b9185b5f3424a73a30f7712572818a8 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:43:14.675631 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4eba3-25e8-4cd3-a311-e3ef37b560a6 service neutron] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:14.686636 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4eba3-25e8-4cd3-a311-e3ef37b560a6 service neutron] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:14.707156 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:14.744799 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ec224-68e6-466a-b794-dac0156c4930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:14.745633 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ec224-68e6-466a-b794-dac0156c4930 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:14.745915 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ec224-68e6-466a-b794-dac0156c4930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:14.746193 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ec224-68e6-466a-b794-dac0156c4930 admin admin] PATH_INFO: `/v3/users/1be82f997bf54e329df309fc7e40a854` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:14.747401 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2ec224-68e6-466a-b794-dac0156c4930 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1be82f997bf54e329df309fc7e40a854)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:14.749363 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2ec224-68e6-466a-b794-dac0156c4930 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:14.798251 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-db2ec224-68e6-466a-b794-dac0156c4930 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1be82f997bf54e329df309fc7e40a854'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:14.798931 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-db2ec224-68e6-466a-b794-dac0156c4930 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1be82f997bf54e329df309fc7e40a854'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:14.799546 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-db2ec224-68e6-466a-b794-dac0156c4930 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1be82f997bf54e329df309fc7e40a854'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:14.806825 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-db2ec224-68e6-466a-b794-dac0156c4930 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1be82f997bf54e329df309fc7e40a854'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:14.819280 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-db2ec224-68e6-466a-b794-dac0156c4930 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1be82f997bf54e329df309fc7e40a854'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:14.831396 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1256/2512] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:43:14 2022] DELETE /identity/v3/users/1be82f997bf54e329df309fc7e40a854 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:43:15.126181 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7363dd9-1ddb-4b35-8be9-9cd935f8c343 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:15.127690 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e7363dd9-1ddb-4b35-8be9-9cd935f8c343 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:15.141372 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7363dd9-1ddb-4b35-8be9-9cd935f8c343 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:15.209201 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a98d7-e791-4d1f-b16a-ad1dbdfc6002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:15.210071 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a98d7-e791-4d1f-b16a-ad1dbdfc6002 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:15.210356 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a98d7-e791-4d1f-b16a-ad1dbdfc6002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:15.210633 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a98d7-e791-4d1f-b16a-ad1dbdfc6002 admin admin] PATH_INFO: `/v3/projects/53e5b1b618fa45c7964480eade1d135e` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:15.211820 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a98d7-e791-4d1f-b16a-ad1dbdfc6002 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53e5b1b618fa45c7964480eade1d135e)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:15.213793 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a98d7-e791-4d1f-b16a-ad1dbdfc6002 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:15.230631 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:15.269857 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-077a98d7-e791-4d1f-b16a-ad1dbdfc6002 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53e5b1b618fa45c7964480eade1d135e', 'request_id': 'req-077a98d7-e791-4d1f-b16a-ad1dbdfc6002'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:15.275472 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-077a98d7-e791-4d1f-b16a-ad1dbdfc6002 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53e5b1b618fa45c7964480eade1d135e', 'request_id': 'req-077a98d7-e791-4d1f-b16a-ad1dbdfc6002'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:15.281676 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-077a98d7-e791-4d1f-b16a-ad1dbdfc6002 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53e5b1b618fa45c7964480eade1d135e', 'request_id': 'req-077a98d7-e791-4d1f-b16a-ad1dbdfc6002'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:15.294493 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-077a98d7-e791-4d1f-b16a-ad1dbdfc6002 admin admin] The token cache is being invalidate because project 53e5b1b618fa45c7964480eade1d135e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:43:15.294782 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-077a98d7-e791-4d1f-b16a-ad1dbdfc6002 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:15.295398 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-077a98d7-e791-4d1f-b16a-ad1dbdfc6002 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:15.296965 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1257/2513] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:43:15 2022] DELETE /identity/v3/projects/53e5b1b618fa45c7964480eade1d135e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:43:15.301829 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1d080-8131-4268-a3bd-52c93feaeaa9 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:15.302322 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1d080-8131-4268-a3bd-52c93feaeaa9 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:15.302440 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1d080-8131-4268-a3bd-52c93feaeaa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:15.320184 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-52c1d080-8131-4268-a3bd-52c93feaeaa9 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:43:15.321422 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-52c1d080-8131-4268-a3bd-52c93feaeaa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:15.382546 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1257/2514] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:43:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:43:15.390491 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c8154-f4d8-4480-8a8b-7b72ad920782 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:15.390778 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c8154-f4d8-4480-8a8b-7b72ad920782 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:15.391047 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c8154-f4d8-4480-8a8b-7b72ad920782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:15.409411 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d09c8154-f4d8-4480-8a8b-7b72ad920782 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:43:15.410599 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d09c8154-f4d8-4480-8a8b-7b72ad920782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:15.419011 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1258/2515] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:43:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:43:15.423127 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c1d080-8131-4268-a3bd-52c93feaeaa9 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:15.433151 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c1d080-8131-4268-a3bd-52c93feaeaa9 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:15.443825 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46aeddb-a454-476e-8c53-e90403d482ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:15.444568 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46aeddb-a454-476e-8c53-e90403d482ae admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:15.444972 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46aeddb-a454-476e-8c53-e90403d482ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:15.445293 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46aeddb-a454-476e-8c53-e90403d482ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:15.446148 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46aeddb-a454-476e-8c53-e90403d482ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:43:15.446501 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46aeddb-a454-476e-8c53-e90403d482ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:15.448214 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46aeddb-a454-476e-8c53-e90403d482ae admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:15.461779 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1258/2516] 10.222.0.16 () {58 vars in 1152 bytes} [Thu May 26 12:43:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:43:15.465363 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c8154-f4d8-4480-8a8b-7b72ad920782 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:15.474428 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c8154-f4d8-4480-8a8b-7b72ad920782 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:15.479942 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7aba56-63b7-4361-9634-a96e085ea9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:15.480630 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7aba56-63b7-4361-9634-a96e085ea9d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:15.480943 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7aba56-63b7-4361-9634-a96e085ea9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:15.481219 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7aba56-63b7-4361-9634-a96e085ea9d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:15.481916 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7aba56-63b7-4361-9634-a96e085ea9d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:15.483835 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7aba56-63b7-4361-9634-a96e085ea9d1 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:15.509016 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1259/2517] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:43:15 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:43:15.513174 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46aeddb-a454-476e-8c53-e90403d482ae admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:15.523900 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46aeddb-a454-476e-8c53-e90403d482ae admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:15.552912 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:15.582489 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac040b-1a14-4211-9262-9f6bc8f6fc38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:15.583154 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac040b-1a14-4211-9262-9f6bc8f6fc38 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:15.583438 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac040b-1a14-4211-9262-9f6bc8f6fc38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:15.583716 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac040b-1a14-4211-9262-9f6bc8f6fc38 admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:15.585015 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ac040b-1a14-4211-9262-9f6bc8f6fc38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:15.586933 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ac040b-1a14-4211-9262-9f6bc8f6fc38 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:15.607836 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1259/2518] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:43:15 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:43:15.611819 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7aba56-63b7-4361-9634-a96e085ea9d1 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:15.623572 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7aba56-63b7-4361-9634-a96e085ea9d1 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:15.628751 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6874d1b-57e1-4668-ac2a-cc83ce231ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:15.629440 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6874d1b-57e1-4668-ac2a-cc83ce231ee6 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:15.629722 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6874d1b-57e1-4668-ac2a-cc83ce231ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:15.630015 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6874d1b-57e1-4668-ac2a-cc83ce231ee6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:15.630716 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6874d1b-57e1-4668-ac2a-cc83ce231ee6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:15.632348 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6874d1b-57e1-4668-ac2a-cc83ce231ee6 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:15.642814 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1260/2519] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:43:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:43:15.647427 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac040b-1a14-4211-9262-9f6bc8f6fc38 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:15.657280 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac040b-1a14-4211-9262-9f6bc8f6fc38 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:15.661752 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe6b19-c87b-4345-870f-c8838ceb41da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:15.662971 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe6b19-c87b-4345-870f-c8838ceb41da admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:15.663248 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe6b19-c87b-4345-870f-c8838ceb41da admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:15.663519 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe6b19-c87b-4345-870f-c8838ceb41da admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:15.664235 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fe6b19-c87b-4345-870f-c8838ceb41da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:15.666032 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fe6b19-c87b-4345-870f-c8838ceb41da admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:15.675776 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1260/2520] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:43:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:43:15.679822 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6874d1b-57e1-4668-ac2a-cc83ce231ee6 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:15.689746 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6874d1b-57e1-4668-ac2a-cc83ce231ee6 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:15.694519 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a33080-ae50-42e3-977b-aa5e6e7e284f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:15.695407 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a33080-ae50-42e3-977b-aa5e6e7e284f admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:15.695686 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a33080-ae50-42e3-977b-aa5e6e7e284f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:15.695962 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a33080-ae50-42e3-977b-aa5e6e7e284f admin admin] PATH_INFO: `/v3/projects/f02f753bb9a44b3384fd9f0fa2679ca5/users/f4ce530cfd3a482ca85c6b5939a59c5d/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:15.710954 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a33080-ae50-42e3-977b-aa5e6e7e284f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f02f753bb9a44b3384fd9f0fa2679ca5, user_id=f4ce530cfd3a482ca85c6b5939a59c5d, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:15.713673 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a33080-ae50-42e3-977b-aa5e6e7e284f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:15.727002 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1261/2521] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:43:15 2022] PUT /identity/v3/projects/f02f753bb9a44b3384fd9f0fa2679ca5/users/f4ce530cfd3a482ca85c6b5939a59c5d/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:43:15.738280 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00c78d-4efa-4e40-8745-dd8311fdaf5a None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:15.738571 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00c78d-4efa-4e40-8745-dd8311fdaf5a None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:15.738847 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00c78d-4efa-4e40-8745-dd8311fdaf5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:15.765868 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-2a00c78d-4efa-4e40-8745-dd8311fdaf5a None None] MFA Rules not processed for user `f4ce530cfd3a482ca85c6b5939a59c5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:43:15.767068 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-2a00c78d-4efa-4e40-8745-dd8311fdaf5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:15.831475 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1261/2522] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:43:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:43:15.836566 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a33080-ae50-42e3-977b-aa5e6e7e284f admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:15.896017 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a33080-ae50-42e3-977b-aa5e6e7e284f admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:15.901300 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474ea29-5b7e-4f73-a225-c0f67ac5530d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:15.901948 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474ea29-5b7e-4f73-a225-c0f67ac5530d admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:15.902232 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474ea29-5b7e-4f73-a225-c0f67ac5530d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:15.902510 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474ea29-5b7e-4f73-a225-c0f67ac5530d admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:15.903203 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0474ea29-5b7e-4f73-a225-c0f67ac5530d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:15.905151 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0474ea29-5b7e-4f73-a225-c0f67ac5530d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:15.930713 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1262/2523] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:43:15 2022] POST /identity/v3/projects => generated 375 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:43:15.934768 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a00c78d-4efa-4e40-8745-dd8311fdaf5a None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:15.945510 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a00c78d-4efa-4e40-8745-dd8311fdaf5a None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:16.002080 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03f1f90-a7d2-45be-a36c-4f42c62818cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:16.002753 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f1f90-a7d2-45be-a36c-4f42c62818cf admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:16.003037 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f1f90-a7d2-45be-a36c-4f42c62818cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:16.003316 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f1f90-a7d2-45be-a36c-4f42c62818cf admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:16.004013 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03f1f90-a7d2-45be-a36c-4f42c62818cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:16.006051 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03f1f90-a7d2-45be-a36c-4f42c62818cf admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:16.024858 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1262/2524] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:43:15 2022] POST /identity/v3/users => generated 294 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:43:16.028862 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474ea29-5b7e-4f73-a225-c0f67ac5530d admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:16.039752 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474ea29-5b7e-4f73-a225-c0f67ac5530d admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:16.044461 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b8b0b-b01a-4c23-b2fb-b423a39611b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:16.045163 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b8b0b-b01a-4c23-b2fb-b423a39611b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:16.045446 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b8b0b-b01a-4c23-b2fb-b423a39611b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:16.045724 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b8b0b-b01a-4c23-b2fb-b423a39611b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:16.046444 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0b8b0b-b01a-4c23-b2fb-b423a39611b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:16.048056 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0b8b0b-b01a-4c23-b2fb-b423a39611b2 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:16.059197 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1263/2525] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:43:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:43:16.063391 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03f1f90-a7d2-45be-a36c-4f42c62818cf admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:16.073532 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03f1f90-a7d2-45be-a36c-4f42c62818cf admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:16.082586 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e390198-f4ea-4e14-ac38-d4a87c48bcf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:16.083397 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e390198-f4ea-4e14-ac38-d4a87c48bcf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:16.083677 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e390198-f4ea-4e14-ac38-d4a87c48bcf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:16.083949 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e390198-f4ea-4e14-ac38-d4a87c48bcf3 admin admin] PATH_INFO: `/v3/projects/dca1d91bce73494c84e060de98f81853/users/2ad287461d9a4e29a9448b81e8993aec/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:16.110574 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e390198-f4ea-4e14-ac38-d4a87c48bcf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dca1d91bce73494c84e060de98f81853, user_id=2ad287461d9a4e29a9448b81e8993aec, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:16.113248 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e390198-f4ea-4e14-ac38-d4a87c48bcf3 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:16.126703 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1263/2526] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:43:16 2022] PUT /identity/v3/projects/dca1d91bce73494c84e060de98f81853/users/2ad287461d9a4e29a9448b81e8993aec/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:43:16.130655 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b8b0b-b01a-4c23-b2fb-b423a39611b2 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:16.141136 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b8b0b-b01a-4c23-b2fb-b423a39611b2 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:16.150591 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:16.199982 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e294153-6735-4182-a055-5cee80b410b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:16.200645 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e294153-6735-4182-a055-5cee80b410b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:16.200964 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e294153-6735-4182-a055-5cee80b410b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:16.201242 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e294153-6735-4182-a055-5cee80b410b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:16.201963 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e294153-6735-4182-a055-5cee80b410b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:16.203574 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e294153-6735-4182-a055-5cee80b410b5 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:16.213180 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1264/2527] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:43:16 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:43:16.217484 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e390198-f4ea-4e14-ac38-d4a87c48bcf3 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:16.224338 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:16.228370 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e390198-f4ea-4e14-ac38-d4a87c48bcf3 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:16.234192 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4451b434-d658-4574-8a25-dfb665448109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:16.235071 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4451b434-d658-4574-8a25-dfb665448109 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:16.235356 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4451b434-d658-4574-8a25-dfb665448109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:16.235632 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4451b434-d658-4574-8a25-dfb665448109 admin admin] PATH_INFO: `/v3/projects/dca1d91bce73494c84e060de98f81853/users/2ad287461d9a4e29a9448b81e8993aec/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:16.237625 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4451b434-d658-4574-8a25-dfb665448109 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dca1d91bce73494c84e060de98f81853, user_id=2ad287461d9a4e29a9448b81e8993aec, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:16.240803 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4451b434-d658-4574-8a25-dfb665448109 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:16.251348 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1264/2528] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:43:16 2022] PUT /identity/v3/projects/dca1d91bce73494c84e060de98f81853/users/2ad287461d9a4e29a9448b81e8993aec/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:43:16.262373 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460f8f7-e88c-423c-84d4-a5122020ff33 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:16.262663 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460f8f7-e88c-423c-84d4-a5122020ff33 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:16.262945 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460f8f7-e88c-423c-84d4-a5122020ff33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:16.289921 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-7460f8f7-e88c-423c-84d4-a5122020ff33 None None] MFA Rules not processed for user `2ad287461d9a4e29a9448b81e8993aec`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:43:16.291289 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7460f8f7-e88c-423c-84d4-a5122020ff33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:16.361464 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1265/2529] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:43:16 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:43:16.372883 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4451b434-d658-4574-8a25-dfb665448109 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:16.374679 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-4451b434-d658-4574-8a25-dfb665448109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:16.434740 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4451b434-d658-4574-8a25-dfb665448109 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:16.438497 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807d40d-5abf-44a7-8383-8e02465e317d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:16.439135 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807d40d-5abf-44a7-8383-8e02465e317d service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:16.439424 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807d40d-5abf-44a7-8383-8e02465e317d service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:16.439694 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807d40d-5abf-44a7-8383-8e02465e317d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:16.498522 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9807d40d-5abf-44a7-8383-8e02465e317d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:16.499951 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9807d40d-5abf-44a7-8383-8e02465e317d service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:16.509139 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1265/2530] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:43:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:43:19.074530 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7460f8f7-e88c-423c-84d4-a5122020ff33 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:19.084616 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7460f8f7-e88c-423c-84d4-a5122020ff33 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:19.088440 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079fb0ea-9581-437a-ba3b-e247f31aec5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:19.089153 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fb0ea-9581-437a-ba3b-e247f31aec5a service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:19.089435 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fb0ea-9581-437a-ba3b-e247f31aec5a service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:19.089710 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fb0ea-9581-437a-ba3b-e247f31aec5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:19.099387 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079fb0ea-9581-437a-ba3b-e247f31aec5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:19.101368 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079fb0ea-9581-437a-ba3b-e247f31aec5a service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:19.110976 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1266/2531] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:43:19 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:43:20.827246 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807d40d-5abf-44a7-8383-8e02465e317d service cinder] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:20.828708 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-9807d40d-5abf-44a7-8383-8e02465e317d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:20.900819 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807d40d-5abf-44a7-8383-8e02465e317d service cinder] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:20.906261 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9513d4-764f-4226-851a-2161915c3361 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4327435c97834afeb7e6806ef02349a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:20.906917 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9513d4-764f-4226-851a-2161915c3361 service placement] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:20.907197 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9513d4-764f-4226-851a-2161915c3361 service placement] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:20.907470 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9513d4-764f-4226-851a-2161915c3361 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:20.909296 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-ab9513d4-764f-4226-851a-2161915c3361 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:20.922243 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9513d4-764f-4226-851a-2161915c3361 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:20.923828 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9513d4-764f-4226-851a-2161915c3361 service placement] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:20.934611 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1266/2532] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:43:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:43:25.711260 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f566d-bb54-489f-80a5-e2861d5cc2fd None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:25.711764 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f566d-bb54-489f-80a5-e2861d5cc2fd None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:25.711909 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f566d-bb54-489f-80a5-e2861d5cc2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:25.730820 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c86f566d-bb54-489f-80a5-e2861d5cc2fd None None] MFA Rules not processed for user `72acc7b23f594627b3e66d4c380e6e60`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:43:25.732025 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c86f566d-bb54-489f-80a5-e2861d5cc2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:25.786013 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1267/2533] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:43:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:43:30.929975 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=83,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:31.625319 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9513d4-764f-4226-851a-2161915c3361 service placement] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:31.701175 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9513d4-764f-4226-851a-2161915c3361 service placement] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:31.705794 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8810d4-8b7d-4f91-bd8f-d16b0e6206cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:31.706674 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8810d4-8b7d-4f91-bd8f-d16b0e6206cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:31.706962 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8810d4-8b7d-4f91-bd8f-d16b0e6206cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:31.707240 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8810d4-8b7d-4f91-bd8f-d16b0e6206cf admin admin] PATH_INFO: `/v3/users/f4ce530cfd3a482ca85c6b5939a59c5d` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:31.709050 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8810d4-8b7d-4f91-bd8f-d16b0e6206cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4ce530cfd3a482ca85c6b5939a59c5d)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:31.711001 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8810d4-8b7d-4f91-bd8f-d16b0e6206cf admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:31.762303 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-ca8810d4-8b7d-4f91-bd8f-d16b0e6206cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4ce530cfd3a482ca85c6b5939a59c5d'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:31.762949 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-ca8810d4-8b7d-4f91-bd8f-d16b0e6206cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4ce530cfd3a482ca85c6b5939a59c5d'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:31.763544 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-ca8810d4-8b7d-4f91-bd8f-d16b0e6206cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4ce530cfd3a482ca85c6b5939a59c5d'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:31.772086 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-ca8810d4-8b7d-4f91-bd8f-d16b0e6206cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4ce530cfd3a482ca85c6b5939a59c5d'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:31.784427 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-ca8810d4-8b7d-4f91-bd8f-d16b0e6206cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4ce530cfd3a482ca85c6b5939a59c5d'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:31.796873 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1267/2534] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:43:31 2022] DELETE /identity/v3/users/f4ce530cfd3a482ca85c6b5939a59c5d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:43:31.801639 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785497e-ecab-4f4e-af4d-9b3c201dbf76 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:31.802156 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785497e-ecab-4f4e-af4d-9b3c201dbf76 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:31.802256 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785497e-ecab-4f4e-af4d-9b3c201dbf76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:31.820965 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c785497e-ecab-4f4e-af4d-9b3c201dbf76 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:43:31.822360 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c785497e-ecab-4f4e-af4d-9b3c201dbf76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:31.844755 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:31.886752 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1268/2535] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:43:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:43:31.897140 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8810d4-8b7d-4f91-bd8f-d16b0e6206cf admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:31.898563 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-ca8810d4-8b7d-4f91-bd8f-d16b0e6206cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:31.960648 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8810d4-8b7d-4f91-bd8f-d16b0e6206cf admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:31.965196 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396539b0-9380-453b-bfe6-e1efa7d3fbd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:31.965798 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396539b0-9380-453b-bfe6-e1efa7d3fbd1 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:31.966090 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396539b0-9380-453b-bfe6-e1efa7d3fbd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:31.966369 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396539b0-9380-453b-bfe6-e1efa7d3fbd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:31.976363 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396539b0-9380-453b-bfe6-e1efa7d3fbd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:31.977868 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396539b0-9380-453b-bfe6-e1efa7d3fbd1 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:31.987794 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1268/2536] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:43:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:43:32.263839 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c785497e-ecab-4f4e-af4d-9b3c201dbf76 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:32.265364 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c785497e-ecab-4f4e-af4d-9b3c201dbf76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:32.277834 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c785497e-ecab-4f4e-af4d-9b3c201dbf76 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:32.282882 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19bec82-bfc2-41a1-a95e-6b3166ae0ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:32.283774 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19bec82-bfc2-41a1-a95e-6b3166ae0ffa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:32.284057 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19bec82-bfc2-41a1-a95e-6b3166ae0ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:32.284337 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19bec82-bfc2-41a1-a95e-6b3166ae0ffa admin admin] PATH_INFO: `/v3/projects/f02f753bb9a44b3384fd9f0fa2679ca5` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:32.285589 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19bec82-bfc2-41a1-a95e-6b3166ae0ffa admin admin] RBAC: Authorizing `identity:delete_project(project_id=f02f753bb9a44b3384fd9f0fa2679ca5)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:32.288096 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19bec82-bfc2-41a1-a95e-6b3166ae0ffa admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:32.338313 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e19bec82-bfc2-41a1-a95e-6b3166ae0ffa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f02f753bb9a44b3384fd9f0fa2679ca5', 'request_id': 'req-e19bec82-bfc2-41a1-a95e-6b3166ae0ffa'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:32.343826 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e19bec82-bfc2-41a1-a95e-6b3166ae0ffa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f02f753bb9a44b3384fd9f0fa2679ca5', 'request_id': 'req-e19bec82-bfc2-41a1-a95e-6b3166ae0ffa'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:32.350743 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e19bec82-bfc2-41a1-a95e-6b3166ae0ffa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f02f753bb9a44b3384fd9f0fa2679ca5', 'request_id': 'req-e19bec82-bfc2-41a1-a95e-6b3166ae0ffa'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:32.365252 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e19bec82-bfc2-41a1-a95e-6b3166ae0ffa admin admin] The token cache is being invalidate because project f02f753bb9a44b3384fd9f0fa2679ca5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:43:32.365542 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e19bec82-bfc2-41a1-a95e-6b3166ae0ffa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:32.366174 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e19bec82-bfc2-41a1-a95e-6b3166ae0ffa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:32.367717 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1269/2537] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:43:32 2022] DELETE /identity/v3/projects/f02f753bb9a44b3384fd9f0fa2679ca5 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:43:32.371615 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396539b0-9380-453b-bfe6-e1efa7d3fbd1 service neutron] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:32.382372 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396539b0-9380-453b-bfe6-e1efa7d3fbd1 service neutron] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:32.401552 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:32.444268 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb0d97-bd28-499a-8746-02266e7e7324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:32.445178 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb0d97-bd28-499a-8746-02266e7e7324 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:32.445463 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb0d97-bd28-499a-8746-02266e7e7324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:32.445741 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb0d97-bd28-499a-8746-02266e7e7324 admin admin] PATH_INFO: `/v3/users/2ad287461d9a4e29a9448b81e8993aec` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:32.446933 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb0d97-bd28-499a-8746-02266e7e7324 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ad287461d9a4e29a9448b81e8993aec)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:32.448968 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb0d97-bd28-499a-8746-02266e7e7324 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:32.497476 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-32cb0d97-bd28-499a-8746-02266e7e7324 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ad287461d9a4e29a9448b81e8993aec'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:32.498126 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-32cb0d97-bd28-499a-8746-02266e7e7324 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ad287461d9a4e29a9448b81e8993aec'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:32.498715 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-32cb0d97-bd28-499a-8746-02266e7e7324 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ad287461d9a4e29a9448b81e8993aec'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:32.506663 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-32cb0d97-bd28-499a-8746-02266e7e7324 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ad287461d9a4e29a9448b81e8993aec'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:32.518875 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-32cb0d97-bd28-499a-8746-02266e7e7324 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ad287461d9a4e29a9448b81e8993aec'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:32.530834 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1269/2538] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:43:32 2022] DELETE /identity/v3/users/2ad287461d9a4e29a9448b81e8993aec => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:43:32.808983 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19bec82-bfc2-41a1-a95e-6b3166ae0ffa admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:32.810615 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e19bec82-bfc2-41a1-a95e-6b3166ae0ffa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:32.827474 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19bec82-bfc2-41a1-a95e-6b3166ae0ffa admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:32.890854 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b84bd-eb12-4a57-b8e8-e5d474fe2d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:32.891652 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b84bd-eb12-4a57-b8e8-e5d474fe2d3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:32.891940 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b84bd-eb12-4a57-b8e8-e5d474fe2d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:32.892243 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b84bd-eb12-4a57-b8e8-e5d474fe2d3c admin admin] PATH_INFO: `/v3/projects/dca1d91bce73494c84e060de98f81853` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:32.893537 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b84bd-eb12-4a57-b8e8-e5d474fe2d3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=dca1d91bce73494c84e060de98f81853)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:32.896071 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b84bd-eb12-4a57-b8e8-e5d474fe2d3c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:32.947871 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-819b84bd-eb12-4a57-b8e8-e5d474fe2d3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dca1d91bce73494c84e060de98f81853', 'request_id': 'req-819b84bd-eb12-4a57-b8e8-e5d474fe2d3c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:32.950261 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:32.955803 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-819b84bd-eb12-4a57-b8e8-e5d474fe2d3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dca1d91bce73494c84e060de98f81853', 'request_id': 'req-819b84bd-eb12-4a57-b8e8-e5d474fe2d3c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:32.964281 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-819b84bd-eb12-4a57-b8e8-e5d474fe2d3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dca1d91bce73494c84e060de98f81853', 'request_id': 'req-819b84bd-eb12-4a57-b8e8-e5d474fe2d3c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:32.979192 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-819b84bd-eb12-4a57-b8e8-e5d474fe2d3c admin admin] The token cache is being invalidate because project dca1d91bce73494c84e060de98f81853 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:43:32.979484 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-819b84bd-eb12-4a57-b8e8-e5d474fe2d3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:32.980136 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-819b84bd-eb12-4a57-b8e8-e5d474fe2d3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:32.981741 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1270/2539] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:43:32 2022] DELETE /identity/v3/projects/dca1d91bce73494c84e060de98f81853 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:43:32.986564 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d651828-c2e2-4479-a556-7267eb5cbc27 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:32.987079 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d651828-c2e2-4479-a556-7267eb5cbc27 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:32.987176 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d651828-c2e2-4479-a556-7267eb5cbc27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:33.006227 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-9d651828-c2e2-4479-a556-7267eb5cbc27 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:43:33.007448 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-9d651828-c2e2-4479-a556-7267eb5cbc27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:33.069615 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1270/2540] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:43:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:43:33.078315 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817372d-24e7-450c-84d2-a6439845b55a None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:33.078609 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817372d-24e7-450c-84d2-a6439845b55a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:33.078895 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817372d-24e7-450c-84d2-a6439845b55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:33.098715 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d817372d-24e7-450c-84d2-a6439845b55a None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:43:33.099944 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d817372d-24e7-450c-84d2-a6439845b55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:33.109420 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1271/2541] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:43:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:43:33.113690 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d651828-c2e2-4479-a556-7267eb5cbc27 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:33.123706 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d651828-c2e2-4479-a556-7267eb5cbc27 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:33.128569 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d12e2-4812-406d-892c-17ca96238101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:33.129266 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d12e2-4812-406d-892c-17ca96238101 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:33.130076 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d12e2-4812-406d-892c-17ca96238101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:33.130357 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d12e2-4812-406d-892c-17ca96238101 admin admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:33.131081 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40d12e2-4812-406d-892c-17ca96238101 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:43:33.131386 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40d12e2-4812-406d-892c-17ca96238101 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:33.133010 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40d12e2-4812-406d-892c-17ca96238101 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:33.145916 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1271/2542] 10.222.0.16 () {58 vars in 1152 bytes} [Thu May 26 12:43:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:43:33.150189 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d817372d-24e7-450c-84d2-a6439845b55a None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:33.159534 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d817372d-24e7-450c-84d2-a6439845b55a None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:33.164239 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd42106-1e43-4374-9318-fd7e0df2db28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:33.164908 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd42106-1e43-4374-9318-fd7e0df2db28 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:33.165192 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd42106-1e43-4374-9318-fd7e0df2db28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:33.165467 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd42106-1e43-4374-9318-fd7e0df2db28 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:33.166156 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd42106-1e43-4374-9318-fd7e0df2db28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:33.168062 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd42106-1e43-4374-9318-fd7e0df2db28 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:33.196298 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1272/2543] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:43:33 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:43:33.200487 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d12e2-4812-406d-892c-17ca96238101 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:33.211432 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d12e2-4812-406d-892c-17ca96238101 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:33.241471 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:33.277578 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a092f-884e-44aa-b0e8-048d2eacfccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:33.278286 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a092f-884e-44aa-b0e8-048d2eacfccc admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:33.278570 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a092f-884e-44aa-b0e8-048d2eacfccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:33.278843 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a092f-884e-44aa-b0e8-048d2eacfccc admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:33.279532 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20a092f-884e-44aa-b0e8-048d2eacfccc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:33.281532 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20a092f-884e-44aa-b0e8-048d2eacfccc admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:33.305742 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1272/2544] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:43:33 2022] POST /identity/v3/users => generated 291 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:43:33.307644 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd42106-1e43-4374-9318-fd7e0df2db28 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:33.319124 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd42106-1e43-4374-9318-fd7e0df2db28 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:33.323911 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc40486-e948-4da8-b1ba-2f8d0056bb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:33.324602 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc40486-e948-4da8-b1ba-2f8d0056bb10 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:33.324905 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc40486-e948-4da8-b1ba-2f8d0056bb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:33.325190 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc40486-e948-4da8-b1ba-2f8d0056bb10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:33.325927 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc40486-e948-4da8-b1ba-2f8d0056bb10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:33.327566 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc40486-e948-4da8-b1ba-2f8d0056bb10 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:33.339484 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1273/2545] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:43:33.343729 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a092f-884e-44aa-b0e8-048d2eacfccc admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:33.354501 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a092f-884e-44aa-b0e8-048d2eacfccc admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:33.359225 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b2b200-be6a-41fa-a37d-0002737203b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:33.359901 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2b200-be6a-41fa-a37d-0002737203b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:33.360183 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2b200-be6a-41fa-a37d-0002737203b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:33.360467 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2b200-be6a-41fa-a37d-0002737203b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:33.361236 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b2b200-be6a-41fa-a37d-0002737203b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:33.362841 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b2b200-be6a-41fa-a37d-0002737203b6 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:33.376715 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1273/2546] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:43:33.378210 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc40486-e948-4da8-b1ba-2f8d0056bb10 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:33.389022 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc40486-e948-4da8-b1ba-2f8d0056bb10 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:33.393769 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab6aba-63c7-48ba-b1a7-63924f374f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:33.394659 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab6aba-63c7-48ba-b1a7-63924f374f89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:33.394940 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab6aba-63c7-48ba-b1a7-63924f374f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:33.395825 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab6aba-63c7-48ba-b1a7-63924f374f89 admin admin] PATH_INFO: `/v3/projects/00bb9b71efb649b5be498ba8127a7d2d/users/8c44864b4ea4473099a9407c76d9d7b8/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:33.412511 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab6aba-63c7-48ba-b1a7-63924f374f89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00bb9b71efb649b5be498ba8127a7d2d, user_id=8c44864b4ea4473099a9407c76d9d7b8, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:33.415236 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab6aba-63c7-48ba-b1a7-63924f374f89 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:33.430149 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1274/2547] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:43:33 2022] PUT /identity/v3/projects/00bb9b71efb649b5be498ba8127a7d2d/users/8c44864b4ea4473099a9407c76d9d7b8/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:43:33.440380 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0898024b-14e8-4dcb-8c9a-12d164a2b065 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:33.440674 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0898024b-14e8-4dcb-8c9a-12d164a2b065 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:33.440990 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0898024b-14e8-4dcb-8c9a-12d164a2b065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:33.469584 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-0898024b-14e8-4dcb-8c9a-12d164a2b065 None None] MFA Rules not processed for user `8c44864b4ea4473099a9407c76d9d7b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:43:33.470846 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-0898024b-14e8-4dcb-8c9a-12d164a2b065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:33.539324 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1274/2548] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:43:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:43:33.543863 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab6aba-63c7-48ba-b1a7-63924f374f89 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:33.617404 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab6aba-63c7-48ba-b1a7-63924f374f89 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:33.622438 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a00a305-30ed-4708-9dab-f26057132c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:33.623087 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00a305-30ed-4708-9dab-f26057132c59 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:33.623369 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00a305-30ed-4708-9dab-f26057132c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:33.623641 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00a305-30ed-4708-9dab-f26057132c59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:33.624331 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a00a305-30ed-4708-9dab-f26057132c59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:33.626531 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a00a305-30ed-4708-9dab-f26057132c59 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:33.651562 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1275/2549] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:43:33 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:43:33.655645 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0898024b-14e8-4dcb-8c9a-12d164a2b065 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:33.666640 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0898024b-14e8-4dcb-8c9a-12d164a2b065 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:33.731188 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4248c23e-c75f-409c-a382-f244f102e962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:33.731854 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248c23e-c75f-409c-a382-f244f102e962 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:33.732138 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248c23e-c75f-409c-a382-f244f102e962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:33.732415 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248c23e-c75f-409c-a382-f244f102e962 admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:33.733131 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4248c23e-c75f-409c-a382-f244f102e962 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:33.735055 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4248c23e-c75f-409c-a382-f244f102e962 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:33.761162 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1275/2550] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:43:33 2022] POST /identity/v3/users => generated 298 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:43:33.765163 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a00a305-30ed-4708-9dab-f26057132c59 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:33.775591 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a00a305-30ed-4708-9dab-f26057132c59 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:33.780301 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a39fa-a155-4453-aa21-296f4ec50309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:33.781000 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a39fa-a155-4453-aa21-296f4ec50309 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:33.781288 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a39fa-a155-4453-aa21-296f4ec50309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:33.781565 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a39fa-a155-4453-aa21-296f4ec50309 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:33.782330 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34a39fa-a155-4453-aa21-296f4ec50309 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:33.783983 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34a39fa-a155-4453-aa21-296f4ec50309 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:33.795375 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1276/2551] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:43:33.799560 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4248c23e-c75f-409c-a382-f244f102e962 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:33.810408 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4248c23e-c75f-409c-a382-f244f102e962 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:33.815145 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c3513-30a5-464e-9a2c-eb39f8cd8eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:33.816025 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c3513-30a5-464e-9a2c-eb39f8cd8eb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:33.816311 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c3513-30a5-464e-9a2c-eb39f8cd8eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:33.816590 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c3513-30a5-464e-9a2c-eb39f8cd8eb1 admin admin] PATH_INFO: `/v3/projects/792a6c0dd9034426b98c80890b3e5ee1/users/b0f7b74aabb945aebca5948ba47019b7/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:33.831832 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434c3513-30a5-464e-9a2c-eb39f8cd8eb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=792a6c0dd9034426b98c80890b3e5ee1, user_id=b0f7b74aabb945aebca5948ba47019b7, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:33.834539 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434c3513-30a5-464e-9a2c-eb39f8cd8eb1 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:33.847272 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1276/2552] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:43:33 2022] PUT /identity/v3/projects/792a6c0dd9034426b98c80890b3e5ee1/users/b0f7b74aabb945aebca5948ba47019b7/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:43:33.851738 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a39fa-a155-4453-aa21-296f4ec50309 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:33.862158 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a39fa-a155-4453-aa21-296f4ec50309 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:33.909617 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:33.922537 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1014e1b-7888-435d-98be-26d383e2b09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:33.923146 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1014e1b-7888-435d-98be-26d383e2b09e admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:33.923433 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1014e1b-7888-435d-98be-26d383e2b09e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:33.923709 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1014e1b-7888-435d-98be-26d383e2b09e admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:33.924434 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1014e1b-7888-435d-98be-26d383e2b09e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:33.926179 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1014e1b-7888-435d-98be-26d383e2b09e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:33.936712 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1277/2553] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:43:33.941133 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c3513-30a5-464e-9a2c-eb39f8cd8eb1 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:33.946605 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:33.953226 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c3513-30a5-464e-9a2c-eb39f8cd8eb1 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:33.958233 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e212c5-1dc7-4284-a6e7-c8f95811dadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:33.959106 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e212c5-1dc7-4284-a6e7-c8f95811dadd admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:33.959392 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e212c5-1dc7-4284-a6e7-c8f95811dadd admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:33.959671 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e212c5-1dc7-4284-a6e7-c8f95811dadd admin admin] PATH_INFO: `/v3/projects/792a6c0dd9034426b98c80890b3e5ee1/users/b0f7b74aabb945aebca5948ba47019b7/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:33.961698 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e212c5-1dc7-4284-a6e7-c8f95811dadd admin admin] RBAC: Authorizing `identity:create_grant(project_id=792a6c0dd9034426b98c80890b3e5ee1, user_id=b0f7b74aabb945aebca5948ba47019b7, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:33.964463 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e212c5-1dc7-4284-a6e7-c8f95811dadd admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:33.975243 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1277/2554] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:43:33 2022] PUT /identity/v3/projects/792a6c0dd9034426b98c80890b3e5ee1/users/b0f7b74aabb945aebca5948ba47019b7/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:43:33.985467 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f831f-64e5-48f0-8056-758ce676d1f3 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:33.985758 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f831f-64e5-48f0-8056-758ce676d1f3 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:33.986038 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f831f-64e5-48f0-8056-758ce676d1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:34.012796 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-7f2f831f-64e5-48f0-8056-758ce676d1f3 None None] MFA Rules not processed for user `b0f7b74aabb945aebca5948ba47019b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:43:34.014036 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7f2f831f-64e5-48f0-8056-758ce676d1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:34.084473 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1278/2555] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:43:33 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:43:34.095252 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e212c5-1dc7-4284-a6e7-c8f95811dadd admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:34.097125 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-20e212c5-1dc7-4284-a6e7-c8f95811dadd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:34.154021 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e212c5-1dc7-4284-a6e7-c8f95811dadd admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:34.157711 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c010ed5-5bca-4462-b967-9739f40e4793 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:34.158346 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c010ed5-5bca-4462-b967-9739f40e4793 service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:34.158628 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c010ed5-5bca-4462-b967-9739f40e4793 service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:34.158907 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c010ed5-5bca-4462-b967-9739f40e4793 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:34.167967 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c010ed5-5bca-4462-b967-9739f40e4793 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:34.169423 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c010ed5-5bca-4462-b967-9739f40e4793 service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:34.179388 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1278/2556] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:43:34 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:43:34.279400 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2f831f-64e5-48f0-8056-758ce676d1f3 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:34.289156 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2f831f-64e5-48f0-8056-758ce676d1f3 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:34.292802 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d503fd1-9d26-43fa-a3f7-79b3638915c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:34.293472 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d503fd1-9d26-43fa-a3f7-79b3638915c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:34.293758 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d503fd1-9d26-43fa-a3f7-79b3638915c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:34.294033 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d503fd1-9d26-43fa-a3f7-79b3638915c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:34.351409 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d503fd1-9d26-43fa-a3f7-79b3638915c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:34.352903 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d503fd1-9d26-43fa-a3f7-79b3638915c1 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:34.361920 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1279/2557] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:43:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:43:36.937673 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c010ed5-5bca-4462-b967-9739f40e4793 service cinder] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:37.002121 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c010ed5-5bca-4462-b967-9739f40e4793 service cinder] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:37.006767 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55ff38-062c-4e5d-9fbd-3595021c8b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:37.007669 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55ff38-062c-4e5d-9fbd-3595021c8b63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:37.009366 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55ff38-062c-4e5d-9fbd-3595021c8b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:37.009366 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55ff38-062c-4e5d-9fbd-3595021c8b63 admin admin] PATH_INFO: `/v3/users/8c44864b4ea4473099a9407c76d9d7b8` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:37.009715 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c55ff38-062c-4e5d-9fbd-3595021c8b63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c44864b4ea4473099a9407c76d9d7b8)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:37.011633 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c55ff38-062c-4e5d-9fbd-3595021c8b63 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:37.062932 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-7c55ff38-062c-4e5d-9fbd-3595021c8b63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c44864b4ea4473099a9407c76d9d7b8'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:37.063744 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-7c55ff38-062c-4e5d-9fbd-3595021c8b63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c44864b4ea4473099a9407c76d9d7b8'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:37.064372 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-7c55ff38-062c-4e5d-9fbd-3595021c8b63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c44864b4ea4473099a9407c76d9d7b8'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:37.075000 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-7c55ff38-062c-4e5d-9fbd-3595021c8b63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c44864b4ea4473099a9407c76d9d7b8'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:37.089481 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-7c55ff38-062c-4e5d-9fbd-3595021c8b63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c44864b4ea4473099a9407c76d9d7b8'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:37.102448 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1279/2558] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:43:36 2022] DELETE /identity/v3/users/8c44864b4ea4473099a9407c76d9d7b8 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:43:37.107018 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f02af5-c59c-43d8-9aaa-f3c3a260941d None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:37.107526 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f02af5-c59c-43d8-9aaa-f3c3a260941d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:37.107714 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f02af5-c59c-43d8-9aaa-f3c3a260941d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:37.125923 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b3f02af5-c59c-43d8-9aaa-f3c3a260941d None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:43:37.127137 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b3f02af5-c59c-43d8-9aaa-f3c3a260941d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:37.188947 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1280/2559] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:43:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:43:37.198702 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55ff38-062c-4e5d-9fbd-3595021c8b63 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:37.200179 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-7c55ff38-062c-4e5d-9fbd-3595021c8b63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:37.214868 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:37.262046 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55ff38-062c-4e5d-9fbd-3595021c8b63 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:37.265664 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f462e70d-7646-428a-9961-3e903a926fd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:37.266307 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f462e70d-7646-428a-9961-3e903a926fd3 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:37.266591 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f462e70d-7646-428a-9961-3e903a926fd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:37.266867 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f462e70d-7646-428a-9961-3e903a926fd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:37.276203 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f462e70d-7646-428a-9961-3e903a926fd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:37.277692 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f462e70d-7646-428a-9961-3e903a926fd3 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:37.287771 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1280/2560] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:43:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:43:37.578592 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f02af5-c59c-43d8-9aaa-f3c3a260941d None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:37.580080 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b3f02af5-c59c-43d8-9aaa-f3c3a260941d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:37.592532 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f02af5-c59c-43d8-9aaa-f3c3a260941d None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:37.597353 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae99834c-5d64-4a46-9748-b40d0abb40ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:37.609744 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99834c-5d64-4a46-9748-b40d0abb40ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:37.610038 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99834c-5d64-4a46-9748-b40d0abb40ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:37.610317 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99834c-5d64-4a46-9748-b40d0abb40ff admin admin] PATH_INFO: `/v3/projects/00bb9b71efb649b5be498ba8127a7d2d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:37.613310 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae99834c-5d64-4a46-9748-b40d0abb40ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=00bb9b71efb649b5be498ba8127a7d2d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:37.615413 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae99834c-5d64-4a46-9748-b40d0abb40ff admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:37.634175 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:37.687589 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ae99834c-5d64-4a46-9748-b40d0abb40ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00bb9b71efb649b5be498ba8127a7d2d', 'request_id': 'req-ae99834c-5d64-4a46-9748-b40d0abb40ff'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:37.694194 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ae99834c-5d64-4a46-9748-b40d0abb40ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00bb9b71efb649b5be498ba8127a7d2d', 'request_id': 'req-ae99834c-5d64-4a46-9748-b40d0abb40ff'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:37.700454 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ae99834c-5d64-4a46-9748-b40d0abb40ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00bb9b71efb649b5be498ba8127a7d2d', 'request_id': 'req-ae99834c-5d64-4a46-9748-b40d0abb40ff'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:37.714529 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ae99834c-5d64-4a46-9748-b40d0abb40ff admin admin] The token cache is being invalidate because project 00bb9b71efb649b5be498ba8127a7d2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:43:37.714819 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ae99834c-5d64-4a46-9748-b40d0abb40ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:37.715433 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ae99834c-5d64-4a46-9748-b40d0abb40ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:37.717056 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1281/2561] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:43:37 2022] DELETE /identity/v3/projects/00bb9b71efb649b5be498ba8127a7d2d => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:43:37.721028 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f462e70d-7646-428a-9961-3e903a926fd3 service neutron] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:37.730761 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f462e70d-7646-428a-9961-3e903a926fd3 service neutron] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:37.793067 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d09994-5b09-458d-906c-3a8427e9a6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:37.793852 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d09994-5b09-458d-906c-3a8427e9a6ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:37.794160 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d09994-5b09-458d-906c-3a8427e9a6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:37.794399 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d09994-5b09-458d-906c-3a8427e9a6ed admin admin] PATH_INFO: `/v3/users/b0f7b74aabb945aebca5948ba47019b7` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:37.795574 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d09994-5b09-458d-906c-3a8427e9a6ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0f7b74aabb945aebca5948ba47019b7)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:37.797525 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d09994-5b09-458d-906c-3a8427e9a6ed admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:37.846736 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-b7d09994-5b09-458d-906c-3a8427e9a6ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0f7b74aabb945aebca5948ba47019b7'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:37.847499 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-b7d09994-5b09-458d-906c-3a8427e9a6ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0f7b74aabb945aebca5948ba47019b7'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:37.848134 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-b7d09994-5b09-458d-906c-3a8427e9a6ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0f7b74aabb945aebca5948ba47019b7'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:37.856399 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-b7d09994-5b09-458d-906c-3a8427e9a6ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0f7b74aabb945aebca5948ba47019b7'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:37.869022 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-b7d09994-5b09-458d-906c-3a8427e9a6ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0f7b74aabb945aebca5948ba47019b7'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:37.882109 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1281/2562] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:43:37 2022] DELETE /identity/v3/users/b0f7b74aabb945aebca5948ba47019b7 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:43:38.160324 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae99834c-5d64-4a46-9748-b40d0abb40ff admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:38.161853 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ae99834c-5d64-4a46-9748-b40d0abb40ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:38.175068 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae99834c-5d64-4a46-9748-b40d0abb40ff admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:38.230429 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6619e1-8356-46cb-b24b-84ce58f42dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:38.231338 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6619e1-8356-46cb-b24b-84ce58f42dd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:38.231705 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6619e1-8356-46cb-b24b-84ce58f42dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:38.232108 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6619e1-8356-46cb-b24b-84ce58f42dd9 admin admin] PATH_INFO: `/v3/projects/792a6c0dd9034426b98c80890b3e5ee1` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:38.233272 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6619e1-8356-46cb-b24b-84ce58f42dd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=792a6c0dd9034426b98c80890b3e5ee1)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:38.235247 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6619e1-8356-46cb-b24b-84ce58f42dd9 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:38.281220 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ca6619e1-8356-46cb-b24b-84ce58f42dd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '792a6c0dd9034426b98c80890b3e5ee1', 'request_id': 'req-ca6619e1-8356-46cb-b24b-84ce58f42dd9'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:38.287099 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ca6619e1-8356-46cb-b24b-84ce58f42dd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '792a6c0dd9034426b98c80890b3e5ee1', 'request_id': 'req-ca6619e1-8356-46cb-b24b-84ce58f42dd9'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:38.293119 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ca6619e1-8356-46cb-b24b-84ce58f42dd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '792a6c0dd9034426b98c80890b3e5ee1', 'request_id': 'req-ca6619e1-8356-46cb-b24b-84ce58f42dd9'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:38.305913 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ca6619e1-8356-46cb-b24b-84ce58f42dd9 admin admin] The token cache is being invalidate because project 792a6c0dd9034426b98c80890b3e5ee1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:43:38.306201 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ca6619e1-8356-46cb-b24b-84ce58f42dd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:38.306820 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ca6619e1-8356-46cb-b24b-84ce58f42dd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:38.308384 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1282/2563] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:43:38 2022] DELETE /identity/v3/projects/792a6c0dd9034426b98c80890b3e5ee1 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:43:38.313513 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b9309-9722-48cd-979e-1492b789d448 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:38.314002 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b9309-9722-48cd-979e-1492b789d448 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:38.314108 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b9309-9722-48cd-979e-1492b789d448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:38.331361 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-077b9309-9722-48cd-979e-1492b789d448 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:43:38.332605 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-077b9309-9722-48cd-979e-1492b789d448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:38.361881 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:38.394382 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1282/2564] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:43:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:43:38.403248 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9d3da-1c97-4fe5-a76b-27254a3eff4e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:38.403537 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9d3da-1c97-4fe5-a76b-27254a3eff4e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:38.403816 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9d3da-1c97-4fe5-a76b-27254a3eff4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:38.422369 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-49a9d3da-1c97-4fe5-a76b-27254a3eff4e None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:43:38.423562 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-49a9d3da-1c97-4fe5-a76b-27254a3eff4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:38.432103 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1283/2565] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:43:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:43:38.436340 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b9309-9722-48cd-979e-1492b789d448 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:38.446727 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b9309-9722-48cd-979e-1492b789d448 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:38.451303 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb521c-ddfa-4913-9ef7-45e0181e158a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:38.451946 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb521c-ddfa-4913-9ef7-45e0181e158a admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:38.452229 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb521c-ddfa-4913-9ef7-45e0181e158a admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:38.452506 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb521c-ddfa-4913-9ef7-45e0181e158a admin admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:38.453267 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fb521c-ddfa-4913-9ef7-45e0181e158a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:43:38.453579 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fb521c-ddfa-4913-9ef7-45e0181e158a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:38.455165 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fb521c-ddfa-4913-9ef7-45e0181e158a admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:38.467425 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1283/2566] 10.222.0.16 () {58 vars in 1152 bytes} [Thu May 26 12:43:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:43:38.471729 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a9d3da-1c97-4fe5-a76b-27254a3eff4e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:38.481115 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a9d3da-1c97-4fe5-a76b-27254a3eff4e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:38.485795 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c16447-8c57-4f05-be85-f021aeca5090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:38.486437 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c16447-8c57-4f05-be85-f021aeca5090 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:38.486717 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c16447-8c57-4f05-be85-f021aeca5090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:38.486986 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c16447-8c57-4f05-be85-f021aeca5090 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:38.487668 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c16447-8c57-4f05-be85-f021aeca5090 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:38.489617 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c16447-8c57-4f05-be85-f021aeca5090 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:38.503802 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:38.524329 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1284/2567] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:43:38 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:43:38.525505 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb521c-ddfa-4913-9ef7-45e0181e158a admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:38.538794 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb521c-ddfa-4913-9ef7-45e0181e158a admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:38.600036 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6772dfc9-c22a-4426-bcc5-d59a2ecc1b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:38.600703 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772dfc9-c22a-4426-bcc5-d59a2ecc1b9e admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:38.601018 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772dfc9-c22a-4426-bcc5-d59a2ecc1b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:38.601294 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772dfc9-c22a-4426-bcc5-d59a2ecc1b9e admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:38.601970 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6772dfc9-c22a-4426-bcc5-d59a2ecc1b9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:38.603877 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6772dfc9-c22a-4426-bcc5-d59a2ecc1b9e admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:38.628119 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1284/2568] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:43:38 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:43:38.630118 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c16447-8c57-4f05-be85-f021aeca5090 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:38.640269 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c16447-8c57-4f05-be85-f021aeca5090 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:38.645408 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa571f5-1803-46d9-b8e1-62cf36c55a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:38.646059 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa571f5-1803-46d9-b8e1-62cf36c55a86 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:38.646346 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa571f5-1803-46d9-b8e1-62cf36c55a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:38.646621 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa571f5-1803-46d9-b8e1-62cf36c55a86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:38.647339 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa571f5-1803-46d9-b8e1-62cf36c55a86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:38.648969 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa571f5-1803-46d9-b8e1-62cf36c55a86 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:38.659263 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1285/2569] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:43:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:43:38.663098 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6772dfc9-c22a-4426-bcc5-d59a2ecc1b9e admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:38.673203 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6772dfc9-c22a-4426-bcc5-d59a2ecc1b9e admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:38.678378 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b7113c-5380-48c8-81c4-fc2c6092c039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:38.679050 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b7113c-5380-48c8-81c4-fc2c6092c039 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:38.679331 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b7113c-5380-48c8-81c4-fc2c6092c039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:38.679604 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b7113c-5380-48c8-81c4-fc2c6092c039 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:38.680325 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b7113c-5380-48c8-81c4-fc2c6092c039 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:38.681940 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b7113c-5380-48c8-81c4-fc2c6092c039 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:38.692451 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1285/2570] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:43:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:43:38.696430 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa571f5-1803-46d9-b8e1-62cf36c55a86 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:38.706541 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa571f5-1803-46d9-b8e1-62cf36c55a86 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:38.711274 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961dad2f-cc2b-426a-b48f-ae50f5bf8723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:38.712153 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961dad2f-cc2b-426a-b48f-ae50f5bf8723 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:38.712439 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961dad2f-cc2b-426a-b48f-ae50f5bf8723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:38.712712 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961dad2f-cc2b-426a-b48f-ae50f5bf8723 admin admin] PATH_INFO: `/v3/projects/28a9b997c4724f1ca782a192ff6e76d4/users/0141e4245f244f2aa0036f8a1d160865/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:38.727031 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961dad2f-cc2b-426a-b48f-ae50f5bf8723 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28a9b997c4724f1ca782a192ff6e76d4, user_id=0141e4245f244f2aa0036f8a1d160865, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:38.729741 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961dad2f-cc2b-426a-b48f-ae50f5bf8723 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:38.742752 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1286/2571] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:43:38 2022] PUT /identity/v3/projects/28a9b997c4724f1ca782a192ff6e76d4/users/0141e4245f244f2aa0036f8a1d160865/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:43:38.753371 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2b239-24c5-43a3-aee5-48580f1fe313 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:38.753664 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2b239-24c5-43a3-aee5-48580f1fe313 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:38.753940 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2b239-24c5-43a3-aee5-48580f1fe313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:38.781390 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-54a2b239-24c5-43a3-aee5-48580f1fe313 None None] MFA Rules not processed for user `0141e4245f244f2aa0036f8a1d160865`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:43:38.782587 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-54a2b239-24c5-43a3-aee5-48580f1fe313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:38.847637 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1286/2572] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:43:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:43:38.859524 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961dad2f-cc2b-426a-b48f-ae50f5bf8723 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:38.861312 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-961dad2f-cc2b-426a-b48f-ae50f5bf8723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:38.918753 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961dad2f-cc2b-426a-b48f-ae50f5bf8723 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:38.922663 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f57a4ac-b6df-4d0a-ba8f-6af589cdcf77 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad8cfccd3a4d42d381ce62ea90849f19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:38.923296 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57a4ac-b6df-4d0a-ba8f-6af589cdcf77 service glance] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:38.923619 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57a4ac-b6df-4d0a-ba8f-6af589cdcf77 service glance] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:38.923932 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57a4ac-b6df-4d0a-ba8f-6af589cdcf77 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:38.933032 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f57a4ac-b6df-4d0a-ba8f-6af589cdcf77 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:38.934481 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f57a4ac-b6df-4d0a-ba8f-6af589cdcf77 service glance] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:38.943959 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1287/2573] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:43:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:43:39.950629 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec96b86-7439-4335-8bdc-48da3a0c2b6d None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:39.951199 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec96b86-7439-4335-8bdc-48da3a0c2b6d None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:39.951199 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec96b86-7439-4335-8bdc-48da3a0c2b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:39.971575 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-dec96b86-7439-4335-8bdc-48da3a0c2b6d None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:43:39.973324 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-dec96b86-7439-4335-8bdc-48da3a0c2b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:40.000441 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:40.040668 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1287/2574] 10.222.0.73 () {58 vars in 1016 bytes} [Thu May 26 12:43:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:43:40.061724 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f57a4ac-b6df-4d0a-ba8f-6af589cdcf77 service glance] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:40.063198 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3f57a4ac-b6df-4d0a-ba8f-6af589cdcf77 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:40.145022 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f57a4ac-b6df-4d0a-ba8f-6af589cdcf77 service glance] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:40.150612 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521ffe9f-c57a-4bde-ad94-27a808a371f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536f68ff77794352adf41aaacdc0645c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:40.151265 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ffe9f-c57a-4bde-ad94-27a808a371f9 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:40.151554 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ffe9f-c57a-4bde-ad94-27a808a371f9 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:40.151833 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ffe9f-c57a-4bde-ad94-27a808a371f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:40.160981 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521ffe9f-c57a-4bde-ad94-27a808a371f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:40.162596 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521ffe9f-c57a-4bde-ad94-27a808a371f9 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:40.172158 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1288/2575] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:43:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:43:44.257015 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2a64e-f6f8-4462-b991-fe8feca0aff0 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:44.257533 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2a64e-f6f8-4462-b991-fe8feca0aff0 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:44.257632 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2a64e-f6f8-4462-b991-fe8feca0aff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:44.275873 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-ecd2a64e-f6f8-4462-b991-fe8feca0aff0 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:43:44.277154 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-ecd2a64e-f6f8-4462-b991-fe8feca0aff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:44.285696 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1288/2576] 10.222.0.73 () {58 vars in 1016 bytes} [Thu May 26 12:43:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:43:44.308928 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521ffe9f-c57a-4bde-ad94-27a808a371f9 service nova] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:44.310485 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-521ffe9f-c57a-4bde-ad94-27a808a371f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:44.325338 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521ffe9f-c57a-4bde-ad94-27a808a371f9 service nova] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:44.331497 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff6462-2a60-42de-8458-71b85ed9cfeb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536f68ff77794352adf41aaacdc0645c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:44.332215 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff6462-2a60-42de-8458-71b85ed9cfeb service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:44.332501 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff6462-2a60-42de-8458-71b85ed9cfeb service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:44.332906 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff6462-2a60-42de-8458-71b85ed9cfeb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:44.341986 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ff6462-2a60-42de-8458-71b85ed9cfeb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:44.343599 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ff6462-2a60-42de-8458-71b85ed9cfeb service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:44.354169 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1289/2577] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:43:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:43:48.351930 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ecb64-66f1-4fc4-b239-d9350e0444fc None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:48.352425 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ecb64-66f1-4fc4-b239-d9350e0444fc None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:48.352544 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ecb64-66f1-4fc4-b239-d9350e0444fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:48.371775 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-1b1ecb64-66f1-4fc4-b239-d9350e0444fc None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:43:48.373039 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-1b1ecb64-66f1-4fc4-b239-d9350e0444fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:48.382233 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1289/2578] 10.222.0.73 () {58 vars in 1016 bytes} [Thu May 26 12:43:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:43:48.406906 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff6462-2a60-42de-8458-71b85ed9cfeb service nova] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:48.423790 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff6462-2a60-42de-8458-71b85ed9cfeb service nova] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:48.430009 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851a253d-45ba-426d-bea0-cd82ac6540ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536f68ff77794352adf41aaacdc0645c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:48.430673 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a253d-45ba-426d-bea0-cd82ac6540ef service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:48.430961 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a253d-45ba-426d-bea0-cd82ac6540ef service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:48.431238 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a253d-45ba-426d-bea0-cd82ac6540ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:48.440084 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851a253d-45ba-426d-bea0-cd82ac6540ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:48.442426 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851a253d-45ba-426d-bea0-cd82ac6540ef service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:48.452809 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1290/2579] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:43:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:43:52.541697 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c59cf-ef1f-42d9-9e2a-2784da237ed9 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:52.542251 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c59cf-ef1f-42d9-9e2a-2784da237ed9 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:52.542251 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c59cf-ef1f-42d9-9e2a-2784da237ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:52.559913 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-e51c59cf-ef1f-42d9-9e2a-2784da237ed9 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:43:52.561138 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-e51c59cf-ef1f-42d9-9e2a-2784da237ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:52.569567 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1290/2580] 10.222.0.73 () {58 vars in 1016 bytes} [Thu May 26 12:43:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:43:52.599194 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851a253d-45ba-426d-bea0-cd82ac6540ef service nova] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:52.610366 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851a253d-45ba-426d-bea0-cd82ac6540ef service nova] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:52.615917 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0fe47d-3011-49d9-8b73-848a094e1fbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536f68ff77794352adf41aaacdc0645c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:52.616584 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0fe47d-3011-49d9-8b73-848a094e1fbe service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:52.616931 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0fe47d-3011-49d9-8b73-848a094e1fbe service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:52.617215 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0fe47d-3011-49d9-8b73-848a094e1fbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:52.626028 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0fe47d-3011-49d9-8b73-848a094e1fbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:52.627661 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0fe47d-3011-49d9-8b73-848a094e1fbe service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:52.637920 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1291/2581] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:43:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:43:59.809319 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d66f7-1b12-415e-87dc-6e177f83cbad None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:59.809868 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d66f7-1b12-415e-87dc-6e177f83cbad None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:59.809868 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d66f7-1b12-415e-87dc-6e177f83cbad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:59.828275 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-9a3d66f7-1b12-415e-87dc-6e177f83cbad None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:43:59.829493 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-9a3d66f7-1b12-415e-87dc-6e177f83cbad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:59.840316 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1291/2582] 10.222.0.73 () {58 vars in 1016 bytes} [Thu May 26 12:43:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:43:59.860584 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0fe47d-3011-49d9-8b73-848a094e1fbe service nova] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:59.871714 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0fe47d-3011-49d9-8b73-848a094e1fbe service nova] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:59.878484 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db62c0-122d-4b44-9b55-ad0c4e8ec5e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536f68ff77794352adf41aaacdc0645c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:59.879144 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db62c0-122d-4b44-9b55-ad0c4e8ec5e9 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:59.879423 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db62c0-122d-4b44-9b55-ad0c4e8ec5e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:59.879728 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db62c0-122d-4b44-9b55-ad0c4e8ec5e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:59.886509 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:59.889143 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db62c0-122d-4b44-9b55-ad0c4e8ec5e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:59.891073 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db62c0-122d-4b44-9b55-ad0c4e8ec5e9 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:59.902574 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1292/2583] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:43:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:44:00.701459 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d66f7-1b12-415e-87dc-6e177f83cbad None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:00.712046 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d66f7-1b12-415e-87dc-6e177f83cbad None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:00.716966 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e482a8-b4b1-4cab-afa4-473e6eb3962c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:00.717823 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e482a8-b4b1-4cab-afa4-473e6eb3962c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:00.718104 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e482a8-b4b1-4cab-afa4-473e6eb3962c admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:00.718377 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e482a8-b4b1-4cab-afa4-473e6eb3962c admin admin] PATH_INFO: `/v3/users/0141e4245f244f2aa0036f8a1d160865` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:00.719572 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e482a8-b4b1-4cab-afa4-473e6eb3962c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0141e4245f244f2aa0036f8a1d160865)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:00.722130 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e482a8-b4b1-4cab-afa4-473e6eb3962c admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:00.773645 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-05e482a8-b4b1-4cab-afa4-473e6eb3962c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0141e4245f244f2aa0036f8a1d160865'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:00.774285 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-05e482a8-b4b1-4cab-afa4-473e6eb3962c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0141e4245f244f2aa0036f8a1d160865'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:00.774965 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-05e482a8-b4b1-4cab-afa4-473e6eb3962c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0141e4245f244f2aa0036f8a1d160865'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:00.783312 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-05e482a8-b4b1-4cab-afa4-473e6eb3962c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0141e4245f244f2aa0036f8a1d160865'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:00.798786 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-05e482a8-b4b1-4cab-afa4-473e6eb3962c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0141e4245f244f2aa0036f8a1d160865'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:00.813655 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1292/2584] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:44:00 2022] DELETE /identity/v3/users/0141e4245f244f2aa0036f8a1d160865 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:00.818714 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4e332-ce6d-4430-83e7-19bedfd26737 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:00.819070 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4e332-ce6d-4430-83e7-19bedfd26737 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:00.819420 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4e332-ce6d-4430-83e7-19bedfd26737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:00.841379 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-99d4e332-ce6d-4430-83e7-19bedfd26737 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:00.842688 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-99d4e332-ce6d-4430-83e7-19bedfd26737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:00.911215 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1293/2585] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:44:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:44:00.921275 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e482a8-b4b1-4cab-afa4-473e6eb3962c admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:00.922724 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-05e482a8-b4b1-4cab-afa4-473e6eb3962c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:00.988580 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e482a8-b4b1-4cab-afa4-473e6eb3962c admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:00.992298 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29803507-dc7e-4bdb-8ff5-a46ac5b2f00a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:00.992979 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29803507-dc7e-4bdb-8ff5-a46ac5b2f00a service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:00.993266 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29803507-dc7e-4bdb-8ff5-a46ac5b2f00a service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:00.993547 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29803507-dc7e-4bdb-8ff5-a46ac5b2f00a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:01.004615 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29803507-dc7e-4bdb-8ff5-a46ac5b2f00a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:01.006088 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29803507-dc7e-4bdb-8ff5-a46ac5b2f00a service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:01.016974 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1293/2586] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:44:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:44:01.305839 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d4e332-ce6d-4430-83e7-19bedfd26737 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:01.307361 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-99d4e332-ce6d-4430-83e7-19bedfd26737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:01.320577 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d4e332-ce6d-4430-83e7-19bedfd26737 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:01.326556 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0895e07-3a32-4471-9943-6927c6bc9811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:01.327699 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0895e07-3a32-4471-9943-6927c6bc9811 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:01.328251 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0895e07-3a32-4471-9943-6927c6bc9811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:01.328621 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0895e07-3a32-4471-9943-6927c6bc9811 admin admin] PATH_INFO: `/v3/projects/28a9b997c4724f1ca782a192ff6e76d4` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:01.331349 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0895e07-3a32-4471-9943-6927c6bc9811 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28a9b997c4724f1ca782a192ff6e76d4)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:01.333829 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0895e07-3a32-4471-9943-6927c6bc9811 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:01.385754 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e0895e07-3a32-4471-9943-6927c6bc9811 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28a9b997c4724f1ca782a192ff6e76d4', 'request_id': 'req-e0895e07-3a32-4471-9943-6927c6bc9811'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:01.394072 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e0895e07-3a32-4471-9943-6927c6bc9811 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28a9b997c4724f1ca782a192ff6e76d4', 'request_id': 'req-e0895e07-3a32-4471-9943-6927c6bc9811'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:01.401595 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e0895e07-3a32-4471-9943-6927c6bc9811 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28a9b997c4724f1ca782a192ff6e76d4', 'request_id': 'req-e0895e07-3a32-4471-9943-6927c6bc9811'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:01.414429 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e0895e07-3a32-4471-9943-6927c6bc9811 admin admin] The token cache is being invalidate because project 28a9b997c4724f1ca782a192ff6e76d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:44:01.414727 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e0895e07-3a32-4471-9943-6927c6bc9811 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:01.415353 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e0895e07-3a32-4471-9943-6927c6bc9811 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:01.417180 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1294/2587] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:44:01 2022] DELETE /identity/v3/projects/28a9b997c4724f1ca782a192ff6e76d4 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:01.423242 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61734f28-d8dc-42dd-8f1f-bd6a197c1e60 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:01.423641 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61734f28-d8dc-42dd-8f1f-bd6a197c1e60 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:01.424001 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61734f28-d8dc-42dd-8f1f-bd6a197c1e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:01.443104 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-61734f28-d8dc-42dd-8f1f-bd6a197c1e60 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:01.444603 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-61734f28-d8dc-42dd-8f1f-bd6a197c1e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:01.458470 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:01.541628 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1294/2588] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:44:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:01.551819 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c6043-3cd6-4900-9d50-33c6aa1acbd2 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:01.552211 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c6043-3cd6-4900-9d50-33c6aa1acbd2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:01.552565 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c6043-3cd6-4900-9d50-33c6aa1acbd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:01.571705 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-6d3c6043-3cd6-4900-9d50-33c6aa1acbd2 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:01.573052 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6d3c6043-3cd6-4900-9d50-33c6aa1acbd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:01.581320 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1295/2589] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:44:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:01.586268 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61734f28-d8dc-42dd-8f1f-bd6a197c1e60 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:01.605500 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61734f28-d8dc-42dd-8f1f-bd6a197c1e60 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:01.613934 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a2255b-0bbd-4db5-a873-7f10fdef58c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:01.615131 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2255b-0bbd-4db5-a873-7f10fdef58c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:01.615645 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2255b-0bbd-4db5-a873-7f10fdef58c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:01.616207 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2255b-0bbd-4db5-a873-7f10fdef58c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:01.617723 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a2255b-0bbd-4db5-a873-7f10fdef58c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:44:01.618271 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a2255b-0bbd-4db5-a873-7f10fdef58c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:01.621520 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a2255b-0bbd-4db5-a873-7f10fdef58c0 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:01.643612 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1295/2590] 10.222.0.16 () {58 vars in 1152 bytes} [Thu May 26 12:44:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:44:01.649003 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c6043-3cd6-4900-9d50-33c6aa1acbd2 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:01.666991 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c6043-3cd6-4900-9d50-33c6aa1acbd2 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:01.675927 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649aab0-eb0a-496c-9171-4a5e6aad418b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:01.677126 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649aab0-eb0a-496c-9171-4a5e6aad418b admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:01.677633 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649aab0-eb0a-496c-9171-4a5e6aad418b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:01.678128 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649aab0-eb0a-496c-9171-4a5e6aad418b admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:01.679414 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e649aab0-eb0a-496c-9171-4a5e6aad418b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:01.682939 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e649aab0-eb0a-496c-9171-4a5e6aad418b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:01.714975 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1296/2591] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:44:01 2022] POST /identity/v3/projects => generated 369 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:44:01.716148 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a2255b-0bbd-4db5-a873-7f10fdef58c0 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:01.727068 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a2255b-0bbd-4db5-a873-7f10fdef58c0 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:01.792669 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b268f19-9c0e-4fbe-86fc-24b1e824a61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:01.793534 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b268f19-9c0e-4fbe-86fc-24b1e824a61a admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:01.793804 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b268f19-9c0e-4fbe-86fc-24b1e824a61a admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:01.794212 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b268f19-9c0e-4fbe-86fc-24b1e824a61a admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:01.795014 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b268f19-9c0e-4fbe-86fc-24b1e824a61a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:01.797070 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b268f19-9c0e-4fbe-86fc-24b1e824a61a admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:01.833078 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1296/2592] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:44:01 2022] POST /identity/v3/users => generated 285 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:44:01.836559 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649aab0-eb0a-496c-9171-4a5e6aad418b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:01.853572 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649aab0-eb0a-496c-9171-4a5e6aad418b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:01.861269 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f44f35-e89f-4e35-9347-35821fb4f32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:01.862615 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f44f35-e89f-4e35-9347-35821fb4f32c admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:01.863121 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f44f35-e89f-4e35-9347-35821fb4f32c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:01.863475 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f44f35-e89f-4e35-9347-35821fb4f32c admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:01.864442 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f44f35-e89f-4e35-9347-35821fb4f32c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:01.866219 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f44f35-e89f-4e35-9347-35821fb4f32c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:01.878295 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1297/2593] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:44:01 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:44:01.883005 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b268f19-9c0e-4fbe-86fc-24b1e824a61a admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:01.894041 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b268f19-9c0e-4fbe-86fc-24b1e824a61a admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:01.899394 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b0be4-b14b-4ec3-bd44-7efc428a1491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:01.900088 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b0be4-b14b-4ec3-bd44-7efc428a1491 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:01.900372 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b0be4-b14b-4ec3-bd44-7efc428a1491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:01.900649 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b0be4-b14b-4ec3-bd44-7efc428a1491 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:01.901442 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7b0be4-b14b-4ec3-bd44-7efc428a1491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:01.903072 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7b0be4-b14b-4ec3-bd44-7efc428a1491 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:01.915627 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1297/2594] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:44:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:44:01.919540 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f44f35-e89f-4e35-9347-35821fb4f32c admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:01.935164 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f44f35-e89f-4e35-9347-35821fb4f32c admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:01.948620 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe0e428-839e-4168-9c72-1c5594a7ee8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:01.949573 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0e428-839e-4168-9c72-1c5594a7ee8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:01.950042 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0e428-839e-4168-9c72-1c5594a7ee8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:01.950324 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0e428-839e-4168-9c72-1c5594a7ee8d admin admin] PATH_INFO: `/v3/projects/d990bddc5bc24440bcd5f6530b01a5e2/users/107c077bdf3c4126b2d426df02b546d0/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:01.969747 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe0e428-839e-4168-9c72-1c5594a7ee8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d990bddc5bc24440bcd5f6530b01a5e2, user_id=107c077bdf3c4126b2d426df02b546d0, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:01.973059 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe0e428-839e-4168-9c72-1c5594a7ee8d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:01.991767 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1298/2595] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:44:01 2022] PUT /identity/v3/projects/d990bddc5bc24440bcd5f6530b01a5e2/users/107c077bdf3c4126b2d426df02b546d0/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:44:02.006859 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfbcb2b-6960-4b75-aae2-502376b30e96 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:02.007711 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfbcb2b-6960-4b75-aae2-502376b30e96 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:02.008200 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfbcb2b-6960-4b75-aae2-502376b30e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:02.041093 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-8cfbcb2b-6960-4b75-aae2-502376b30e96 None None] MFA Rules not processed for user `107c077bdf3c4126b2d426df02b546d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:02.043169 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-8cfbcb2b-6960-4b75-aae2-502376b30e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:02.137758 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1298/2596] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:44:02 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:02.153177 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe0e428-839e-4168-9c72-1c5594a7ee8d admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:02.155338 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-fbe0e428-839e-4168-9c72-1c5594a7ee8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:02.182251 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:02.234445 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe0e428-839e-4168-9c72-1c5594a7ee8d admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:02.239146 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcf1de2-d753-458f-8188-6a106601c7f1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad8cfccd3a4d42d381ce62ea90849f19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:02.239965 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf1de2-d753-458f-8188-6a106601c7f1 service glance] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:02.240310 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf1de2-d753-458f-8188-6a106601c7f1 service glance] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:02.240591 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf1de2-d753-458f-8188-6a106601c7f1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:02.250663 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcf1de2-d753-458f-8188-6a106601c7f1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:02.252236 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcf1de2-d753-458f-8188-6a106601c7f1 service glance] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:02.270041 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1299/2597] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:44:02 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:44:06.440570 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfbcb2b-6960-4b75-aae2-502376b30e96 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:06.442008 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-8cfbcb2b-6960-4b75-aae2-502376b30e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:06.456117 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:06.503790 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfbcb2b-6960-4b75-aae2-502376b30e96 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:06.507988 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde1f0a-6153-4db3-8ee0-32872c81895a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:06.508703 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde1f0a-6153-4db3-8ee0-32872c81895a service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:06.509045 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde1f0a-6153-4db3-8ee0-32872c81895a service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:06.509326 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde1f0a-6153-4db3-8ee0-32872c81895a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:06.511321 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-edde1f0a-6153-4db3-8ee0-32872c81895a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:06.577735 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edde1f0a-6153-4db3-8ee0-32872c81895a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:06.579153 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edde1f0a-6153-4db3-8ee0-32872c81895a service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:06.589642 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1299/2598] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:44:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:44:09.877521 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcf1de2-d753-458f-8188-6a106601c7f1 service glance] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:09.878984 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5dcf1de2-d753-458f-8188-6a106601c7f1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:09.895831 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcf1de2-d753-458f-8188-6a106601c7f1 service glance] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:09.900408 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e72144b-bec2-4140-90ad-d868e2a440af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:09.901324 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72144b-bec2-4140-90ad-d868e2a440af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:09.901613 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72144b-bec2-4140-90ad-d868e2a440af admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:09.902035 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72144b-bec2-4140-90ad-d868e2a440af admin admin] PATH_INFO: `/v3/users/62ff83542a7c4c7982affdc3b882cdd2` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:09.903236 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e72144b-bec2-4140-90ad-d868e2a440af admin admin] RBAC: Authorizing `identity:delete_user(user_id=62ff83542a7c4c7982affdc3b882cdd2)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:09.905220 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e72144b-bec2-4140-90ad-d868e2a440af admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:09.963420 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5e72144b-bec2-4140-90ad-d868e2a440af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62ff83542a7c4c7982affdc3b882cdd2'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:09.970904 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5e72144b-bec2-4140-90ad-d868e2a440af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62ff83542a7c4c7982affdc3b882cdd2'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:09.971622 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5e72144b-bec2-4140-90ad-d868e2a440af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62ff83542a7c4c7982affdc3b882cdd2'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:09.972774 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5e72144b-bec2-4140-90ad-d868e2a440af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62ff83542a7c4c7982affdc3b882cdd2'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:09.979698 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5e72144b-bec2-4140-90ad-d868e2a440af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62ff83542a7c4c7982affdc3b882cdd2'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:09.997082 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1300/2599] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:44:09 2022] DELETE /identity/v3/users/62ff83542a7c4c7982affdc3b882cdd2 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:44:10.187115 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde1f0a-6153-4db3-8ee0-32872c81895a service neutron] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:10.201018 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde1f0a-6153-4db3-8ee0-32872c81895a service neutron] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:10.266158 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0cebc8-68a9-41c1-bd8b-1794f7ff907a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:10.267035 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0cebc8-68a9-41c1-bd8b-1794f7ff907a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:10.267983 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0cebc8-68a9-41c1-bd8b-1794f7ff907a admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:10.268396 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0cebc8-68a9-41c1-bd8b-1794f7ff907a admin admin] PATH_INFO: `/v3/projects/e6c4fdad2c744b218d5a6706d90db4aa` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:10.269700 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0cebc8-68a9-41c1-bd8b-1794f7ff907a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6c4fdad2c744b218d5a6706d90db4aa)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:10.271650 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0cebc8-68a9-41c1-bd8b-1794f7ff907a admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:10.339718 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-bc0cebc8-68a9-41c1-bd8b-1794f7ff907a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6c4fdad2c744b218d5a6706d90db4aa', 'request_id': 'req-bc0cebc8-68a9-41c1-bd8b-1794f7ff907a'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:10.348266 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-bc0cebc8-68a9-41c1-bd8b-1794f7ff907a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6c4fdad2c744b218d5a6706d90db4aa', 'request_id': 'req-bc0cebc8-68a9-41c1-bd8b-1794f7ff907a'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:10.354842 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-bc0cebc8-68a9-41c1-bd8b-1794f7ff907a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6c4fdad2c744b218d5a6706d90db4aa', 'request_id': 'req-bc0cebc8-68a9-41c1-bd8b-1794f7ff907a'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:10.359206 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:10.368794 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-bc0cebc8-68a9-41c1-bd8b-1794f7ff907a admin admin] The token cache is being invalidate because project e6c4fdad2c744b218d5a6706d90db4aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:44:10.369140 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-bc0cebc8-68a9-41c1-bd8b-1794f7ff907a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:10.371070 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-bc0cebc8-68a9-41c1-bd8b-1794f7ff907a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:10.373478 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1300/2600] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:44:10 2022] DELETE /identity/v3/projects/e6c4fdad2c744b218d5a6706d90db4aa => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:10.379602 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274508f-12d0-4b00-8489-a4baf5222647 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:10.379900 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274508f-12d0-4b00-8489-a4baf5222647 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:10.380215 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274508f-12d0-4b00-8489-a4baf5222647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:10.402458 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-8274508f-12d0-4b00-8489-a4baf5222647 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:10.403724 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8274508f-12d0-4b00-8489-a4baf5222647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:10.466205 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1301/2601] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:44:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:10.474184 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a6c52-eb28-4efc-b23b-0db914d813fe None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:10.474474 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a6c52-eb28-4efc-b23b-0db914d813fe None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:10.474755 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a6c52-eb28-4efc-b23b-0db914d813fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:10.493615 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-dd6a6c52-eb28-4efc-b23b-0db914d813fe None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:10.494823 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-dd6a6c52-eb28-4efc-b23b-0db914d813fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:10.503655 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1301/2602] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:44:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:10.508156 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8274508f-12d0-4b00-8489-a4baf5222647 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:10.518054 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8274508f-12d0-4b00-8489-a4baf5222647 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:10.523281 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7bebb-ac57-470c-9858-419cee034e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:10.523940 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7bebb-ac57-470c-9858-419cee034e84 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:10.524226 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7bebb-ac57-470c-9858-419cee034e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:10.524509 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7bebb-ac57-470c-9858-419cee034e84 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:10.525300 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c7bebb-ac57-470c-9858-419cee034e84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:44:10.525593 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c7bebb-ac57-470c-9858-419cee034e84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:10.527206 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c7bebb-ac57-470c-9858-419cee034e84 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:10.539337 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1302/2603] 10.222.0.16 () {58 vars in 1152 bytes} [Thu May 26 12:44:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:44:10.543934 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a6c52-eb28-4efc-b23b-0db914d813fe None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:10.553964 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a6c52-eb28-4efc-b23b-0db914d813fe None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:10.558754 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04359bd6-eda5-4cb0-9afc-c373f8271df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:10.559401 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04359bd6-eda5-4cb0-9afc-c373f8271df1 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:10.559683 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04359bd6-eda5-4cb0-9afc-c373f8271df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:10.559956 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04359bd6-eda5-4cb0-9afc-c373f8271df1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:10.560670 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04359bd6-eda5-4cb0-9afc-c373f8271df1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:10.562646 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04359bd6-eda5-4cb0-9afc-c373f8271df1 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:10.589839 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1302/2604] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:44:10 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:44:10.594331 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7bebb-ac57-470c-9858-419cee034e84 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:10.605627 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7bebb-ac57-470c-9858-419cee034e84 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:10.618547 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:10.675942 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec9050a-0d6a-45a4-8165-d5dc165258c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:10.676623 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9050a-0d6a-45a4-8165-d5dc165258c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:10.676946 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9050a-0d6a-45a4-8165-d5dc165258c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:10.677224 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9050a-0d6a-45a4-8165-d5dc165258c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:10.677936 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec9050a-0d6a-45a4-8165-d5dc165258c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:10.679913 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec9050a-0d6a-45a4-8165-d5dc165258c3 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:10.700085 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1303/2605] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:44:10 2022] POST /identity/v3/users => generated 286 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:44:10.705462 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04359bd6-eda5-4cb0-9afc-c373f8271df1 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:10.716157 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04359bd6-eda5-4cb0-9afc-c373f8271df1 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:10.721380 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1dfd06-ce3c-452e-ba46-d2a544c95c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:10.722047 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1dfd06-ce3c-452e-ba46-d2a544c95c61 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:10.722331 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1dfd06-ce3c-452e-ba46-d2a544c95c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:10.722609 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1dfd06-ce3c-452e-ba46-d2a544c95c61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:10.723338 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1dfd06-ce3c-452e-ba46-d2a544c95c61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:10.724971 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1dfd06-ce3c-452e-ba46-d2a544c95c61 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:10.735853 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1303/2606] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:44:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:44:10.740714 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec9050a-0d6a-45a4-8165-d5dc165258c3 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:10.752321 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec9050a-0d6a-45a4-8165-d5dc165258c3 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:10.758970 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c93c36b-d79f-4766-b903-df51eacc42af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:10.759726 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93c36b-d79f-4766-b903-df51eacc42af admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:10.760053 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93c36b-d79f-4766-b903-df51eacc42af admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:10.760370 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93c36b-d79f-4766-b903-df51eacc42af admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:10.761199 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c93c36b-d79f-4766-b903-df51eacc42af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:10.762852 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c93c36b-d79f-4766-b903-df51eacc42af admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:10.773765 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1304/2607] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:44:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:44:10.778213 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1dfd06-ce3c-452e-ba46-d2a544c95c61 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:10.789262 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1dfd06-ce3c-452e-ba46-d2a544c95c61 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:10.794498 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7a51a-4f64-45a7-b1ba-1289e835d975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:10.795454 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7a51a-4f64-45a7-b1ba-1289e835d975 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:10.795739 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7a51a-4f64-45a7-b1ba-1289e835d975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:10.796021 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7a51a-4f64-45a7-b1ba-1289e835d975 admin admin] PATH_INFO: `/v3/projects/e9e4118fe05f404286349f4101f5ebe1/users/55249cfea5034e48a7b81642373b6b20/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:10.811377 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b7a51a-4f64-45a7-b1ba-1289e835d975 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9e4118fe05f404286349f4101f5ebe1, user_id=55249cfea5034e48a7b81642373b6b20, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:10.814197 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b7a51a-4f64-45a7-b1ba-1289e835d975 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:10.827677 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1304/2608] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:44:10 2022] PUT /identity/v3/projects/e9e4118fe05f404286349f4101f5ebe1/users/55249cfea5034e48a7b81642373b6b20/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:10.838512 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc2ae4-e384-4db4-958a-40202653dc90 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:10.838806 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc2ae4-e384-4db4-958a-40202653dc90 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:10.839091 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc2ae4-e384-4db4-958a-40202653dc90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:10.871735 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-61bc2ae4-e384-4db4-958a-40202653dc90 None None] MFA Rules not processed for user `55249cfea5034e48a7b81642373b6b20`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:10.873273 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-61bc2ae4-e384-4db4-958a-40202653dc90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:10.942850 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1305/2609] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:44:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:10.955223 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7a51a-4f64-45a7-b1ba-1289e835d975 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:10.957434 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-90b7a51a-4f64-45a7-b1ba-1289e835d975 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:11.046189 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7a51a-4f64-45a7-b1ba-1289e835d975 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:11.052195 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44838ff7-39f9-489a-8e2c-467376f1e39e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536f68ff77794352adf41aaacdc0645c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:11.052858 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44838ff7-39f9-489a-8e2c-467376f1e39e service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:11.053193 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44838ff7-39f9-489a-8e2c-467376f1e39e service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:11.053426 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44838ff7-39f9-489a-8e2c-467376f1e39e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:11.062421 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44838ff7-39f9-489a-8e2c-467376f1e39e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:11.064094 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44838ff7-39f9-489a-8e2c-467376f1e39e service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:11.080897 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1305/2610] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:44:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:44:11.351452 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bc2ae4-e384-4db4-958a-40202653dc90 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:11.425420 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bc2ae4-e384-4db4-958a-40202653dc90 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:11.430567 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd710e9-57f3-4930-9a58-769e4d7975a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:11.431450 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd710e9-57f3-4930-9a58-769e4d7975a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:11.431730 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd710e9-57f3-4930-9a58-769e4d7975a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:11.432002 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd710e9-57f3-4930-9a58-769e4d7975a3 admin admin] PATH_INFO: `/v3/users/55249cfea5034e48a7b81642373b6b20` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:11.433250 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd710e9-57f3-4930-9a58-769e4d7975a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55249cfea5034e48a7b81642373b6b20)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:11.435197 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd710e9-57f3-4930-9a58-769e4d7975a3 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:11.483037 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:11.516936 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9bd710e9-57f3-4930-9a58-769e4d7975a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55249cfea5034e48a7b81642373b6b20'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:11.527601 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9bd710e9-57f3-4930-9a58-769e4d7975a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55249cfea5034e48a7b81642373b6b20'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:11.528479 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9bd710e9-57f3-4930-9a58-769e4d7975a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55249cfea5034e48a7b81642373b6b20'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:11.529636 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9bd710e9-57f3-4930-9a58-769e4d7975a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55249cfea5034e48a7b81642373b6b20'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:11.540264 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9bd710e9-57f3-4930-9a58-769e4d7975a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55249cfea5034e48a7b81642373b6b20'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:11.560443 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1306/2611] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:44:11 2022] DELETE /identity/v3/users/55249cfea5034e48a7b81642373b6b20 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:11.565760 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df3d31-ff9b-4bd1-a3bb-09995bd0e430 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:11.566268 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df3d31-ff9b-4bd1-a3bb-09995bd0e430 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:11.566520 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df3d31-ff9b-4bd1-a3bb-09995bd0e430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:11.584275 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-04df3d31-ff9b-4bd1-a3bb-09995bd0e430 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:11.585510 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-04df3d31-ff9b-4bd1-a3bb-09995bd0e430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:11.655656 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1306/2612] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:44:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:11.665945 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd710e9-57f3-4930-9a58-769e4d7975a3 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:11.667383 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9bd710e9-57f3-4930-9a58-769e4d7975a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:11.734975 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd710e9-57f3-4930-9a58-769e4d7975a3 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:11.739243 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d583ce-4d11-4b1a-9e91-6cbce55345ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:11.739895 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d583ce-4d11-4b1a-9e91-6cbce55345ce service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:11.740181 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d583ce-4d11-4b1a-9e91-6cbce55345ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:11.740460 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d583ce-4d11-4b1a-9e91-6cbce55345ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:11.750501 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d583ce-4d11-4b1a-9e91-6cbce55345ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:11.752552 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d583ce-4d11-4b1a-9e91-6cbce55345ce service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:11.763048 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1307/2613] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:44:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:44:12.046595 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df3d31-ff9b-4bd1-a3bb-09995bd0e430 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:12.048412 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-04df3d31-ff9b-4bd1-a3bb-09995bd0e430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:12.080922 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df3d31-ff9b-4bd1-a3bb-09995bd0e430 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:12.087059 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da715fcd-57b8-41ff-8975-ccad332478ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:12.087967 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da715fcd-57b8-41ff-8975-ccad332478ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:12.088254 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da715fcd-57b8-41ff-8975-ccad332478ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:12.088608 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da715fcd-57b8-41ff-8975-ccad332478ac admin admin] PATH_INFO: `/v3/projects/e9e4118fe05f404286349f4101f5ebe1` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:12.089850 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da715fcd-57b8-41ff-8975-ccad332478ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9e4118fe05f404286349f4101f5ebe1)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:12.091952 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da715fcd-57b8-41ff-8975-ccad332478ac admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:12.105391 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:12.155040 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-da715fcd-57b8-41ff-8975-ccad332478ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9e4118fe05f404286349f4101f5ebe1', 'request_id': 'req-da715fcd-57b8-41ff-8975-ccad332478ac'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:12.164484 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-da715fcd-57b8-41ff-8975-ccad332478ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9e4118fe05f404286349f4101f5ebe1', 'request_id': 'req-da715fcd-57b8-41ff-8975-ccad332478ac'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:12.171142 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-da715fcd-57b8-41ff-8975-ccad332478ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9e4118fe05f404286349f4101f5ebe1', 'request_id': 'req-da715fcd-57b8-41ff-8975-ccad332478ac'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:12.182237 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-da715fcd-57b8-41ff-8975-ccad332478ac admin admin] The token cache is being invalidate because project e9e4118fe05f404286349f4101f5ebe1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:44:12.182525 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-da715fcd-57b8-41ff-8975-ccad332478ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:12.183173 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-da715fcd-57b8-41ff-8975-ccad332478ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:12.184758 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1307/2614] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:44:12 2022] DELETE /identity/v3/projects/e9e4118fe05f404286349f4101f5ebe1 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:12.189841 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b055b-c4e9-44bb-8428-d4edc653725f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:12.190439 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b055b-c4e9-44bb-8428-d4edc653725f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:12.190439 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b055b-c4e9-44bb-8428-d4edc653725f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:12.210361 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d44b055b-c4e9-44bb-8428-d4edc653725f None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:12.211571 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d44b055b-c4e9-44bb-8428-d4edc653725f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:12.274011 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1308/2615] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:44:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:12.281825 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d6e6b-f9af-4b40-8a32-1b06b2ee5aa2 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:12.282117 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d6e6b-f9af-4b40-8a32-1b06b2ee5aa2 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:12.282396 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d6e6b-f9af-4b40-8a32-1b06b2ee5aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:12.301912 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-180d6e6b-f9af-4b40-8a32-1b06b2ee5aa2 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:12.303046 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-180d6e6b-f9af-4b40-8a32-1b06b2ee5aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:12.311319 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1308/2616] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:44:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:12.316351 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44b055b-c4e9-44bb-8428-d4edc653725f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:12.329367 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44b055b-c4e9-44bb-8428-d4edc653725f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:12.334616 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3007e0-6bc1-427d-924b-ccfe20c145c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:12.335301 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3007e0-6bc1-427d-924b-ccfe20c145c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:12.335679 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3007e0-6bc1-427d-924b-ccfe20c145c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:12.335963 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3007e0-6bc1-427d-924b-ccfe20c145c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:12.336825 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3007e0-6bc1-427d-924b-ccfe20c145c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:44:12.337166 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3007e0-6bc1-427d-924b-ccfe20c145c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:12.339012 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3007e0-6bc1-427d-924b-ccfe20c145c9 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:12.352778 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1309/2617] 10.222.0.16 () {58 vars in 1152 bytes} [Thu May 26 12:44:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:44:12.357127 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d6e6b-f9af-4b40-8a32-1b06b2ee5aa2 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:12.367331 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d6e6b-f9af-4b40-8a32-1b06b2ee5aa2 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:12.371991 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9add7a-8278-4b51-96ad-cb70c1b1890b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:12.372659 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9add7a-8278-4b51-96ad-cb70c1b1890b admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:12.373227 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9add7a-8278-4b51-96ad-cb70c1b1890b admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:12.373501 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9add7a-8278-4b51-96ad-cb70c1b1890b admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:12.374184 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9add7a-8278-4b51-96ad-cb70c1b1890b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:12.376080 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9add7a-8278-4b51-96ad-cb70c1b1890b admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:12.403283 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1309/2618] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:44:12 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:44:12.407627 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3007e0-6bc1-427d-924b-ccfe20c145c9 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:12.417786 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3007e0-6bc1-427d-924b-ccfe20c145c9 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:12.451283 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:12.477848 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c62e37-46bc-42f2-8be7-50c69a682d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:12.478523 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c62e37-46bc-42f2-8be7-50c69a682d12 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:12.478839 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c62e37-46bc-42f2-8be7-50c69a682d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:12.479120 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c62e37-46bc-42f2-8be7-50c69a682d12 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:12.479813 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c62e37-46bc-42f2-8be7-50c69a682d12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:12.482120 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c62e37-46bc-42f2-8be7-50c69a682d12 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:12.507896 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1310/2619] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:44:12 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:44:12.509565 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9add7a-8278-4b51-96ad-cb70c1b1890b admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:12.549200 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9add7a-8278-4b51-96ad-cb70c1b1890b admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:12.554509 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9a77e-0ccd-44f5-9daf-34b2884c8879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:12.555115 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9a77e-0ccd-44f5-9daf-34b2884c8879 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:12.555401 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9a77e-0ccd-44f5-9daf-34b2884c8879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:12.555681 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9a77e-0ccd-44f5-9daf-34b2884c8879 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:12.556414 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f9a77e-0ccd-44f5-9daf-34b2884c8879 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:12.558136 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f9a77e-0ccd-44f5-9daf-34b2884c8879 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:12.570523 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1310/2620] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:44:12 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:44:12.574303 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c62e37-46bc-42f2-8be7-50c69a682d12 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:12.585653 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c62e37-46bc-42f2-8be7-50c69a682d12 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:12.590477 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2064af0-aaaf-468c-89d0-6f6ed21503ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:12.591152 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2064af0-aaaf-468c-89d0-6f6ed21503ca admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:12.591452 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2064af0-aaaf-468c-89d0-6f6ed21503ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:12.591717 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2064af0-aaaf-468c-89d0-6f6ed21503ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:12.592458 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2064af0-aaaf-468c-89d0-6f6ed21503ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:12.594131 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2064af0-aaaf-468c-89d0-6f6ed21503ca admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:12.605761 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1311/2621] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:44:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:44:12.610179 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9a77e-0ccd-44f5-9daf-34b2884c8879 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:12.621042 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9a77e-0ccd-44f5-9daf-34b2884c8879 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:12.627061 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de7717f-177f-4ab4-9c53-812b8c97faaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:12.627950 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de7717f-177f-4ab4-9c53-812b8c97faaa admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:12.628237 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de7717f-177f-4ab4-9c53-812b8c97faaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:12.628516 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de7717f-177f-4ab4-9c53-812b8c97faaa admin admin] PATH_INFO: `/v3/projects/94cd8b2a5d7d4b809566eb73e3ee1e3d/users/6dc9b8892dd64d3e90eca38e81ef0811/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:12.644625 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de7717f-177f-4ab4-9c53-812b8c97faaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=94cd8b2a5d7d4b809566eb73e3ee1e3d, user_id=6dc9b8892dd64d3e90eca38e81ef0811, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:12.647327 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de7717f-177f-4ab4-9c53-812b8c97faaa admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:12.663767 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1311/2622] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:44:12 2022] PUT /identity/v3/projects/94cd8b2a5d7d4b809566eb73e3ee1e3d/users/6dc9b8892dd64d3e90eca38e81ef0811/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:12.676169 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c851c-098f-468d-bd11-dbf57334ad4c None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:12.676459 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c851c-098f-468d-bd11-dbf57334ad4c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:12.676740 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c851c-098f-468d-bd11-dbf57334ad4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:12.705794 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-2b4c851c-098f-468d-bd11-dbf57334ad4c None None] MFA Rules not processed for user `6dc9b8892dd64d3e90eca38e81ef0811`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:12.707037 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2b4c851c-098f-468d-bd11-dbf57334ad4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:12.811960 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1312/2623] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:44:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:12.812285 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de7717f-177f-4ab4-9c53-812b8c97faaa admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:12.879995 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de7717f-177f-4ab4-9c53-812b8c97faaa admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:12.885692 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df9872-7fc8-4a8b-9357-24c1a8a46bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:12.886363 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df9872-7fc8-4a8b-9357-24c1a8a46bb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:12.886650 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df9872-7fc8-4a8b-9357-24c1a8a46bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:12.886929 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df9872-7fc8-4a8b-9357-24c1a8a46bb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:12.887623 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82df9872-7fc8-4a8b-9357-24c1a8a46bb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:12.889580 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82df9872-7fc8-4a8b-9357-24c1a8a46bb5 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:12.916647 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1312/2624] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:44:12 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:44:12.920544 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c851c-098f-468d-bd11-dbf57334ad4c None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:12.931977 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c851c-098f-468d-bd11-dbf57334ad4c None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:12.990045 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db907303-5904-475d-b558-db791fadaed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:12.990732 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db907303-5904-475d-b558-db791fadaed3 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:12.991020 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db907303-5904-475d-b558-db791fadaed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:12.991297 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db907303-5904-475d-b558-db791fadaed3 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:12.992000 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db907303-5904-475d-b558-db791fadaed3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:12.994013 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db907303-5904-475d-b558-db791fadaed3 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:13.015165 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1313/2625] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:44:12 2022] POST /identity/v3/users => generated 299 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:44:13.019543 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df9872-7fc8-4a8b-9357-24c1a8a46bb5 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:13.030009 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df9872-7fc8-4a8b-9357-24c1a8a46bb5 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:13.035555 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61abd6fb-bcc1-4a1f-a856-121374d9b7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:13.036224 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61abd6fb-bcc1-4a1f-a856-121374d9b7f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:13.036504 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61abd6fb-bcc1-4a1f-a856-121374d9b7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:13.036775 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61abd6fb-bcc1-4a1f-a856-121374d9b7f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:13.037537 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61abd6fb-bcc1-4a1f-a856-121374d9b7f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:13.039146 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61abd6fb-bcc1-4a1f-a856-121374d9b7f1 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:13.050835 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1313/2626] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:44:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:44:13.055092 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db907303-5904-475d-b558-db791fadaed3 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:13.065975 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db907303-5904-475d-b558-db791fadaed3 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:13.070818 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a62c089-9fb2-42e6-91c5-87c919617ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:13.071716 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62c089-9fb2-42e6-91c5-87c919617ec8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:13.072133 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62c089-9fb2-42e6-91c5-87c919617ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:13.072417 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62c089-9fb2-42e6-91c5-87c919617ec8 admin admin] PATH_INFO: `/v3/projects/76176094f14c42289ddfeb13f6362e35/users/10e4b3e5b74644f9bd2f918db5edff5c/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:13.087658 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a62c089-9fb2-42e6-91c5-87c919617ec8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76176094f14c42289ddfeb13f6362e35, user_id=10e4b3e5b74644f9bd2f918db5edff5c, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:13.090524 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a62c089-9fb2-42e6-91c5-87c919617ec8 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:13.104184 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1314/2627] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:44:13 2022] PUT /identity/v3/projects/76176094f14c42289ddfeb13f6362e35/users/10e4b3e5b74644f9bd2f918db5edff5c/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:13.108198 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61abd6fb-bcc1-4a1f-a856-121374d9b7f1 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:13.119602 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61abd6fb-bcc1-4a1f-a856-121374d9b7f1 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:13.124973 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:13.181213 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb11f41e-bd4d-4066-805b-22bf308d3271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:13.181883 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11f41e-bd4d-4066-805b-22bf308d3271 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:13.182165 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11f41e-bd4d-4066-805b-22bf308d3271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:13.182460 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11f41e-bd4d-4066-805b-22bf308d3271 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:13.183164 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb11f41e-bd4d-4066-805b-22bf308d3271 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:13.184755 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb11f41e-bd4d-4066-805b-22bf308d3271 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:13.195721 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1314/2628] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:44:13 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:44:13.200669 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a62c089-9fb2-42e6-91c5-87c919617ec8 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:13.213507 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a62c089-9fb2-42e6-91c5-87c919617ec8 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:13.218945 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d5c3c8-164b-4e2d-857b-741302afbdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:13.220996 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5c3c8-164b-4e2d-857b-741302afbdec admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:13.221282 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5c3c8-164b-4e2d-857b-741302afbdec admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:13.221557 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5c3c8-164b-4e2d-857b-741302afbdec admin admin] PATH_INFO: `/v3/projects/76176094f14c42289ddfeb13f6362e35/users/10e4b3e5b74644f9bd2f918db5edff5c/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:13.223626 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d5c3c8-164b-4e2d-857b-741302afbdec admin admin] RBAC: Authorizing `identity:create_grant(project_id=76176094f14c42289ddfeb13f6362e35, user_id=10e4b3e5b74644f9bd2f918db5edff5c, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:13.226341 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d5c3c8-164b-4e2d-857b-741302afbdec admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:13.229815 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:13.238667 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1315/2629] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:44:13 2022] PUT /identity/v3/projects/76176094f14c42289ddfeb13f6362e35/users/10e4b3e5b74644f9bd2f918db5edff5c/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:13.249335 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016b906-7ce7-49b5-98d1-56258470b13d None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:13.249627 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016b906-7ce7-49b5-98d1-56258470b13d None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:13.249899 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016b906-7ce7-49b5-98d1-56258470b13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:13.279123 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-b016b906-7ce7-49b5-98d1-56258470b13d None None] MFA Rules not processed for user `10e4b3e5b74644f9bd2f918db5edff5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:13.280411 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-b016b906-7ce7-49b5-98d1-56258470b13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:13.351235 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1315/2630] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:44:13 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:13.362942 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d5c3c8-164b-4e2d-857b-741302afbdec admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:13.364727 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-77d5c3c8-164b-4e2d-857b-741302afbdec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:13.426340 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d5c3c8-164b-4e2d-857b-741302afbdec admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:13.430548 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739466b4-a76c-42b8-9188-dc90f896acdb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:13.431202 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739466b4-a76c-42b8-9188-dc90f896acdb service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:13.431530 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739466b4-a76c-42b8-9188-dc90f896acdb service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:13.431805 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739466b4-a76c-42b8-9188-dc90f896acdb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:13.441912 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739466b4-a76c-42b8-9188-dc90f896acdb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:13.443390 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739466b4-a76c-42b8-9188-dc90f896acdb service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:13.453001 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1316/2631] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:44:13 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:44:13.482338 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b016b906-7ce7-49b5-98d1-56258470b13d None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:13.553969 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b016b906-7ce7-49b5-98d1-56258470b13d None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:13.559631 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad73fd42-d7d7-4d76-846d-c6a34e68d9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:13.560549 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73fd42-d7d7-4d76-846d-c6a34e68d9d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:13.560874 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73fd42-d7d7-4d76-846d-c6a34e68d9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:13.561138 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73fd42-d7d7-4d76-846d-c6a34e68d9d7 admin admin] PATH_INFO: `/v3/users/6dc9b8892dd64d3e90eca38e81ef0811` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:13.562450 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad73fd42-d7d7-4d76-846d-c6a34e68d9d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dc9b8892dd64d3e90eca38e81ef0811)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:13.564512 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad73fd42-d7d7-4d76-846d-c6a34e68d9d7 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:13.601035 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:13.615398 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-ad73fd42-d7d7-4d76-846d-c6a34e68d9d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dc9b8892dd64d3e90eca38e81ef0811'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:13.616012 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-ad73fd42-d7d7-4d76-846d-c6a34e68d9d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dc9b8892dd64d3e90eca38e81ef0811'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:13.616621 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-ad73fd42-d7d7-4d76-846d-c6a34e68d9d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dc9b8892dd64d3e90eca38e81ef0811'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:13.625235 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-ad73fd42-d7d7-4d76-846d-c6a34e68d9d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dc9b8892dd64d3e90eca38e81ef0811'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:13.638617 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-ad73fd42-d7d7-4d76-846d-c6a34e68d9d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dc9b8892dd64d3e90eca38e81ef0811'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:13.650993 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1316/2632] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:44:13 2022] DELETE /identity/v3/users/6dc9b8892dd64d3e90eca38e81ef0811 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:13.655533 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21348a03-5b59-4fd5-998b-773033ad6c45 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:13.655825 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21348a03-5b59-4fd5-998b-773033ad6c45 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:13.656106 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21348a03-5b59-4fd5-998b-773033ad6c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:13.675660 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-21348a03-5b59-4fd5-998b-773033ad6c45 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:13.676929 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-21348a03-5b59-4fd5-998b-773033ad6c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:13.736118 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1317/2633] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:44:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:13.746087 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad73fd42-d7d7-4d76-846d-c6a34e68d9d7 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:13.748301 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-ad73fd42-d7d7-4d76-846d-c6a34e68d9d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:13.819775 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad73fd42-d7d7-4d76-846d-c6a34e68d9d7 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:13.823537 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b08bdb-2828-4d80-acf8-63da3504f995 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:13.824184 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b08bdb-2828-4d80-acf8-63da3504f995 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:13.824465 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b08bdb-2828-4d80-acf8-63da3504f995 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:13.824741 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b08bdb-2828-4d80-acf8-63da3504f995 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:13.835446 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b08bdb-2828-4d80-acf8-63da3504f995 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:13.837130 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b08bdb-2828-4d80-acf8-63da3504f995 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:13.848489 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1317/2634] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:44:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:44:14.155347 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21348a03-5b59-4fd5-998b-773033ad6c45 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:14.157197 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-21348a03-5b59-4fd5-998b-773033ad6c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:14.173672 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21348a03-5b59-4fd5-998b-773033ad6c45 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:14.179167 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2404f3-48bb-47b7-902c-9c4efe2e82d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:14.180049 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2404f3-48bb-47b7-902c-9c4efe2e82d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:14.180331 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2404f3-48bb-47b7-902c-9c4efe2e82d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:14.180636 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2404f3-48bb-47b7-902c-9c4efe2e82d0 admin admin] PATH_INFO: `/v3/projects/94cd8b2a5d7d4b809566eb73e3ee1e3d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:14.181943 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2404f3-48bb-47b7-902c-9c4efe2e82d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94cd8b2a5d7d4b809566eb73e3ee1e3d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:14.183909 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2404f3-48bb-47b7-902c-9c4efe2e82d0 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:14.232584 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5d2404f3-48bb-47b7-902c-9c4efe2e82d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94cd8b2a5d7d4b809566eb73e3ee1e3d', 'request_id': 'req-5d2404f3-48bb-47b7-902c-9c4efe2e82d0'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:14.238686 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5d2404f3-48bb-47b7-902c-9c4efe2e82d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94cd8b2a5d7d4b809566eb73e3ee1e3d', 'request_id': 'req-5d2404f3-48bb-47b7-902c-9c4efe2e82d0'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:14.244938 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5d2404f3-48bb-47b7-902c-9c4efe2e82d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94cd8b2a5d7d4b809566eb73e3ee1e3d', 'request_id': 'req-5d2404f3-48bb-47b7-902c-9c4efe2e82d0'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:14.259344 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5d2404f3-48bb-47b7-902c-9c4efe2e82d0 admin admin] The token cache is being invalidate because project 94cd8b2a5d7d4b809566eb73e3ee1e3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:44:14.259639 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5d2404f3-48bb-47b7-902c-9c4efe2e82d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:14.260288 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5d2404f3-48bb-47b7-902c-9c4efe2e82d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:14.261887 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1318/2635] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:44:14 2022] DELETE /identity/v3/projects/94cd8b2a5d7d4b809566eb73e3ee1e3d => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:14.265939 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b08bdb-2828-4d80-acf8-63da3504f995 service neutron] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:14.275775 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b08bdb-2828-4d80-acf8-63da3504f995 service neutron] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:14.340793 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f394c0ed-7df8-4453-a3fe-36cae9cde657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:14.341717 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394c0ed-7df8-4453-a3fe-36cae9cde657 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:14.342001 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394c0ed-7df8-4453-a3fe-36cae9cde657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:14.342313 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394c0ed-7df8-4453-a3fe-36cae9cde657 admin admin] PATH_INFO: `/v3/users/10e4b3e5b74644f9bd2f918db5edff5c` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:14.343680 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f394c0ed-7df8-4453-a3fe-36cae9cde657 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10e4b3e5b74644f9bd2f918db5edff5c)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:14.346202 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f394c0ed-7df8-4453-a3fe-36cae9cde657 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:14.398175 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-f394c0ed-7df8-4453-a3fe-36cae9cde657 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10e4b3e5b74644f9bd2f918db5edff5c'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:14.398936 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-f394c0ed-7df8-4453-a3fe-36cae9cde657 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10e4b3e5b74644f9bd2f918db5edff5c'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:14.399570 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-f394c0ed-7df8-4453-a3fe-36cae9cde657 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10e4b3e5b74644f9bd2f918db5edff5c'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:14.412031 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-f394c0ed-7df8-4453-a3fe-36cae9cde657 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10e4b3e5b74644f9bd2f918db5edff5c'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:14.413999 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:14.432814 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-f394c0ed-7df8-4453-a3fe-36cae9cde657 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10e4b3e5b74644f9bd2f918db5edff5c'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:14.448257 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1318/2636] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:44:14 2022] DELETE /identity/v3/users/10e4b3e5b74644f9bd2f918db5edff5c => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:44:14.781984 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2404f3-48bb-47b7-902c-9c4efe2e82d0 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:14.784291 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5d2404f3-48bb-47b7-902c-9c4efe2e82d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:14.804981 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2404f3-48bb-47b7-902c-9c4efe2e82d0 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:14.827950 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:14.869530 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0c7d8-b852-47fd-b05c-f4a9411967af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:14.870403 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0c7d8-b852-47fd-b05c-f4a9411967af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:14.870686 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0c7d8-b852-47fd-b05c-f4a9411967af admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:14.870962 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0c7d8-b852-47fd-b05c-f4a9411967af admin admin] PATH_INFO: `/v3/projects/76176094f14c42289ddfeb13f6362e35` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:14.872142 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba0c7d8-b852-47fd-b05c-f4a9411967af admin admin] RBAC: Authorizing `identity:delete_project(project_id=76176094f14c42289ddfeb13f6362e35)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:14.874369 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba0c7d8-b852-47fd-b05c-f4a9411967af admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:14.922238 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3ba0c7d8-b852-47fd-b05c-f4a9411967af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76176094f14c42289ddfeb13f6362e35', 'request_id': 'req-3ba0c7d8-b852-47fd-b05c-f4a9411967af'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:14.927672 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3ba0c7d8-b852-47fd-b05c-f4a9411967af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76176094f14c42289ddfeb13f6362e35', 'request_id': 'req-3ba0c7d8-b852-47fd-b05c-f4a9411967af'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:14.933902 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3ba0c7d8-b852-47fd-b05c-f4a9411967af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76176094f14c42289ddfeb13f6362e35', 'request_id': 'req-3ba0c7d8-b852-47fd-b05c-f4a9411967af'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:14.946433 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3ba0c7d8-b852-47fd-b05c-f4a9411967af admin admin] The token cache is being invalidate because project 76176094f14c42289ddfeb13f6362e35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:44:14.946725 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3ba0c7d8-b852-47fd-b05c-f4a9411967af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:14.947375 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3ba0c7d8-b852-47fd-b05c-f4a9411967af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:14.948956 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1319/2637] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:44:14 2022] DELETE /identity/v3/projects/76176094f14c42289ddfeb13f6362e35 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:14.953895 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab969f35-c805-40eb-a723-eba065d2c14f None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:14.954962 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab969f35-c805-40eb-a723-eba065d2c14f None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:14.955303 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab969f35-c805-40eb-a723-eba065d2c14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:14.973866 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-ab969f35-c805-40eb-a723-eba065d2c14f None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:14.975082 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-ab969f35-c805-40eb-a723-eba065d2c14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:15.034899 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1319/2638] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:44:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:44:15.042958 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5682e18-b668-4899-b07f-7fb0b5f9de80 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:15.043166 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5682e18-b668-4899-b07f-7fb0b5f9de80 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:15.043450 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5682e18-b668-4899-b07f-7fb0b5f9de80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:15.063204 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c5682e18-b668-4899-b07f-7fb0b5f9de80 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:15.065006 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c5682e18-b668-4899-b07f-7fb0b5f9de80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:15.074141 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1320/2639] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:44:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:15.080213 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab969f35-c805-40eb-a723-eba065d2c14f None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:15.090816 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab969f35-c805-40eb-a723-eba065d2c14f None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:15.096164 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df12289-43d1-43f2-84c4-d9d04f5d5081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:15.096930 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df12289-43d1-43f2-84c4-d9d04f5d5081 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:15.097294 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df12289-43d1-43f2-84c4-d9d04f5d5081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:15.097573 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df12289-43d1-43f2-84c4-d9d04f5d5081 admin admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:15.098311 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df12289-43d1-43f2-84c4-d9d04f5d5081 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:44:15.098621 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df12289-43d1-43f2-84c4-d9d04f5d5081 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:15.100468 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df12289-43d1-43f2-84c4-d9d04f5d5081 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:15.115214 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1320/2640] 10.222.0.16 () {58 vars in 1152 bytes} [Thu May 26 12:44:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:44:15.119946 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5682e18-b668-4899-b07f-7fb0b5f9de80 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:15.134891 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5682e18-b668-4899-b07f-7fb0b5f9de80 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:15.141436 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e715666c-922a-4b21-bc8a-114f605b3992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:15.142715 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715666c-922a-4b21-bc8a-114f605b3992 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:15.143078 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715666c-922a-4b21-bc8a-114f605b3992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:15.143367 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715666c-922a-4b21-bc8a-114f605b3992 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:15.144328 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e715666c-922a-4b21-bc8a-114f605b3992 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:15.146170 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e715666c-922a-4b21-bc8a-114f605b3992 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:15.178374 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1321/2641] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:44:15 2022] POST /identity/v3/projects => generated 387 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:44:15.183317 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df12289-43d1-43f2-84c4-d9d04f5d5081 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:15.194894 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df12289-43d1-43f2-84c4-d9d04f5d5081 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:15.270165 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1528bb9-b829-40c1-b909-36cfcff92d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:15.270863 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1528bb9-b829-40c1-b909-36cfcff92d72 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:15.271128 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1528bb9-b829-40c1-b909-36cfcff92d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:15.271408 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1528bb9-b829-40c1-b909-36cfcff92d72 admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:15.272096 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1528bb9-b829-40c1-b909-36cfcff92d72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:15.274613 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1528bb9-b829-40c1-b909-36cfcff92d72 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:15.297898 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1321/2642] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:44:15 2022] POST /identity/v3/users => generated 294 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:44:15.302754 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e715666c-922a-4b21-bc8a-114f605b3992 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:15.314887 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e715666c-922a-4b21-bc8a-114f605b3992 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:15.320383 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b5fdc7-c69f-43b8-be15-06710343afd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:15.321089 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5fdc7-c69f-43b8-be15-06710343afd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:15.321370 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5fdc7-c69f-43b8-be15-06710343afd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:15.321649 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5fdc7-c69f-43b8-be15-06710343afd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:15.322380 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b5fdc7-c69f-43b8-be15-06710343afd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:15.324000 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b5fdc7-c69f-43b8-be15-06710343afd4 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:15.335251 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1322/2643] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:44:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:44:15.339468 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1528bb9-b829-40c1-b909-36cfcff92d72 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:15.351022 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1528bb9-b829-40c1-b909-36cfcff92d72 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:15.357591 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4241347-4aed-49c1-b1aa-cfdfc00b8445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:15.358763 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4241347-4aed-49c1-b1aa-cfdfc00b8445 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:15.359176 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4241347-4aed-49c1-b1aa-cfdfc00b8445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:15.359555 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4241347-4aed-49c1-b1aa-cfdfc00b8445 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:15.360548 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4241347-4aed-49c1-b1aa-cfdfc00b8445 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:15.363062 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4241347-4aed-49c1-b1aa-cfdfc00b8445 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:15.375915 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1322/2644] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:44:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:44:15.380874 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b5fdc7-c69f-43b8-be15-06710343afd4 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:15.393476 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b5fdc7-c69f-43b8-be15-06710343afd4 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:15.400074 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76629e-14d2-473d-b5aa-138bfe2adede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:15.401409 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76629e-14d2-473d-b5aa-138bfe2adede admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:15.403551 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76629e-14d2-473d-b5aa-138bfe2adede admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:15.404169 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76629e-14d2-473d-b5aa-138bfe2adede admin admin] PATH_INFO: `/v3/projects/a609529c21f148f68c6e922d658bcd9d/users/308a51eac971475c9129ed93c1e282e9/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:15.439013 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b76629e-14d2-473d-b5aa-138bfe2adede admin admin] RBAC: Authorizing `identity:create_grant(project_id=a609529c21f148f68c6e922d658bcd9d, user_id=308a51eac971475c9129ed93c1e282e9, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:15.441966 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b76629e-14d2-473d-b5aa-138bfe2adede admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:15.483194 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1323/2645] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:44:15 2022] PUT /identity/v3/projects/a609529c21f148f68c6e922d658bcd9d/users/308a51eac971475c9129ed93c1e282e9/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:15.485615 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489055c4-6f1e-4f74-b34a-65a9e67edd1e None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:15.486104 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489055c4-6f1e-4f74-b34a-65a9e67edd1e None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:15.486618 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489055c4-6f1e-4f74-b34a-65a9e67edd1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:15.519075 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-489055c4-6f1e-4f74-b34a-65a9e67edd1e None None] MFA Rules not processed for user `308a51eac971475c9129ed93c1e282e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:15.520307 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-489055c4-6f1e-4f74-b34a-65a9e67edd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:15.550006 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:15.591843 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1323/2646] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:44:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:44:15.596588 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76629e-14d2-473d-b5aa-138bfe2adede admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:15.665545 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:15.685163 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76629e-14d2-473d-b5aa-138bfe2adede admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:15.693572 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5adec3-5740-4c7e-881f-5ec90a0192fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:15.694644 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5adec3-5740-4c7e-881f-5ec90a0192fc admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:15.695111 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5adec3-5740-4c7e-881f-5ec90a0192fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:15.695599 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5adec3-5740-4c7e-881f-5ec90a0192fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:15.696870 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5adec3-5740-4c7e-881f-5ec90a0192fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:15.700408 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5adec3-5740-4c7e-881f-5ec90a0192fc admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:15.738329 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1324/2647] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:44:15 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:44:15.739714 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489055c4-6f1e-4f74-b34a-65a9e67edd1e None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:15.760975 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489055c4-6f1e-4f74-b34a-65a9e67edd1e None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:15.825351 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1179e5e-a39e-4d9f-bc12-73170925b820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:15.826026 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1179e5e-a39e-4d9f-bc12-73170925b820 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:15.826305 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1179e5e-a39e-4d9f-bc12-73170925b820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:15.826576 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1179e5e-a39e-4d9f-bc12-73170925b820 admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:15.827269 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1179e5e-a39e-4d9f-bc12-73170925b820 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:15.829239 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1179e5e-a39e-4d9f-bc12-73170925b820 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:15.854621 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1324/2648] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:44:15 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:44:15.859172 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5adec3-5740-4c7e-881f-5ec90a0192fc admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:15.874603 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5adec3-5740-4c7e-881f-5ec90a0192fc admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:15.880691 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ffb3f7-bddf-41a2-b9c2-ae04d1d8ad86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:15.881532 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffb3f7-bddf-41a2-b9c2-ae04d1d8ad86 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:15.881811 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffb3f7-bddf-41a2-b9c2-ae04d1d8ad86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:15.882085 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffb3f7-bddf-41a2-b9c2-ae04d1d8ad86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:15.882880 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ffb3f7-bddf-41a2-b9c2-ae04d1d8ad86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:15.884495 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ffb3f7-bddf-41a2-b9c2-ae04d1d8ad86 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:15.899242 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1325/2649] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:44:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:44:15.904139 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1179e5e-a39e-4d9f-bc12-73170925b820 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:15.917571 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1179e5e-a39e-4d9f-bc12-73170925b820 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:15.923192 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a440d8-b82a-4f86-80b7-e4b0160df878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:15.924044 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a440d8-b82a-4f86-80b7-e4b0160df878 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:15.924516 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a440d8-b82a-4f86-80b7-e4b0160df878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:15.925024 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a440d8-b82a-4f86-80b7-e4b0160df878 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:15.926303 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a440d8-b82a-4f86-80b7-e4b0160df878 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:15.928655 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a440d8-b82a-4f86-80b7-e4b0160df878 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:15.941135 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1325/2650] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:44:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:44:15.945375 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ffb3f7-bddf-41a2-b9c2-ae04d1d8ad86 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:15.956497 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ffb3f7-bddf-41a2-b9c2-ae04d1d8ad86 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:15.961628 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8655bc1c-3c36-41e1-b63a-360aa2a7724c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:15.962777 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655bc1c-3c36-41e1-b63a-360aa2a7724c admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:15.963228 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655bc1c-3c36-41e1-b63a-360aa2a7724c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:15.963608 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655bc1c-3c36-41e1-b63a-360aa2a7724c admin admin] PATH_INFO: `/v3/projects/b686e7645e2f4f53965b3ed3d6bcd39b/users/3c7cb8409ac1426e89430a6460dde714/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:15.986747 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8655bc1c-3c36-41e1-b63a-360aa2a7724c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b686e7645e2f4f53965b3ed3d6bcd39b, user_id=3c7cb8409ac1426e89430a6460dde714, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:15.989495 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8655bc1c-3c36-41e1-b63a-360aa2a7724c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:16.007558 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1326/2651] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:44:15 2022] PUT /identity/v3/projects/b686e7645e2f4f53965b3ed3d6bcd39b/users/3c7cb8409ac1426e89430a6460dde714/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:16.023165 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f663f9a-b90c-4e02-81a1-18c515fe7494 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:16.023165 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f663f9a-b90c-4e02-81a1-18c515fe7494 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:16.023165 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f663f9a-b90c-4e02-81a1-18c515fe7494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:16.054457 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-4f663f9a-b90c-4e02-81a1-18c515fe7494 None None] MFA Rules not processed for user `3c7cb8409ac1426e89430a6460dde714`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:16.055791 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-4f663f9a-b90c-4e02-81a1-18c515fe7494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:16.142672 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1326/2652] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:44:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:16.147317 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8655bc1c-3c36-41e1-b63a-360aa2a7724c admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:16.225286 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8655bc1c-3c36-41e1-b63a-360aa2a7724c admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:16.230287 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f81e20-6152-4265-9b5c-7ce3eda06d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:16.230986 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f81e20-6152-4265-9b5c-7ce3eda06d54 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:16.231270 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f81e20-6152-4265-9b5c-7ce3eda06d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:16.231547 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f81e20-6152-4265-9b5c-7ce3eda06d54 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:16.232250 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f81e20-6152-4265-9b5c-7ce3eda06d54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:16.234215 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f81e20-6152-4265-9b5c-7ce3eda06d54 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:16.263134 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1327/2653] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:44:16 2022] POST /identity/v3/projects => generated 387 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:44:16.267837 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f663f9a-b90c-4e02-81a1-18c515fe7494 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:16.278944 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f663f9a-b90c-4e02-81a1-18c515fe7494 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:16.313185 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:16.343024 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d84c7c-6a3d-4fff-9eac-a0227e85f167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:16.343703 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d84c7c-6a3d-4fff-9eac-a0227e85f167 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:16.344069 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d84c7c-6a3d-4fff-9eac-a0227e85f167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:16.344567 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d84c7c-6a3d-4fff-9eac-a0227e85f167 admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:16.345972 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d84c7c-6a3d-4fff-9eac-a0227e85f167 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:16.348186 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d84c7c-6a3d-4fff-9eac-a0227e85f167 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:16.374969 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1327/2654] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:44:16 2022] POST /identity/v3/users => generated 300 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:44:16.377558 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f81e20-6152-4265-9b5c-7ce3eda06d54 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:16.388343 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f81e20-6152-4265-9b5c-7ce3eda06d54 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:16.393549 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ebfb4e-bd47-408b-b7dd-c8e9fe5f3b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:16.394207 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebfb4e-bd47-408b-b7dd-c8e9fe5f3b58 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:16.394486 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebfb4e-bd47-408b-b7dd-c8e9fe5f3b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:16.394757 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebfb4e-bd47-408b-b7dd-c8e9fe5f3b58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:16.395487 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ebfb4e-bd47-408b-b7dd-c8e9fe5f3b58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:16.397162 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ebfb4e-bd47-408b-b7dd-c8e9fe5f3b58 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:16.409883 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1328/2655] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:44:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:44:16.415417 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d84c7c-6a3d-4fff-9eac-a0227e85f167 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:16.433226 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d84c7c-6a3d-4fff-9eac-a0227e85f167 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:16.439715 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922041b2-aabc-4cf6-9a14-9b605bdc7a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:16.439715 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922041b2-aabc-4cf6-9a14-9b605bdc7a20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:16.439715 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922041b2-aabc-4cf6-9a14-9b605bdc7a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:16.439715 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922041b2-aabc-4cf6-9a14-9b605bdc7a20 admin admin] PATH_INFO: `/v3/projects/bf620209ce9349c599e2733d895e366f/users/5253987ac5bd409d9531c04385f1046f/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:16.457468 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922041b2-aabc-4cf6-9a14-9b605bdc7a20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf620209ce9349c599e2733d895e366f, user_id=5253987ac5bd409d9531c04385f1046f, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:16.460144 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922041b2-aabc-4cf6-9a14-9b605bdc7a20 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:16.473682 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1328/2656] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:44:16 2022] PUT /identity/v3/projects/bf620209ce9349c599e2733d895e366f/users/5253987ac5bd409d9531c04385f1046f/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:16.477877 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ebfb4e-bd47-408b-b7dd-c8e9fe5f3b58 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:16.490750 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ebfb4e-bd47-408b-b7dd-c8e9fe5f3b58 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:16.549608 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06616290-721f-44e7-ab1e-71879df8fc2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:16.550268 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06616290-721f-44e7-ab1e-71879df8fc2a admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:16.550549 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06616290-721f-44e7-ab1e-71879df8fc2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:16.550820 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06616290-721f-44e7-ab1e-71879df8fc2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:16.551543 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06616290-721f-44e7-ab1e-71879df8fc2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:16.553202 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06616290-721f-44e7-ab1e-71879df8fc2a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:16.562731 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1329/2657] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:44:16 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:44:16.567099 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922041b2-aabc-4cf6-9a14-9b605bdc7a20 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:16.577452 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922041b2-aabc-4cf6-9a14-9b605bdc7a20 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:16.582066 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4759b6-6cd7-4ad3-9491-2373546b0522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:16.582941 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4759b6-6cd7-4ad3-9491-2373546b0522 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:16.583211 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4759b6-6cd7-4ad3-9491-2373546b0522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:16.583484 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4759b6-6cd7-4ad3-9491-2373546b0522 admin admin] PATH_INFO: `/v3/projects/bf620209ce9349c599e2733d895e366f/users/5253987ac5bd409d9531c04385f1046f/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:16.585501 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4759b6-6cd7-4ad3-9491-2373546b0522 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf620209ce9349c599e2733d895e366f, user_id=5253987ac5bd409d9531c04385f1046f, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:16.588133 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4759b6-6cd7-4ad3-9491-2373546b0522 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:16.598926 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1329/2658] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:44:16 2022] PUT /identity/v3/projects/bf620209ce9349c599e2733d895e366f/users/5253987ac5bd409d9531c04385f1046f/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:16.608990 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09675aae-e287-4de1-929d-0409e269480c None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:16.609279 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09675aae-e287-4de1-929d-0409e269480c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:16.609557 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09675aae-e287-4de1-929d-0409e269480c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:16.628920 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:16.638526 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-09675aae-e287-4de1-929d-0409e269480c None None] MFA Rules not processed for user `5253987ac5bd409d9531c04385f1046f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:16.639727 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-09675aae-e287-4de1-929d-0409e269480c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:16.712887 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1330/2659] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:44:16 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:16.723981 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4759b6-6cd7-4ad3-9491-2373546b0522 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:16.725736 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-3c4759b6-6cd7-4ad3-9491-2373546b0522 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:16.785571 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4759b6-6cd7-4ad3-9491-2373546b0522 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:16.789298 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ebbed-0a8c-4e0a-8f3d-c5a3bcf1f8f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:16.789937 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ebbed-0a8c-4e0a-8f3d-c5a3bcf1f8f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:16.790221 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ebbed-0a8c-4e0a-8f3d-c5a3bcf1f8f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:16.790499 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ebbed-0a8c-4e0a-8f3d-c5a3bcf1f8f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:16.800187 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8ebbed-0a8c-4e0a-8f3d-c5a3bcf1f8f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:16.801645 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8ebbed-0a8c-4e0a-8f3d-c5a3bcf1f8f9 service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:16.811261 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1330/2660] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:44:16 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:44:17.315557 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09675aae-e287-4de1-929d-0409e269480c None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:17.317012 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-09675aae-e287-4de1-929d-0409e269480c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:17.331755 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09675aae-e287-4de1-929d-0409e269480c None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:17.335553 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c50b84b-b9fe-4c97-a351-ebe3025c42e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:17.336219 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c50b84b-b9fe-4c97-a351-ebe3025c42e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:17.336502 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c50b84b-b9fe-4c97-a351-ebe3025c42e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:17.336775 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c50b84b-b9fe-4c97-a351-ebe3025c42e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:17.398094 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c50b84b-b9fe-4c97-a351-ebe3025c42e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:17.399571 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c50b84b-b9fe-4c97-a351-ebe3025c42e1 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:17.408726 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1331/2661] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:44:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:44:22.533653 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ebbed-0a8c-4e0a-8f3d-c5a3bcf1f8f9 service cinder] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:22.542839 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ebbed-0a8c-4e0a-8f3d-c5a3bcf1f8f9 service cinder] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:22.546495 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beccad5-7479-4fb3-a5b5-2bc4e1d0d5d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:22.547129 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beccad5-7479-4fb3-a5b5-2bc4e1d0d5d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:22.547413 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beccad5-7479-4fb3-a5b5-2bc4e1d0d5d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:22.548353 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beccad5-7479-4fb3-a5b5-2bc4e1d0d5d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:22.609607 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beccad5-7479-4fb3-a5b5-2bc4e1d0d5d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:22.611649 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beccad5-7479-4fb3-a5b5-2bc4e1d0d5d5 service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:22.623616 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1331/2662] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:44:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:44:25.013522 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c50b84b-b9fe-4c97-a351-ebe3025c42e1 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:25.106337 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c50b84b-b9fe-4c97-a351-ebe3025c42e1 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:25.112053 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00572c70-c647-4ba6-abf8-2c2594747973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:25.112976 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00572c70-c647-4ba6-abf8-2c2594747973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:25.113264 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00572c70-c647-4ba6-abf8-2c2594747973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:25.113562 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00572c70-c647-4ba6-abf8-2c2594747973 admin admin] PATH_INFO: `/v3/users/308a51eac971475c9129ed93c1e282e9` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:25.114765 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00572c70-c647-4ba6-abf8-2c2594747973 admin admin] RBAC: Authorizing `identity:delete_user(user_id=308a51eac971475c9129ed93c1e282e9)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:25.116749 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00572c70-c647-4ba6-abf8-2c2594747973 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:25.161201 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:25.174357 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-00572c70-c647-4ba6-abf8-2c2594747973 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '308a51eac971475c9129ed93c1e282e9'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:25.182571 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-00572c70-c647-4ba6-abf8-2c2594747973 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '308a51eac971475c9129ed93c1e282e9'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:25.183514 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-00572c70-c647-4ba6-abf8-2c2594747973 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '308a51eac971475c9129ed93c1e282e9'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:25.184122 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-00572c70-c647-4ba6-abf8-2c2594747973 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '308a51eac971475c9129ed93c1e282e9'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:25.191939 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-00572c70-c647-4ba6-abf8-2c2594747973 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '308a51eac971475c9129ed93c1e282e9'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:25.213986 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1332/2663] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:44:25 2022] DELETE /identity/v3/users/308a51eac971475c9129ed93c1e282e9 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:25.218770 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc79e6-ca96-4948-a8ed-b45c54eae77a None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:25.219335 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc79e6-ca96-4948-a8ed-b45c54eae77a None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:25.219970 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc79e6-ca96-4948-a8ed-b45c54eae77a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:25.238908 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-a2bc79e6-ca96-4948-a8ed-b45c54eae77a None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:25.240128 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-a2bc79e6-ca96-4948-a8ed-b45c54eae77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:25.266511 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:25.308687 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1332/2664] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:44:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:44:25.319443 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00572c70-c647-4ba6-abf8-2c2594747973 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:25.321173 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-00572c70-c647-4ba6-abf8-2c2594747973 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:25.401305 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00572c70-c647-4ba6-abf8-2c2594747973 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:25.401305 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63720e8b-7ab1-40b2-bcd4-94b6e9431eb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:25.401305 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63720e8b-7ab1-40b2-bcd4-94b6e9431eb4 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:25.401305 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63720e8b-7ab1-40b2-bcd4-94b6e9431eb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:25.401707 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63720e8b-7ab1-40b2-bcd4-94b6e9431eb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:25.411915 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63720e8b-7ab1-40b2-bcd4-94b6e9431eb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:25.413520 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63720e8b-7ab1-40b2-bcd4-94b6e9431eb4 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:25.427519 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1333/2665] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:44:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:44:25.725716 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc79e6-ca96-4948-a8ed-b45c54eae77a None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:25.727132 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-a2bc79e6-ca96-4948-a8ed-b45c54eae77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:25.742123 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc79e6-ca96-4948-a8ed-b45c54eae77a None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:25.750294 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3545225-84b0-4767-bc61-a31369c7ccb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:25.751332 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3545225-84b0-4767-bc61-a31369c7ccb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:25.751993 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3545225-84b0-4767-bc61-a31369c7ccb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:25.752366 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3545225-84b0-4767-bc61-a31369c7ccb4 admin admin] PATH_INFO: `/v3/projects/a609529c21f148f68c6e922d658bcd9d` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:25.761956 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3545225-84b0-4767-bc61-a31369c7ccb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a609529c21f148f68c6e922d658bcd9d)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:25.764185 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3545225-84b0-4767-bc61-a31369c7ccb4 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:25.816649 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-a3545225-84b0-4767-bc61-a31369c7ccb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a609529c21f148f68c6e922d658bcd9d', 'request_id': 'req-a3545225-84b0-4767-bc61-a31369c7ccb4'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:25.824481 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-a3545225-84b0-4767-bc61-a31369c7ccb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a609529c21f148f68c6e922d658bcd9d', 'request_id': 'req-a3545225-84b0-4767-bc61-a31369c7ccb4'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:25.831372 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-a3545225-84b0-4767-bc61-a31369c7ccb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a609529c21f148f68c6e922d658bcd9d', 'request_id': 'req-a3545225-84b0-4767-bc61-a31369c7ccb4'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:25.842700 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-a3545225-84b0-4767-bc61-a31369c7ccb4 admin admin] The token cache is being invalidate because project a609529c21f148f68c6e922d658bcd9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:44:25.843057 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-a3545225-84b0-4767-bc61-a31369c7ccb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:25.843965 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-a3545225-84b0-4767-bc61-a31369c7ccb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:25.846187 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1333/2666] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:44:25 2022] DELETE /identity/v3/projects/a609529c21f148f68c6e922d658bcd9d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:44:25.850893 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63720e8b-7ab1-40b2-bcd4-94b6e9431eb4 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:25.861403 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63720e8b-7ab1-40b2-bcd4-94b6e9431eb4 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:25.929305 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bcc0bf-9994-4406-b086-8ccf75fcc157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:25.930211 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bcc0bf-9994-4406-b086-8ccf75fcc157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:25.930498 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bcc0bf-9994-4406-b086-8ccf75fcc157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:25.930773 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bcc0bf-9994-4406-b086-8ccf75fcc157 admin admin] PATH_INFO: `/v3/users/3c7cb8409ac1426e89430a6460dde714` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:25.931994 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bcc0bf-9994-4406-b086-8ccf75fcc157 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c7cb8409ac1426e89430a6460dde714)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:25.934005 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bcc0bf-9994-4406-b086-8ccf75fcc157 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:25.981109 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e6bcc0bf-9994-4406-b086-8ccf75fcc157 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c7cb8409ac1426e89430a6460dde714'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:25.989128 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e6bcc0bf-9994-4406-b086-8ccf75fcc157 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c7cb8409ac1426e89430a6460dde714'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:25.989735 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e6bcc0bf-9994-4406-b086-8ccf75fcc157 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c7cb8409ac1426e89430a6460dde714'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:25.990353 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e6bcc0bf-9994-4406-b086-8ccf75fcc157 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c7cb8409ac1426e89430a6460dde714'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:25.992450 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:25.999147 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e6bcc0bf-9994-4406-b086-8ccf75fcc157 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c7cb8409ac1426e89430a6460dde714'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:26.018357 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1334/2667] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:44:25 2022] DELETE /identity/v3/users/3c7cb8409ac1426e89430a6460dde714 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:26.300011 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3545225-84b0-4767-bc61-a31369c7ccb4 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:26.301664 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-a3545225-84b0-4767-bc61-a31369c7ccb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:26.315601 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3545225-84b0-4767-bc61-a31369c7ccb4 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:26.379294 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76fa32-cf1a-4b8f-914d-ec997333b32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:26.380068 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76fa32-cf1a-4b8f-914d-ec997333b32d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:26.380353 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76fa32-cf1a-4b8f-914d-ec997333b32d admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:26.380627 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76fa32-cf1a-4b8f-914d-ec997333b32d admin admin] PATH_INFO: `/v3/projects/b686e7645e2f4f53965b3ed3d6bcd39b` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:26.381854 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a76fa32-cf1a-4b8f-914d-ec997333b32d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b686e7645e2f4f53965b3ed3d6bcd39b)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:26.383862 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a76fa32-cf1a-4b8f-914d-ec997333b32d admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:26.436119 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-3a76fa32-cf1a-4b8f-914d-ec997333b32d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b686e7645e2f4f53965b3ed3d6bcd39b', 'request_id': 'req-3a76fa32-cf1a-4b8f-914d-ec997333b32d'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:26.440398 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:26.446482 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-3a76fa32-cf1a-4b8f-914d-ec997333b32d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b686e7645e2f4f53965b3ed3d6bcd39b', 'request_id': 'req-3a76fa32-cf1a-4b8f-914d-ec997333b32d'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:26.460690 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-3a76fa32-cf1a-4b8f-914d-ec997333b32d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b686e7645e2f4f53965b3ed3d6bcd39b', 'request_id': 'req-3a76fa32-cf1a-4b8f-914d-ec997333b32d'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:26.472575 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-3a76fa32-cf1a-4b8f-914d-ec997333b32d admin admin] The token cache is being invalidate because project b686e7645e2f4f53965b3ed3d6bcd39b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:44:26.472864 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-3a76fa32-cf1a-4b8f-914d-ec997333b32d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:26.473701 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-3a76fa32-cf1a-4b8f-914d-ec997333b32d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:26.475299 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1334/2668] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:44:26 2022] DELETE /identity/v3/projects/b686e7645e2f4f53965b3ed3d6bcd39b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:26.479393 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bcc0bf-9994-4406-b086-8ccf75fcc157 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:26.480803 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e6bcc0bf-9994-4406-b086-8ccf75fcc157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:26.494143 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bcc0bf-9994-4406-b086-8ccf75fcc157 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:26.576071 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55caba9a-ebcd-423e-8d12-a2b72a83c5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:26.577617 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55caba9a-ebcd-423e-8d12-a2b72a83c5ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:26.578108 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55caba9a-ebcd-423e-8d12-a2b72a83c5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:26.578595 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55caba9a-ebcd-423e-8d12-a2b72a83c5ed admin admin] PATH_INFO: `/v3/users/5253987ac5bd409d9531c04385f1046f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:26.580561 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55caba9a-ebcd-423e-8d12-a2b72a83c5ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=5253987ac5bd409d9531c04385f1046f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:26.584163 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55caba9a-ebcd-423e-8d12-a2b72a83c5ed admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:26.647889 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-55caba9a-ebcd-423e-8d12-a2b72a83c5ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5253987ac5bd409d9531c04385f1046f'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:26.669899 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-55caba9a-ebcd-423e-8d12-a2b72a83c5ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5253987ac5bd409d9531c04385f1046f'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:26.669899 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-55caba9a-ebcd-423e-8d12-a2b72a83c5ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5253987ac5bd409d9531c04385f1046f'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:26.669899 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-55caba9a-ebcd-423e-8d12-a2b72a83c5ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5253987ac5bd409d9531c04385f1046f'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:26.681204 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-55caba9a-ebcd-423e-8d12-a2b72a83c5ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5253987ac5bd409d9531c04385f1046f'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:26.712596 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1335/2669] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:44:26 2022] DELETE /identity/v3/users/5253987ac5bd409d9531c04385f1046f => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:44:27.059441 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76fa32-cf1a-4b8f-914d-ec997333b32d admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:27.060999 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-3a76fa32-cf1a-4b8f-914d-ec997333b32d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:27.076459 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76fa32-cf1a-4b8f-914d-ec997333b32d admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:27.147307 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdee5cf-5cf3-47d4-a4f4-c932d856c27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:27.148099 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdee5cf-5cf3-47d4-a4f4-c932d856c27d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:27.148383 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdee5cf-5cf3-47d4-a4f4-c932d856c27d admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:27.148657 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdee5cf-5cf3-47d4-a4f4-c932d856c27d admin admin] PATH_INFO: `/v3/projects/bf620209ce9349c599e2733d895e366f` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:27.149929 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdee5cf-5cf3-47d4-a4f4-c932d856c27d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf620209ce9349c599e2733d895e366f)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:27.151876 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdee5cf-5cf3-47d4-a4f4-c932d856c27d admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:27.205244 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-fcdee5cf-5cf3-47d4-a4f4-c932d856c27d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf620209ce9349c599e2733d895e366f', 'request_id': 'req-fcdee5cf-5cf3-47d4-a4f4-c932d856c27d'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:27.214987 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-fcdee5cf-5cf3-47d4-a4f4-c932d856c27d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf620209ce9349c599e2733d895e366f', 'request_id': 'req-fcdee5cf-5cf3-47d4-a4f4-c932d856c27d'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:27.222432 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-fcdee5cf-5cf3-47d4-a4f4-c932d856c27d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf620209ce9349c599e2733d895e366f', 'request_id': 'req-fcdee5cf-5cf3-47d4-a4f4-c932d856c27d'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:27.234350 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-fcdee5cf-5cf3-47d4-a4f4-c932d856c27d admin admin] The token cache is being invalidate because project bf620209ce9349c599e2733d895e366f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:44:27.234705 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-fcdee5cf-5cf3-47d4-a4f4-c932d856c27d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:27.235941 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-fcdee5cf-5cf3-47d4-a4f4-c932d856c27d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:27.237674 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1335/2670] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:44:27 2022] DELETE /identity/v3/projects/bf620209ce9349c599e2733d895e366f => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:27.244083 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf8199-5168-46d6-9257-5679dd0a1457 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:27.244596 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf8199-5168-46d6-9257-5679dd0a1457 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:27.244721 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf8199-5168-46d6-9257-5679dd0a1457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:27.265079 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-9bbf8199-5168-46d6-9257-5679dd0a1457 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:27.267382 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9bbf8199-5168-46d6-9257-5679dd0a1457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:27.322196 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:27.339681 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1336/2671] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:44:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:44:27.348420 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da464b6f-ea55-409d-a608-6518fc1bb048 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:27.349136 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da464b6f-ea55-409d-a608-6518fc1bb048 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:27.349136 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da464b6f-ea55-409d-a608-6518fc1bb048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:27.368532 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-da464b6f-ea55-409d-a608-6518fc1bb048 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:27.369834 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-da464b6f-ea55-409d-a608-6518fc1bb048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:27.379892 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1336/2672] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:44:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:27.385637 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf8199-5168-46d6-9257-5679dd0a1457 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:27.397457 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf8199-5168-46d6-9257-5679dd0a1457 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:27.402246 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d0a523-4b2b-4af6-9573-9e6c9105659a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:27.402909 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0a523-4b2b-4af6-9573-9e6c9105659a admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:27.403192 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0a523-4b2b-4af6-9573-9e6c9105659a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:27.403471 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0a523-4b2b-4af6-9573-9e6c9105659a admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:27.404200 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d0a523-4b2b-4af6-9573-9e6c9105659a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:44:27.404514 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d0a523-4b2b-4af6-9573-9e6c9105659a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:27.406185 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d0a523-4b2b-4af6-9573-9e6c9105659a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:27.417943 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1337/2673] 10.222.0.16 () {58 vars in 1152 bytes} [Thu May 26 12:44:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:44:27.423548 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da464b6f-ea55-409d-a608-6518fc1bb048 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:27.433344 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da464b6f-ea55-409d-a608-6518fc1bb048 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:27.438857 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b41e3-7ff9-4fec-93c4-a5314bc8113f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:27.440473 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b41e3-7ff9-4fec-93c4-a5314bc8113f admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:27.440473 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b41e3-7ff9-4fec-93c4-a5314bc8113f admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:27.440473 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b41e3-7ff9-4fec-93c4-a5314bc8113f admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:27.440782 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3b41e3-7ff9-4fec-93c4-a5314bc8113f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:27.442709 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3b41e3-7ff9-4fec-93c4-a5314bc8113f admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:27.469827 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1337/2674] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:44:27 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:44:27.474076 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d0a523-4b2b-4af6-9573-9e6c9105659a admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:27.484319 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d0a523-4b2b-4af6-9573-9e6c9105659a admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:27.548693 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54adc780-38ac-4bcb-8644-72ec548532bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:27.549456 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54adc780-38ac-4bcb-8644-72ec548532bc admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:27.549744 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54adc780-38ac-4bcb-8644-72ec548532bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:27.550024 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54adc780-38ac-4bcb-8644-72ec548532bc admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:27.550728 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54adc780-38ac-4bcb-8644-72ec548532bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:27.552662 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54adc780-38ac-4bcb-8644-72ec548532bc admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:27.574056 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1338/2675] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:44:27 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:44:27.579135 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b41e3-7ff9-4fec-93c4-a5314bc8113f admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:27.591974 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b41e3-7ff9-4fec-93c4-a5314bc8113f admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:27.598664 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0b9843-6339-4f88-93bc-69096890d560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:27.599408 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b9843-6339-4f88-93bc-69096890d560 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:27.599775 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b9843-6339-4f88-93bc-69096890d560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:27.600083 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b9843-6339-4f88-93bc-69096890d560 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:27.600942 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0b9843-6339-4f88-93bc-69096890d560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:27.602560 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0b9843-6339-4f88-93bc-69096890d560 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:27.613579 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1338/2676] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:44:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:44:27.617826 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54adc780-38ac-4bcb-8644-72ec548532bc admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:27.629142 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54adc780-38ac-4bcb-8644-72ec548532bc admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:27.634225 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a6321-df17-4310-971f-02dd06174d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:27.634893 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a6321-df17-4310-971f-02dd06174d5b admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:27.635179 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a6321-df17-4310-971f-02dd06174d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:27.635459 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a6321-df17-4310-971f-02dd06174d5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:27.636208 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a6321-df17-4310-971f-02dd06174d5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:27.637885 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a6321-df17-4310-971f-02dd06174d5b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:27.648695 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1339/2677] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:44:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:44:27.652946 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0b9843-6339-4f88-93bc-69096890d560 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:27.664050 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0b9843-6339-4f88-93bc-69096890d560 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:27.669404 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6673f552-95c2-4790-89ce-21ed600d6d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:27.670443 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6673f552-95c2-4790-89ce-21ed600d6d00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:27.670771 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6673f552-95c2-4790-89ce-21ed600d6d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:27.671055 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6673f552-95c2-4790-89ce-21ed600d6d00 admin admin] PATH_INFO: `/v3/projects/91ca7db52106461d9c2d02fed29bd080/users/995eba56109a4bca9d5578259fcbcb14/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:27.687163 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6673f552-95c2-4790-89ce-21ed600d6d00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91ca7db52106461d9c2d02fed29bd080, user_id=995eba56109a4bca9d5578259fcbcb14, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:27.690017 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6673f552-95c2-4790-89ce-21ed600d6d00 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:27.702985 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1339/2678] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:44:27 2022] PUT /identity/v3/projects/91ca7db52106461d9c2d02fed29bd080/users/995eba56109a4bca9d5578259fcbcb14/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:44:27.708698 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e40415-35e0-4ec0-af2c-8eb714ee3ca0 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:27.709016 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e40415-35e0-4ec0-af2c-8eb714ee3ca0 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:27.709300 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e40415-35e0-4ec0-af2c-8eb714ee3ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:27.727831 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-e4e40415-35e0-4ec0-af2c-8eb714ee3ca0 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:27.729078 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e4e40415-35e0-4ec0-af2c-8eb714ee3ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:27.789630 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1340/2679] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:44:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:27.802213 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6673f552-95c2-4790-89ce-21ed600d6d00 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:27.804160 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-6673f552-95c2-4790-89ce-21ed600d6d00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:27.815959 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:27.871531 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6673f552-95c2-4790-89ce-21ed600d6d00 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:27.876882 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1286e27-b970-4735-88ee-2dd942f8d7da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:27.877390 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1286e27-b970-4735-88ee-2dd942f8d7da service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:27.877710 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1286e27-b970-4735-88ee-2dd942f8d7da service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:27.877983 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1286e27-b970-4735-88ee-2dd942f8d7da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:27.889244 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1286e27-b970-4735-88ee-2dd942f8d7da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:27.891798 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1286e27-b970-4735-88ee-2dd942f8d7da service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:27.906407 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1340/2680] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:44:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:44:28.640413 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1082e9e0-29f5-4bb1-94a7-fb385c7c7ef0 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:28.641652 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1082e9e0-29f5-4bb1-94a7-fb385c7c7ef0 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:28.641652 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1082e9e0-29f5-4bb1-94a7-fb385c7c7ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:28.668045 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-1082e9e0-29f5-4bb1-94a7-fb385c7c7ef0 None None] MFA Rules not processed for user `995eba56109a4bca9d5578259fcbcb14`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:28.669242 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1082e9e0-29f5-4bb1-94a7-fb385c7c7ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:28.721973 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:28.741499 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1341/2681] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:44:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:28.745752 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1286e27-b970-4735-88ee-2dd942f8d7da service neutron] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:28.761989 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1286e27-b970-4735-88ee-2dd942f8d7da service neutron] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:28.766642 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ccc468-9f83-4c28-bd49-704e95a88d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:28.767295 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ccc468-9f83-4c28-bd49-704e95a88d96 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:28.767579 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ccc468-9f83-4c28-bd49-704e95a88d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:28.767849 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ccc468-9f83-4c28-bd49-704e95a88d96 admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:28.768533 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ccc468-9f83-4c28-bd49-704e95a88d96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:28.770473 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ccc468-9f83-4c28-bd49-704e95a88d96 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:28.798848 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1341/2682] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:44:28 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:44:28.803196 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1082e9e0-29f5-4bb1-94a7-fb385c7c7ef0 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:28.815186 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1082e9e0-29f5-4bb1-94a7-fb385c7c7ef0 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:28.873255 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a96411-ff6b-45fd-9fba-bbee26193684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:28.873929 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a96411-ff6b-45fd-9fba-bbee26193684 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:28.874214 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a96411-ff6b-45fd-9fba-bbee26193684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:28.874492 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a96411-ff6b-45fd-9fba-bbee26193684 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:28.875296 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a96411-ff6b-45fd-9fba-bbee26193684 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:28.877328 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a96411-ff6b-45fd-9fba-bbee26193684 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:28.897670 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1342/2683] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:44:28 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:44:28.901650 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ccc468-9f83-4c28-bd49-704e95a88d96 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:28.912530 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ccc468-9f83-4c28-bd49-704e95a88d96 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:28.917072 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c39ee9-3e62-453f-9662-4f0098314130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:28.917725 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c39ee9-3e62-453f-9662-4f0098314130 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:28.918004 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c39ee9-3e62-453f-9662-4f0098314130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:28.918328 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c39ee9-3e62-453f-9662-4f0098314130 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:28.918996 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c39ee9-3e62-453f-9662-4f0098314130 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:28.920614 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c39ee9-3e62-453f-9662-4f0098314130 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:28.933634 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1342/2684] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:44:28.938385 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a96411-ff6b-45fd-9fba-bbee26193684 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:28.948475 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a96411-ff6b-45fd-9fba-bbee26193684 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:28.953150 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c28ba-2c20-4640-9520-15972361dde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:28.954558 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c28ba-2c20-4640-9520-15972361dde6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:28.954832 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c28ba-2c20-4640-9520-15972361dde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:28.955105 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c28ba-2c20-4640-9520-15972361dde6 admin admin] PATH_INFO: `/v3/projects/5937b262917e40a9bfaebcb8bba659f8/users/5657945f633c48ea941971f2cf602684/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:28.970671 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530c28ba-2c20-4640-9520-15972361dde6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5937b262917e40a9bfaebcb8bba659f8, user_id=5657945f633c48ea941971f2cf602684, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:28.973371 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530c28ba-2c20-4640-9520-15972361dde6 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:28.987194 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1343/2685] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:44:28 2022] PUT /identity/v3/projects/5937b262917e40a9bfaebcb8bba659f8/users/5657945f633c48ea941971f2cf602684/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:28.991418 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c39ee9-3e62-453f-9662-4f0098314130 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:29.002034 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c39ee9-3e62-453f-9662-4f0098314130 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:29.060254 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50792412-2621-4e70-b330-e8cac5b6f846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:29.060949 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50792412-2621-4e70-b330-e8cac5b6f846 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:29.061237 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50792412-2621-4e70-b330-e8cac5b6f846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:29.061516 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50792412-2621-4e70-b330-e8cac5b6f846 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:29.062242 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50792412-2621-4e70-b330-e8cac5b6f846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:29.064395 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50792412-2621-4e70-b330-e8cac5b6f846 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:29.074222 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1343/2686] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:44:29.079153 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c28ba-2c20-4640-9520-15972361dde6 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:29.090047 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c28ba-2c20-4640-9520-15972361dde6 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:29.095632 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c40e9-81f2-4345-bf1d-e5f9920317c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:29.096511 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c40e9-81f2-4345-bf1d-e5f9920317c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:29.096793 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c40e9-81f2-4345-bf1d-e5f9920317c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:29.097107 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c40e9-81f2-4345-bf1d-e5f9920317c4 admin admin] PATH_INFO: `/v3/projects/5937b262917e40a9bfaebcb8bba659f8/users/5657945f633c48ea941971f2cf602684/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:29.099101 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87c40e9-81f2-4345-bf1d-e5f9920317c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5937b262917e40a9bfaebcb8bba659f8, user_id=5657945f633c48ea941971f2cf602684, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:29.101971 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87c40e9-81f2-4345-bf1d-e5f9920317c4 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:29.113102 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1344/2687] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:44:29 2022] PUT /identity/v3/projects/5937b262917e40a9bfaebcb8bba659f8/users/5657945f633c48ea941971f2cf602684/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:29.324288 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50792412-2621-4e70-b330-e8cac5b6f846 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:29.409824 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50792412-2621-4e70-b330-e8cac5b6f846 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:29.468050 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:29.501165 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5124d403-2222-4ab9-94df-5db2b099cba2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:29.501917 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124d403-2222-4ab9-94df-5db2b099cba2 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:29.502359 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124d403-2222-4ab9-94df-5db2b099cba2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:29.502616 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124d403-2222-4ab9-94df-5db2b099cba2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:29.505878 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-5124d403-2222-4ab9-94df-5db2b099cba2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:29.602505 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5124d403-2222-4ab9-94df-5db2b099cba2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:29.604228 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5124d403-2222-4ab9-94df-5db2b099cba2 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:29.616944 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1344/2688] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:44:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:44:30.285709 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92ffa7-3f1a-4764-8ec7-8994ce36906f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:30.286269 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92ffa7-3f1a-4764-8ec7-8994ce36906f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:30.287429 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92ffa7-3f1a-4764-8ec7-8994ce36906f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:30.317554 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-1c92ffa7-3f1a-4764-8ec7-8994ce36906f None None] MFA Rules not processed for user `5657945f633c48ea941971f2cf602684`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:30.319258 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1c92ffa7-3f1a-4764-8ec7-8994ce36906f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:30.402902 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1345/2689] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:44:30 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:30.413108 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6c1b4-7add-40e9-8ec8-2b4667ea15e7 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:30.413987 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6c1b4-7add-40e9-8ec8-2b4667ea15e7 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:30.414273 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6c1b4-7add-40e9-8ec8-2b4667ea15e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:30.433117 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-cca6c1b4-7add-40e9-8ec8-2b4667ea15e7 None None] MFA Rules not processed for user `995eba56109a4bca9d5578259fcbcb14`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:30.434445 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-cca6c1b4-7add-40e9-8ec8-2b4667ea15e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:30.494961 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1345/2690] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:44:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:30.507096 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c92ffa7-3f1a-4764-8ec7-8994ce36906f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:30.508499 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1c92ffa7-3f1a-4764-8ec7-8994ce36906f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:30.538719 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:30.596178 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c92ffa7-3f1a-4764-8ec7-8994ce36906f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:30.602320 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac217d1-271b-4f2a-90a8-f39ca8e81caf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536f68ff77794352adf41aaacdc0645c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:30.603147 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac217d1-271b-4f2a-90a8-f39ca8e81caf service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:30.603369 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac217d1-271b-4f2a-90a8-f39ca8e81caf service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:30.603547 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac217d1-271b-4f2a-90a8-f39ca8e81caf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:30.612540 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac217d1-271b-4f2a-90a8-f39ca8e81caf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:30.614206 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac217d1-271b-4f2a-90a8-f39ca8e81caf service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:30.627770 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1346/2691] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:44:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:44:34.065667 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca6c1b4-7add-40e9-8ec8-2b4667ea15e7 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:34.067207 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-cca6c1b4-7add-40e9-8ec8-2b4667ea15e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:34.087586 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca6c1b4-7add-40e9-8ec8-2b4667ea15e7 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:34.093464 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b876a96e-eb85-4dd8-b995-5e6c53a48142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:34.095198 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876a96e-eb85-4dd8-b995-5e6c53a48142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:34.095530 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876a96e-eb85-4dd8-b995-5e6c53a48142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:34.096008 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876a96e-eb85-4dd8-b995-5e6c53a48142 admin admin] PATH_INFO: `/v3/users/107c077bdf3c4126b2d426df02b546d0` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:34.097364 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b876a96e-eb85-4dd8-b995-5e6c53a48142 admin admin] RBAC: Authorizing `identity:delete_user(user_id=107c077bdf3c4126b2d426df02b546d0)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:34.099348 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b876a96e-eb85-4dd8-b995-5e6c53a48142 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:34.155508 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-b876a96e-eb85-4dd8-b995-5e6c53a48142 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '107c077bdf3c4126b2d426df02b546d0'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:34.156294 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-b876a96e-eb85-4dd8-b995-5e6c53a48142 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '107c077bdf3c4126b2d426df02b546d0'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:34.157011 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-b876a96e-eb85-4dd8-b995-5e6c53a48142 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '107c077bdf3c4126b2d426df02b546d0'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:34.167345 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-b876a96e-eb85-4dd8-b995-5e6c53a48142 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '107c077bdf3c4126b2d426df02b546d0'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:34.184117 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-b876a96e-eb85-4dd8-b995-5e6c53a48142 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '107c077bdf3c4126b2d426df02b546d0'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:34.190177 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac217d1-271b-4f2a-90a8-f39ca8e81caf service nova] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:34.192267 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4ac217d1-271b-4f2a-90a8-f39ca8e81caf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:34.194821 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:34.201686 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1346/2692] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:44:34 2022] DELETE /identity/v3/users/107c077bdf3c4126b2d426df02b546d0 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:34.203935 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b876a96e-eb85-4dd8-b995-5e6c53a48142 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:34.207097 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-b876a96e-eb85-4dd8-b995-5e6c53a48142 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:34.217243 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac217d1-271b-4f2a-90a8-f39ca8e81caf service nova] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:34.290141 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b876a96e-eb85-4dd8-b995-5e6c53a48142 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:34.297673 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67109e3e-1ec5-43f6-af83-0f146cee963d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:34.298524 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e850479-6621-4a1a-a4c4-5a8cd46b30d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:34.299410 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67109e3e-1ec5-43f6-af83-0f146cee963d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:34.299787 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67109e3e-1ec5-43f6-af83-0f146cee963d admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:34.300084 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67109e3e-1ec5-43f6-af83-0f146cee963d admin admin] PATH_INFO: `/v3/users/72acc7b23f594627b3e66d4c380e6e60` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:34.300198 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e850479-6621-4a1a-a4c4-5a8cd46b30d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:34.300665 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e850479-6621-4a1a-a4c4-5a8cd46b30d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:34.301163 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e850479-6621-4a1a-a4c4-5a8cd46b30d6 admin admin] PATH_INFO: `/v3/users/41661c29981b4667a1621e894e3f3d29` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:34.301820 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67109e3e-1ec5-43f6-af83-0f146cee963d admin admin] RBAC: Authorizing `identity:delete_user(user_id=72acc7b23f594627b3e66d4c380e6e60)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:34.302782 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e850479-6621-4a1a-a4c4-5a8cd46b30d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41661c29981b4667a1621e894e3f3d29)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:34.305092 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67109e3e-1ec5-43f6-af83-0f146cee963d admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:34.305707 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e850479-6621-4a1a-a4c4-5a8cd46b30d6 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:34.384197 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-67109e3e-1ec5-43f6-af83-0f146cee963d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72acc7b23f594627b3e66d4c380e6e60'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:34.385901 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-67109e3e-1ec5-43f6-af83-0f146cee963d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72acc7b23f594627b3e66d4c380e6e60'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:34.386819 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-67109e3e-1ec5-43f6-af83-0f146cee963d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72acc7b23f594627b3e66d4c380e6e60'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:34.389442 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9e850479-6621-4a1a-a4c4-5a8cd46b30d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41661c29981b4667a1621e894e3f3d29'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:34.399123 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-67109e3e-1ec5-43f6-af83-0f146cee963d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72acc7b23f594627b3e66d4c380e6e60'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:34.404457 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9e850479-6621-4a1a-a4c4-5a8cd46b30d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41661c29981b4667a1621e894e3f3d29'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:34.406172 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9e850479-6621-4a1a-a4c4-5a8cd46b30d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41661c29981b4667a1621e894e3f3d29'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:34.408090 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9e850479-6621-4a1a-a4c4-5a8cd46b30d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41661c29981b4667a1621e894e3f3d29'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:34.420807 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-67109e3e-1ec5-43f6-af83-0f146cee963d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72acc7b23f594627b3e66d4c380e6e60'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:34.424929 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9e850479-6621-4a1a-a4c4-5a8cd46b30d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41661c29981b4667a1621e894e3f3d29'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:34.444215 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1347/2693] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:44:34 2022] DELETE /identity/v3/users/72acc7b23f594627b3e66d4c380e6e60 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:34.445390 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d60bd5-7758-466b-9602-c3373c7f3b38 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:34.445733 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d60bd5-7758-466b-9602-c3373c7f3b38 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:34.450692 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d60bd5-7758-466b-9602-c3373c7f3b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:34.457386 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1347/2694] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:44:34 2022] DELETE /identity/v3/users/41661c29981b4667a1621e894e3f3d29 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:44:34.478900 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-16d60bd5-7758-466b-9602-c3373c7f3b38 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:34.480879 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-16d60bd5-7758-466b-9602-c3373c7f3b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:34.561878 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1348/2695] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:44:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:34.574115 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e850479-6621-4a1a-a4c4-5a8cd46b30d6 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:34.576045 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9e850479-6621-4a1a-a4c4-5a8cd46b30d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:34.613704 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:34.660518 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e850479-6621-4a1a-a4c4-5a8cd46b30d6 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:34.664434 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e2c219-560c-4625-9497-2b1d258fde60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:34.665835 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d60bd5-7758-466b-9602-c3373c7f3b38 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:34.666660 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2c219-560c-4625-9497-2b1d258fde60 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:34.666941 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2c219-560c-4625-9497-2b1d258fde60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:34.667217 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2c219-560c-4625-9497-2b1d258fde60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:34.667632 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-16d60bd5-7758-466b-9602-c3373c7f3b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:34.679216 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e2c219-560c-4625-9497-2b1d258fde60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:34.680977 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e2c219-560c-4625-9497-2b1d258fde60 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:34.694121 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1348/2696] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:44:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:44:34.725486 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d60bd5-7758-466b-9602-c3373c7f3b38 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:34.735034 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20762c5-d15a-4638-bd44-a9d7a1254d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:34.736160 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20762c5-d15a-4638-bd44-a9d7a1254d83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:34.736672 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20762c5-d15a-4638-bd44-a9d7a1254d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:34.737138 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20762c5-d15a-4638-bd44-a9d7a1254d83 admin admin] PATH_INFO: `/v3/projects/785423a906614dc580ba25f27a356020` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:34.739675 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20762c5-d15a-4638-bd44-a9d7a1254d83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=785423a906614dc580ba25f27a356020)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:34.743247 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20762c5-d15a-4638-bd44-a9d7a1254d83 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:34.775037 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:34.837944 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-b20762c5-d15a-4638-bd44-a9d7a1254d83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '785423a906614dc580ba25f27a356020', 'request_id': 'req-b20762c5-d15a-4638-bd44-a9d7a1254d83'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:34.848568 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-b20762c5-d15a-4638-bd44-a9d7a1254d83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '785423a906614dc580ba25f27a356020', 'request_id': 'req-b20762c5-d15a-4638-bd44-a9d7a1254d83'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:34.858046 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-b20762c5-d15a-4638-bd44-a9d7a1254d83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '785423a906614dc580ba25f27a356020', 'request_id': 'req-b20762c5-d15a-4638-bd44-a9d7a1254d83'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:34.874431 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-b20762c5-d15a-4638-bd44-a9d7a1254d83 admin admin] The token cache is being invalidate because project 785423a906614dc580ba25f27a356020 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:44:34.874855 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-b20762c5-d15a-4638-bd44-a9d7a1254d83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:34.876048 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-b20762c5-d15a-4638-bd44-a9d7a1254d83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:34.878701 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1349/2697] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:44:34 2022] DELETE /identity/v3/projects/785423a906614dc580ba25f27a356020 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:44:35.053497 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e2c219-560c-4625-9497-2b1d258fde60 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:35.055311 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f4e2c219-560c-4625-9497-2b1d258fde60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:35.074882 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e2c219-560c-4625-9497-2b1d258fde60 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:35.160499 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e06c1b-82fb-4640-908d-3dbb8e887677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:35.161448 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e06c1b-82fb-4640-908d-3dbb8e887677 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:35.161738 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e06c1b-82fb-4640-908d-3dbb8e887677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:35.162046 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e06c1b-82fb-4640-908d-3dbb8e887677 admin admin] PATH_INFO: `/v3/projects/d990bddc5bc24440bcd5f6530b01a5e2` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:35.163277 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e06c1b-82fb-4640-908d-3dbb8e887677 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d990bddc5bc24440bcd5f6530b01a5e2)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:35.165434 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e06c1b-82fb-4640-908d-3dbb8e887677 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:35.216389 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a1e06c1b-82fb-4640-908d-3dbb8e887677 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd990bddc5bc24440bcd5f6530b01a5e2', 'request_id': 'req-a1e06c1b-82fb-4640-908d-3dbb8e887677'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:35.222600 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a1e06c1b-82fb-4640-908d-3dbb8e887677 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd990bddc5bc24440bcd5f6530b01a5e2', 'request_id': 'req-a1e06c1b-82fb-4640-908d-3dbb8e887677'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:35.228892 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a1e06c1b-82fb-4640-908d-3dbb8e887677 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd990bddc5bc24440bcd5f6530b01a5e2', 'request_id': 'req-a1e06c1b-82fb-4640-908d-3dbb8e887677'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:35.246708 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a1e06c1b-82fb-4640-908d-3dbb8e887677 admin admin] The token cache is being invalidate because project d990bddc5bc24440bcd5f6530b01a5e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:44:35.247384 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a1e06c1b-82fb-4640-908d-3dbb8e887677 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:35.248392 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a1e06c1b-82fb-4640-908d-3dbb8e887677 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:35.250392 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1349/2698] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:44:35 2022] DELETE /identity/v3/projects/d990bddc5bc24440bcd5f6530b01a5e2 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:35.256129 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3de686-5700-418e-b9fc-559b7b70d5f3 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:35.256696 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3de686-5700-418e-b9fc-559b7b70d5f3 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:35.256987 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3de686-5700-418e-b9fc-559b7b70d5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:35.278982 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e06c1b-82fb-4640-908d-3dbb8e887677 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:35.282776 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a1e06c1b-82fb-4640-908d-3dbb8e887677 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:35.313665 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-cb3de686-5700-418e-b9fc-559b7b70d5f3 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:35.314984 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-cb3de686-5700-418e-b9fc-559b7b70d5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:35.396421 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e06c1b-82fb-4640-908d-3dbb8e887677 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:35.401366 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1350/2699] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:44:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:35.405595 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3529ec-561b-4b69-886b-e33df206c006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:35.407159 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3529ec-561b-4b69-886b-e33df206c006 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:35.407449 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3529ec-561b-4b69-886b-e33df206c006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:35.407725 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3529ec-561b-4b69-886b-e33df206c006 admin admin] PATH_INFO: `/v3/projects/b6f92db85a5441ff9182abc900060193` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:35.409103 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3529ec-561b-4b69-886b-e33df206c006 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6f92db85a5441ff9182abc900060193)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:35.409548 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033cc4bc-6ee1-4fe1-a6dc-d2067ff05db1 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:35.409927 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033cc4bc-6ee1-4fe1-a6dc-d2067ff05db1 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:35.410422 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033cc4bc-6ee1-4fe1-a6dc-d2067ff05db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:35.411550 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3529ec-561b-4b69-886b-e33df206c006 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:35.420600 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:35.435116 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-033cc4bc-6ee1-4fe1-a6dc-d2067ff05db1 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:35.436534 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-033cc4bc-6ee1-4fe1-a6dc-d2067ff05db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:35.447634 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1351/2700] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:44:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:44:35.455382 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033cc4bc-6ee1-4fe1-a6dc-d2067ff05db1 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:35.467756 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033cc4bc-6ee1-4fe1-a6dc-d2067ff05db1 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:35.486145 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5e3529ec-561b-4b69-886b-e33df206c006 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6f92db85a5441ff9182abc900060193', 'request_id': 'req-5e3529ec-561b-4b69-886b-e33df206c006'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:35.494492 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5e3529ec-561b-4b69-886b-e33df206c006 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6f92db85a5441ff9182abc900060193', 'request_id': 'req-5e3529ec-561b-4b69-886b-e33df206c006'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:35.505205 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5e3529ec-561b-4b69-886b-e33df206c006 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6f92db85a5441ff9182abc900060193', 'request_id': 'req-5e3529ec-561b-4b69-886b-e33df206c006'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:35.520588 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5e3529ec-561b-4b69-886b-e33df206c006 admin admin] The token cache is being invalidate because project b6f92db85a5441ff9182abc900060193 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:44:35.520996 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5e3529ec-561b-4b69-886b-e33df206c006 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:35.521688 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5e3529ec-561b-4b69-886b-e33df206c006 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:35.524909 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1350/2701] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:44:35 2022] DELETE /identity/v3/projects/b6f92db85a5441ff9182abc900060193 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:35.529126 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd85f7b-6578-413f-9e1f-436fd9044e25 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:35.529539 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd85f7b-6578-413f-9e1f-436fd9044e25 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:35.529968 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd85f7b-6578-413f-9e1f-436fd9044e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:35.541614 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b237fbb-05b2-4af6-9ec3-46bff4c9a590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:35.542282 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b237fbb-05b2-4af6-9ec3-46bff4c9a590 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:35.542562 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b237fbb-05b2-4af6-9ec3-46bff4c9a590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:35.542839 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b237fbb-05b2-4af6-9ec3-46bff4c9a590 admin admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:35.543571 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b237fbb-05b2-4af6-9ec3-46bff4c9a590 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:44:35.543875 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b237fbb-05b2-4af6-9ec3-46bff4c9a590 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:35.545540 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b237fbb-05b2-4af6-9ec3-46bff4c9a590 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:35.551652 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-4fd85f7b-6578-413f-9e1f-436fd9044e25 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:35.553137 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4fd85f7b-6578-413f-9e1f-436fd9044e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:35.560871 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1352/2702] 10.222.0.16 () {58 vars in 1152 bytes} [Thu May 26 12:44:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:44:35.564531 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b237fbb-05b2-4af6-9ec3-46bff4c9a590 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:35.569279 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1351/2703] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:44:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:35.570939 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-5b237fbb-05b2-4af6-9ec3-46bff4c9a590 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:35.572069 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84ed45-acb7-453e-816f-69cd2104e78c None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:35.572489 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84ed45-acb7-453e-816f-69cd2104e78c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:35.572902 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84ed45-acb7-453e-816f-69cd2104e78c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:35.586683 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b237fbb-05b2-4af6-9ec3-46bff4c9a590 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:35.592298 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c916a-28fc-4029-bc33-0315dd18d131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:35.592774 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-ba84ed45-acb7-453e-816f-69cd2104e78c None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:35.593587 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c916a-28fc-4029-bc33-0315dd18d131 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:35.593587 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c916a-28fc-4029-bc33-0315dd18d131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:35.594436 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c916a-28fc-4029-bc33-0315dd18d131 admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:35.594921 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6c916a-28fc-4029-bc33-0315dd18d131 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:35.595472 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ba84ed45-acb7-453e-816f-69cd2104e78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:35.597057 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6c916a-28fc-4029-bc33-0315dd18d131 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:35.607906 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1352/2704] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:44:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:44:35.609395 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84ed45-acb7-453e-816f-69cd2104e78c None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:35.620333 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84ed45-acb7-453e-816f-69cd2104e78c None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:35.626969 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188494e-7e70-40d0-91ad-55208e5c9478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:35.627804 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188494e-7e70-40d0-91ad-55208e5c9478 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:35.628128 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188494e-7e70-40d0-91ad-55208e5c9478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:35.628412 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188494e-7e70-40d0-91ad-55208e5c9478 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:35.628607 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1353/2705] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:44:35 2022] POST /identity/v3/projects => generated 373 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:44:35.629317 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e188494e-7e70-40d0-91ad-55208e5c9478 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:44:35.629652 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e188494e-7e70-40d0-91ad-55208e5c9478 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:35.631262 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e188494e-7e70-40d0-91ad-55208e5c9478 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:35.633061 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c916a-28fc-4029-bc33-0315dd18d131 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:35.643013 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:35.644805 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1353/2706] 10.222.0.16 () {58 vars in 1152 bytes} [Thu May 26 12:44:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:44:35.653870 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188494e-7e70-40d0-91ad-55208e5c9478 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:35.666021 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188494e-7e70-40d0-91ad-55208e5c9478 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:35.726921 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c916a-28fc-4029-bc33-0315dd18d131 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:35.731923 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e317655-c02c-494c-bd39-c9e1f1c8b62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:35.732599 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e317655-c02c-494c-bd39-c9e1f1c8b62a admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:35.732909 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e317655-c02c-494c-bd39-c9e1f1c8b62a admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:35.733186 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e317655-c02c-494c-bd39-c9e1f1c8b62a admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:35.733883 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e317655-c02c-494c-bd39-c9e1f1c8b62a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:35.735902 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e317655-c02c-494c-bd39-c9e1f1c8b62a admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:35.737038 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad4a929-33bf-4bce-b45c-a47f1d8d289d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:35.737795 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4a929-33bf-4bce-b45c-a47f1d8d289d admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:35.738146 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4a929-33bf-4bce-b45c-a47f1d8d289d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:35.738655 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4a929-33bf-4bce-b45c-a47f1d8d289d admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:35.739408 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad4a929-33bf-4bce-b45c-a47f1d8d289d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:35.741516 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad4a929-33bf-4bce-b45c-a47f1d8d289d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:35.773349 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1354/2707] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:44:35 2022] POST /identity/v3/users => generated 287 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:44:35.774031 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1354/2708] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:44:35 2022] POST /identity/v3/projects => generated 403 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:44:35.775511 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e317655-c02c-494c-bd39-c9e1f1c8b62a admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:35.777144 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad4a929-33bf-4bce-b45c-a47f1d8d289d admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:35.787844 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e317655-c02c-494c-bd39-c9e1f1c8b62a admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:35.835938 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:35.852107 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad4a929-33bf-4bce-b45c-a47f1d8d289d admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:35.853887 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb6411d-c36d-4585-a83b-c4c86a7f224d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:35.854435 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6411d-c36d-4585-a83b-c4c86a7f224d admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:35.854722 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6411d-c36d-4585-a83b-c4c86a7f224d admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:35.854996 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6411d-c36d-4585-a83b-c4c86a7f224d admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:35.855728 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb6411d-c36d-4585-a83b-c4c86a7f224d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:35.858225 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb6411d-c36d-4585-a83b-c4c86a7f224d admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:35.858717 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f491f-a963-4a35-99c3-8c0b317b3e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:35.860008 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f491f-a963-4a35-99c3-8c0b317b3e18 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:35.860276 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f491f-a963-4a35-99c3-8c0b317b3e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:35.860591 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f491f-a963-4a35-99c3-8c0b317b3e18 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:35.861329 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366f491f-a963-4a35-99c3-8c0b317b3e18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:35.863291 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366f491f-a963-4a35-99c3-8c0b317b3e18 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:35.870573 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1355/2709] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:44:35 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:44:35.874911 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb6411d-c36d-4585-a83b-c4c86a7f224d admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:35.885545 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1355/2710] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:44:35 2022] POST /identity/v3/users => generated 302 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:44:35.889645 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f491f-a963-4a35-99c3-8c0b317b3e18 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:35.889812 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb6411d-c36d-4585-a83b-c4c86a7f224d admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:35.895337 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded96d7-89ba-4368-bb93-07424d18ce2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:35.896706 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded96d7-89ba-4368-bb93-07424d18ce2b admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:35.896706 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded96d7-89ba-4368-bb93-07424d18ce2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:35.896941 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded96d7-89ba-4368-bb93-07424d18ce2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:35.897578 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dded96d7-89ba-4368-bb93-07424d18ce2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:35.899200 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dded96d7-89ba-4368-bb93-07424d18ce2b admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:35.899969 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f491f-a963-4a35-99c3-8c0b317b3e18 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:35.904719 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb344d9-ddf6-4c75-8436-426914e9891c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:35.905493 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb344d9-ddf6-4c75-8436-426914e9891c admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:35.905779 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb344d9-ddf6-4c75-8436-426914e9891c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:35.906580 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb344d9-ddf6-4c75-8436-426914e9891c admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:35.907309 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb344d9-ddf6-4c75-8436-426914e9891c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:35.908938 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb344d9-ddf6-4c75-8436-426914e9891c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:35.911736 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1356/2711] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:44:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:44:35.917815 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded96d7-89ba-4368-bb93-07424d18ce2b admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:35.924601 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1356/2712] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:44:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:44:35.925749 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb344d9-ddf6-4c75-8436-426914e9891c admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:35.929830 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded96d7-89ba-4368-bb93-07424d18ce2b admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:35.935416 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb2a361-818f-4f32-9a2b-53ee7c28de9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:35.935672 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb344d9-ddf6-4c75-8436-426914e9891c admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:35.936447 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2a361-818f-4f32-9a2b-53ee7c28de9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:35.936804 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2a361-818f-4f32-9a2b-53ee7c28de9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:35.937224 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2a361-818f-4f32-9a2b-53ee7c28de9b admin admin] PATH_INFO: `/v3/projects/3146d0bedb3041c088819f072b016b48/users/6eb8b883e2a84b59815da4a5200a60e9/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:35.940494 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb63fe-13a2-446d-891b-40b6e91a228c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:35.941207 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb63fe-13a2-446d-891b-40b6e91a228c admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:35.941491 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb63fe-13a2-446d-891b-40b6e91a228c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:35.941765 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb63fe-13a2-446d-891b-40b6e91a228c admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:35.942525 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fb63fe-13a2-446d-891b-40b6e91a228c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:35.944809 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fb63fe-13a2-446d-891b-40b6e91a228c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:35.954592 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb2a361-818f-4f32-9a2b-53ee7c28de9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3146d0bedb3041c088819f072b016b48, user_id=6eb8b883e2a84b59815da4a5200a60e9, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:35.957403 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb2a361-818f-4f32-9a2b-53ee7c28de9b admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:35.958728 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1357/2713] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:44:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:44:35.962057 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb63fe-13a2-446d-891b-40b6e91a228c admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:35.973431 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb63fe-13a2-446d-891b-40b6e91a228c admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:35.975781 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1357/2714] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:44:35 2022] PUT /identity/v3/projects/3146d0bedb3041c088819f072b016b48/users/6eb8b883e2a84b59815da4a5200a60e9/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:35.987364 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019225b7-55ae-4ab0-9885-ea93d3d8ef3f None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:35.987661 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019225b7-55ae-4ab0-9885-ea93d3d8ef3f None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:35.987938 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019225b7-55ae-4ab0-9885-ea93d3d8ef3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:36.020124 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-019225b7-55ae-4ab0-9885-ea93d3d8ef3f None None] MFA Rules not processed for user `6eb8b883e2a84b59815da4a5200a60e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:36.021663 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-019225b7-55ae-4ab0-9885-ea93d3d8ef3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:36.036258 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2020d1-32bc-4fb1-bbb5-7cc1faf5bdc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:36.037194 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2020d1-32bc-4fb1-bbb5-7cc1faf5bdc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:36.037477 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2020d1-32bc-4fb1-bbb5-7cc1faf5bdc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:36.037753 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2020d1-32bc-4fb1-bbb5-7cc1faf5bdc1 admin admin] PATH_INFO: `/v3/projects/57f5295c9e64468e8247883795259635/users/fc9b535a7caf49699b4c22f9174c486d/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:36.052950 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2020d1-32bc-4fb1-bbb5-7cc1faf5bdc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57f5295c9e64468e8247883795259635, user_id=fc9b535a7caf49699b4c22f9174c486d, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:36.055660 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2020d1-32bc-4fb1-bbb5-7cc1faf5bdc1 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:36.072271 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1358/2715] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:44:35 2022] PUT /identity/v3/projects/57f5295c9e64468e8247883795259635/users/fc9b535a7caf49699b4c22f9174c486d/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:36.077330 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:36.079029 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b983856-b502-4955-a001-1dad6d7b6bd8 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:36.079321 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b983856-b502-4955-a001-1dad6d7b6bd8 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:36.079613 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b983856-b502-4955-a001-1dad6d7b6bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:36.100230 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-9b983856-b502-4955-a001-1dad6d7b6bd8 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:36.101495 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9b983856-b502-4955-a001-1dad6d7b6bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:36.108353 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1358/2716] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:44:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:44:36.119835 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019225b7-55ae-4ab0-9885-ea93d3d8ef3f None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:36.121707 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-019225b7-55ae-4ab0-9885-ea93d3d8ef3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:36.177412 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1359/2717] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:44:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:36.186788 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b983856-b502-4955-a001-1dad6d7b6bd8 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:36.189597 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9b983856-b502-4955-a001-1dad6d7b6bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:36.191387 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019225b7-55ae-4ab0-9885-ea93d3d8ef3f None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:36.240702 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:36.247622 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4911c21-e09d-4751-b437-a3384c2a2c22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:36.248429 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4911c21-e09d-4751-b437-a3384c2a2c22 service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:36.248772 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4911c21-e09d-4751-b437-a3384c2a2c22 service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:36.249167 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4911c21-e09d-4751-b437-a3384c2a2c22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:36.256298 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b983856-b502-4955-a001-1dad6d7b6bd8 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:36.260622 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5b9c4-2262-47b8-b7bb-bc3e284686a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:36.262153 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5b9c4-2262-47b8-b7bb-bc3e284686a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:36.262532 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5b9c4-2262-47b8-b7bb-bc3e284686a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:36.262901 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5b9c4-2262-47b8-b7bb-bc3e284686a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:36.274019 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd5b9c4-2262-47b8-b7bb-bc3e284686a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:36.275509 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd5b9c4-2262-47b8-b7bb-bc3e284686a7 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:36.286295 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1360/2718] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:44:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:44:36.310364 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4911c21-e09d-4751-b437-a3384c2a2c22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:36.312696 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4911c21-e09d-4751-b437-a3384c2a2c22 service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:36.323413 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1359/2719] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:44:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:44:37.016494 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39bb49-57b2-4fb9-a2db-c8f2bb68e94c None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:37.017135 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39bb49-57b2-4fb9-a2db-c8f2bb68e94c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:37.017681 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39bb49-57b2-4fb9-a2db-c8f2bb68e94c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:37.055320 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-9d39bb49-57b2-4fb9-a2db-c8f2bb68e94c None None] MFA Rules not processed for user `fc9b535a7caf49699b4c22f9174c486d`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:37.056668 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9d39bb49-57b2-4fb9-a2db-c8f2bb68e94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:37.126429 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1361/2720] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:44:37 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:37.131020 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4911c21-e09d-4751-b437-a3384c2a2c22 service cinder] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:37.142722 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4911c21-e09d-4751-b437-a3384c2a2c22 service cinder] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:37.147550 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd0ae9f-0e8a-4934-bf37-29bf59978707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:37.148192 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd0ae9f-0e8a-4934-bf37-29bf59978707 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:37.148473 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd0ae9f-0e8a-4934-bf37-29bf59978707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:37.148744 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd0ae9f-0e8a-4934-bf37-29bf59978707 admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:37.149478 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd0ae9f-0e8a-4934-bf37-29bf59978707 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:37.151365 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd0ae9f-0e8a-4934-bf37-29bf59978707 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:37.178867 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1360/2721] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:44:37 2022] POST /identity/v3/projects => generated 403 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:44:37.183297 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d39bb49-57b2-4fb9-a2db-c8f2bb68e94c None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:37.195577 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d39bb49-57b2-4fb9-a2db-c8f2bb68e94c None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:37.258338 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c37997c-e0e9-4d7b-9dfc-1fd5e556107c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:37.259459 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37997c-e0e9-4d7b-9dfc-1fd5e556107c admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:37.259846 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37997c-e0e9-4d7b-9dfc-1fd5e556107c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:37.260293 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37997c-e0e9-4d7b-9dfc-1fd5e556107c admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:37.261609 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c37997c-e0e9-4d7b-9dfc-1fd5e556107c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:37.264341 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c37997c-e0e9-4d7b-9dfc-1fd5e556107c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:37.285851 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1362/2722] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:44:37 2022] POST /identity/v3/users => generated 308 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:44:37.289977 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd0ae9f-0e8a-4934-bf37-29bf59978707 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:37.301113 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd0ae9f-0e8a-4934-bf37-29bf59978707 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:37.305724 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab72063d-5e3c-487a-9c18-6fc1a936a005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:37.306384 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72063d-5e3c-487a-9c18-6fc1a936a005 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:37.306668 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72063d-5e3c-487a-9c18-6fc1a936a005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:37.306944 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72063d-5e3c-487a-9c18-6fc1a936a005 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:37.307676 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab72063d-5e3c-487a-9c18-6fc1a936a005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:37.309306 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab72063d-5e3c-487a-9c18-6fc1a936a005 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:37.320424 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1361/2723] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:44:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:44:37.325012 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c37997c-e0e9-4d7b-9dfc-1fd5e556107c admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:37.335175 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c37997c-e0e9-4d7b-9dfc-1fd5e556107c admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:37.339877 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4659eaf-beb2-4399-9079-bc93373dd0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:37.340773 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4659eaf-beb2-4399-9079-bc93373dd0fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:37.341091 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4659eaf-beb2-4399-9079-bc93373dd0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:37.341370 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4659eaf-beb2-4399-9079-bc93373dd0fc admin admin] PATH_INFO: `/v3/projects/fa03312f2ed4482b96d8808c9f15be37/users/06b826bf89c5434cb8fa514c0347e913/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:37.357652 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4659eaf-beb2-4399-9079-bc93373dd0fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa03312f2ed4482b96d8808c9f15be37, user_id=06b826bf89c5434cb8fa514c0347e913, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:37.361161 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4659eaf-beb2-4399-9079-bc93373dd0fc admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:37.376146 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1363/2724] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:44:37 2022] PUT /identity/v3/projects/fa03312f2ed4482b96d8808c9f15be37/users/06b826bf89c5434cb8fa514c0347e913/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:37.380335 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab72063d-5e3c-487a-9c18-6fc1a936a005 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:37.391206 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab72063d-5e3c-487a-9c18-6fc1a936a005 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:37.412700 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:37.452190 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da11009a-3a67-43c3-bd69-e31a312b4cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:37.452975 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11009a-3a67-43c3-bd69-e31a312b4cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:37.453262 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11009a-3a67-43c3-bd69-e31a312b4cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:37.453545 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11009a-3a67-43c3-bd69-e31a312b4cc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:37.454278 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da11009a-3a67-43c3-bd69-e31a312b4cc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:37.455881 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da11009a-3a67-43c3-bd69-e31a312b4cc5 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:37.466166 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1362/2725] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:44:37 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:44:37.470955 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4659eaf-beb2-4399-9079-bc93373dd0fc admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:37.482341 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4659eaf-beb2-4399-9079-bc93373dd0fc admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:37.488227 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5bbb5c-ce6b-447f-8f0b-0826307f5f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:37.489199 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bbb5c-ce6b-447f-8f0b-0826307f5f6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:37.489487 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bbb5c-ce6b-447f-8f0b-0826307f5f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:37.489766 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bbb5c-ce6b-447f-8f0b-0826307f5f6b admin admin] PATH_INFO: `/v3/projects/fa03312f2ed4482b96d8808c9f15be37/users/06b826bf89c5434cb8fa514c0347e913/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:37.491798 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5bbb5c-ce6b-447f-8f0b-0826307f5f6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa03312f2ed4482b96d8808c9f15be37, user_id=06b826bf89c5434cb8fa514c0347e913, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:37.494520 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5bbb5c-ce6b-447f-8f0b-0826307f5f6b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:37.506548 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1364/2726] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:44:37 2022] PUT /identity/v3/projects/fa03312f2ed4482b96d8808c9f15be37/users/06b826bf89c5434cb8fa514c0347e913/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:37.750280 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f484b7-2ac8-434f-ab3c-bd34a2f50219 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:37.750645 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f484b7-2ac8-434f-ab3c-bd34a2f50219 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:37.751039 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f484b7-2ac8-434f-ab3c-bd34a2f50219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:37.770015 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-05f484b7-2ac8-434f-ab3c-bd34a2f50219 None None] MFA Rules not processed for user `6eb8b883e2a84b59815da4a5200a60e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:37.771479 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-05f484b7-2ac8-434f-ab3c-bd34a2f50219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:37.833647 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1363/2727] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:44:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:38.397473 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301153a-5343-4464-83fb-a3e98d78ee28 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:38.398096 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301153a-5343-4464-83fb-a3e98d78ee28 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:38.398272 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301153a-5343-4464-83fb-a3e98d78ee28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:38.431105 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b301153a-5343-4464-83fb-a3e98d78ee28 None None] MFA Rules not processed for user `06b826bf89c5434cb8fa514c0347e913`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:38.432426 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b301153a-5343-4464-83fb-a3e98d78ee28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:38.452621 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:38.531405 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1365/2728] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:44:38 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:39.998672 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f484b7-2ac8-434f-ab3c-bd34a2f50219 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:40.067236 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f484b7-2ac8-434f-ab3c-bd34a2f50219 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:40.072086 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3edb1a-2b64-4f01-a9e4-7f56f5c98251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:40.073386 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3edb1a-2b64-4f01-a9e4-7f56f5c98251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:40.073386 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3edb1a-2b64-4f01-a9e4-7f56f5c98251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:40.073625 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3edb1a-2b64-4f01-a9e4-7f56f5c98251 admin admin] PATH_INFO: `/v3/users/fc9b535a7caf49699b4c22f9174c486d` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:40.074735 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3edb1a-2b64-4f01-a9e4-7f56f5c98251 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc9b535a7caf49699b4c22f9174c486d)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:40.076651 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3edb1a-2b64-4f01-a9e4-7f56f5c98251 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:40.140414 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-0d3edb1a-2b64-4f01-a9e4-7f56f5c98251 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc9b535a7caf49699b4c22f9174c486d'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:40.141187 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-0d3edb1a-2b64-4f01-a9e4-7f56f5c98251 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc9b535a7caf49699b4c22f9174c486d'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:40.141893 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-0d3edb1a-2b64-4f01-a9e4-7f56f5c98251 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc9b535a7caf49699b4c22f9174c486d'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:40.150057 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-0d3edb1a-2b64-4f01-a9e4-7f56f5c98251 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc9b535a7caf49699b4c22f9174c486d'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:40.168049 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:40.171178 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-0d3edb1a-2b64-4f01-a9e4-7f56f5c98251 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc9b535a7caf49699b4c22f9174c486d'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:40.189408 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1364/2729] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:44:39 2022] DELETE /identity/v3/users/fc9b535a7caf49699b4c22f9174c486d => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:40.399327 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b301153a-5343-4464-83fb-a3e98d78ee28 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:40.417943 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b301153a-5343-4464-83fb-a3e98d78ee28 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:40.490717 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207744d6-3f9f-4b85-851a-249d6e93a5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:40.491636 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207744d6-3f9f-4b85-851a-249d6e93a5ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:40.491925 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207744d6-3f9f-4b85-851a-249d6e93a5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:40.492207 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207744d6-3f9f-4b85-851a-249d6e93a5ec admin admin] PATH_INFO: `/v3/projects/57f5295c9e64468e8247883795259635` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:40.493488 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207744d6-3f9f-4b85-851a-249d6e93a5ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=57f5295c9e64468e8247883795259635)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:40.495495 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207744d6-3f9f-4b85-851a-249d6e93a5ec admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:40.549619 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-207744d6-3f9f-4b85-851a-249d6e93a5ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57f5295c9e64468e8247883795259635', 'request_id': 'req-207744d6-3f9f-4b85-851a-249d6e93a5ec'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:40.555443 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-207744d6-3f9f-4b85-851a-249d6e93a5ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57f5295c9e64468e8247883795259635', 'request_id': 'req-207744d6-3f9f-4b85-851a-249d6e93a5ec'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:40.562922 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-207744d6-3f9f-4b85-851a-249d6e93a5ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57f5295c9e64468e8247883795259635', 'request_id': 'req-207744d6-3f9f-4b85-851a-249d6e93a5ec'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:40.576540 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-207744d6-3f9f-4b85-851a-249d6e93a5ec admin admin] The token cache is being invalidate because project 57f5295c9e64468e8247883795259635 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:44:40.576983 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-207744d6-3f9f-4b85-851a-249d6e93a5ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:40.577761 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-207744d6-3f9f-4b85-851a-249d6e93a5ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:40.579730 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1366/2730] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:44:40 2022] DELETE /identity/v3/projects/57f5295c9e64468e8247883795259635 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:40.584458 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3edb1a-2b64-4f01-a9e4-7f56f5c98251 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:40.585973 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-0d3edb1a-2b64-4f01-a9e4-7f56f5c98251 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:40.603626 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3edb1a-2b64-4f01-a9e4-7f56f5c98251 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:40.715112 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab7568-a7a6-4b57-b66c-28e74c7a763d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:40.716012 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab7568-a7a6-4b57-b66c-28e74c7a763d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:40.716296 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab7568-a7a6-4b57-b66c-28e74c7a763d admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:40.716569 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab7568-a7a6-4b57-b66c-28e74c7a763d admin admin] PATH_INFO: `/v3/users/06b826bf89c5434cb8fa514c0347e913` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:40.717974 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab7568-a7a6-4b57-b66c-28e74c7a763d admin admin] RBAC: Authorizing `identity:delete_user(user_id=06b826bf89c5434cb8fa514c0347e913)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:40.720137 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab7568-a7a6-4b57-b66c-28e74c7a763d admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:40.792235 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-a5ab7568-a7a6-4b57-b66c-28e74c7a763d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06b826bf89c5434cb8fa514c0347e913'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:40.793029 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-a5ab7568-a7a6-4b57-b66c-28e74c7a763d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06b826bf89c5434cb8fa514c0347e913'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:40.793763 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-a5ab7568-a7a6-4b57-b66c-28e74c7a763d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06b826bf89c5434cb8fa514c0347e913'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:40.810887 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-a5ab7568-a7a6-4b57-b66c-28e74c7a763d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06b826bf89c5434cb8fa514c0347e913'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:40.831251 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-a5ab7568-a7a6-4b57-b66c-28e74c7a763d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06b826bf89c5434cb8fa514c0347e913'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:40.854579 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1365/2731] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:44:40 2022] DELETE /identity/v3/users/06b826bf89c5434cb8fa514c0347e913 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:41.066181 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207744d6-3f9f-4b85-851a-249d6e93a5ec admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:41.068139 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-207744d6-3f9f-4b85-851a-249d6e93a5ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:41.088797 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207744d6-3f9f-4b85-851a-249d6e93a5ec admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:41.145708 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:41.168163 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfab3bb-0d30-45b1-a6d1-17efb4c87420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:41.169294 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfab3bb-0d30-45b1-a6d1-17efb4c87420 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:41.169682 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfab3bb-0d30-45b1-a6d1-17efb4c87420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:41.170060 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfab3bb-0d30-45b1-a6d1-17efb4c87420 admin admin] PATH_INFO: `/v3/projects/fa03312f2ed4482b96d8808c9f15be37` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:41.171990 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfab3bb-0d30-45b1-a6d1-17efb4c87420 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa03312f2ed4482b96d8808c9f15be37)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:41.174502 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfab3bb-0d30-45b1-a6d1-17efb4c87420 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:41.243297 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7dfab3bb-0d30-45b1-a6d1-17efb4c87420 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa03312f2ed4482b96d8808c9f15be37', 'request_id': 'req-7dfab3bb-0d30-45b1-a6d1-17efb4c87420'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:41.254017 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7dfab3bb-0d30-45b1-a6d1-17efb4c87420 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa03312f2ed4482b96d8808c9f15be37', 'request_id': 'req-7dfab3bb-0d30-45b1-a6d1-17efb4c87420'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:41.267392 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7dfab3bb-0d30-45b1-a6d1-17efb4c87420 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa03312f2ed4482b96d8808c9f15be37', 'request_id': 'req-7dfab3bb-0d30-45b1-a6d1-17efb4c87420'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:41.292046 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7dfab3bb-0d30-45b1-a6d1-17efb4c87420 admin admin] The token cache is being invalidate because project fa03312f2ed4482b96d8808c9f15be37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:44:41.292475 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7dfab3bb-0d30-45b1-a6d1-17efb4c87420 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:41.294146 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7dfab3bb-0d30-45b1-a6d1-17efb4c87420 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:41.298074 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1367/2732] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:44:41 2022] DELETE /identity/v3/projects/fa03312f2ed4482b96d8808c9f15be37 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:41.303391 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641fa5fd-3bf2-4cd5-9c9a-8e7c6eeb779a None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:41.303893 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641fa5fd-3bf2-4cd5-9c9a-8e7c6eeb779a None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:41.304446 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641fa5fd-3bf2-4cd5-9c9a-8e7c6eeb779a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:41.325877 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-641fa5fd-3bf2-4cd5-9c9a-8e7c6eeb779a None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:41.327031 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-641fa5fd-3bf2-4cd5-9c9a-8e7c6eeb779a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:41.438845 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1366/2733] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:44:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:41.446820 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e749cdc8-4807-4f61-a69b-b9a781a16d7b None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:41.447390 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e749cdc8-4807-4f61-a69b-b9a781a16d7b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:41.447390 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e749cdc8-4807-4f61-a69b-b9a781a16d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:41.470666 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-e749cdc8-4807-4f61-a69b-b9a781a16d7b None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:41.472099 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e749cdc8-4807-4f61-a69b-b9a781a16d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:41.481123 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1368/2734] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:44:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:41.485783 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641fa5fd-3bf2-4cd5-9c9a-8e7c6eeb779a None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:41.494177 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:41.502043 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641fa5fd-3bf2-4cd5-9c9a-8e7c6eeb779a None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:41.510435 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c1ee6b-a6df-4b78-a546-f9ea2fc7779f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:41.511121 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1ee6b-a6df-4b78-a546-f9ea2fc7779f admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:41.512077 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1ee6b-a6df-4b78-a546-f9ea2fc7779f admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:41.512559 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1ee6b-a6df-4b78-a546-f9ea2fc7779f admin admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:41.513704 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c1ee6b-a6df-4b78-a546-f9ea2fc7779f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:44:41.514074 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c1ee6b-a6df-4b78-a546-f9ea2fc7779f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:41.516377 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c1ee6b-a6df-4b78-a546-f9ea2fc7779f admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:41.532900 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1367/2735] 10.222.0.16 () {58 vars in 1152 bytes} [Thu May 26 12:44:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:44:41.535463 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e749cdc8-4807-4f61-a69b-b9a781a16d7b None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:41.547169 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e749cdc8-4807-4f61-a69b-b9a781a16d7b None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:41.553478 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f309e7c-0886-4f1a-9700-34046e1a4624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:41.554428 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f309e7c-0886-4f1a-9700-34046e1a4624 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:41.554713 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f309e7c-0886-4f1a-9700-34046e1a4624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:41.554987 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f309e7c-0886-4f1a-9700-34046e1a4624 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:41.557425 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f309e7c-0886-4f1a-9700-34046e1a4624 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:41.558295 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f309e7c-0886-4f1a-9700-34046e1a4624 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:41.587749 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1369/2736] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:44:41 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:44:41.591972 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c1ee6b-a6df-4b78-a546-f9ea2fc7779f admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:41.602844 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c1ee6b-a6df-4b78-a546-f9ea2fc7779f admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:41.670339 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1522a24-d3e4-48e2-b8e3-9caba15e4f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:41.670956 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1522a24-d3e4-48e2-b8e3-9caba15e4f03 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:41.671339 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1522a24-d3e4-48e2-b8e3-9caba15e4f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:41.671718 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1522a24-d3e4-48e2-b8e3-9caba15e4f03 admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:41.672518 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1522a24-d3e4-48e2-b8e3-9caba15e4f03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:41.674783 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1522a24-d3e4-48e2-b8e3-9caba15e4f03 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:41.699889 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1368/2737] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:44:41 2022] POST /identity/v3/users => generated 286 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:44:41.704479 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f309e7c-0886-4f1a-9700-34046e1a4624 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:41.724986 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f309e7c-0886-4f1a-9700-34046e1a4624 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:41.731572 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32cdd3-29b7-4640-a21c-2ee790341f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:41.732561 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32cdd3-29b7-4640-a21c-2ee790341f53 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:41.732988 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32cdd3-29b7-4640-a21c-2ee790341f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:41.734014 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32cdd3-29b7-4640-a21c-2ee790341f53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:41.734875 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd32cdd3-29b7-4640-a21c-2ee790341f53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:41.736805 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd32cdd3-29b7-4640-a21c-2ee790341f53 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:41.756707 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1370/2738] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:44:41.760419 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1522a24-d3e4-48e2-b8e3-9caba15e4f03 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:41.771654 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1522a24-d3e4-48e2-b8e3-9caba15e4f03 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:41.776501 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a4ac1-893c-46e6-8903-864e3b5dd96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:41.777230 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a4ac1-893c-46e6-8903-864e3b5dd96f admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:41.777514 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a4ac1-893c-46e6-8903-864e3b5dd96f admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:41.777816 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a4ac1-893c-46e6-8903-864e3b5dd96f admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:41.778578 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a4ac1-893c-46e6-8903-864e3b5dd96f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:41.780168 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a4ac1-893c-46e6-8903-864e3b5dd96f admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:41.791008 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1369/2739] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:44:41.795272 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32cdd3-29b7-4640-a21c-2ee790341f53 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:41.806525 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32cdd3-29b7-4640-a21c-2ee790341f53 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:41.812539 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793938bb-9751-4e7a-9f6b-4d79aab483e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:41.813626 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793938bb-9751-4e7a-9f6b-4d79aab483e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:41.813909 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793938bb-9751-4e7a-9f6b-4d79aab483e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:41.814188 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793938bb-9751-4e7a-9f6b-4d79aab483e1 admin admin] PATH_INFO: `/v3/projects/2c3924a41dab4148bad7b53872f2b57b/users/e384f0ef36a641b4876e2d6f2ff6208c/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:41.847613 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793938bb-9751-4e7a-9f6b-4d79aab483e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c3924a41dab4148bad7b53872f2b57b, user_id=e384f0ef36a641b4876e2d6f2ff6208c, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:41.850407 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793938bb-9751-4e7a-9f6b-4d79aab483e1 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:41.866408 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1371/2740] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:44:41 2022] PUT /identity/v3/projects/2c3924a41dab4148bad7b53872f2b57b/users/e384f0ef36a641b4876e2d6f2ff6208c/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:41.878675 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13043e16-aaea-433c-b523-a04d591d4f11 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:41.878981 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13043e16-aaea-433c-b523-a04d591d4f11 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:41.879246 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13043e16-aaea-433c-b523-a04d591d4f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:41.889397 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793938bb-9751-4e7a-9f6b-4d79aab483e1 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:41.892379 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-793938bb-9751-4e7a-9f6b-4d79aab483e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:41.908931 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-13043e16-aaea-433c-b523-a04d591d4f11 None None] MFA Rules not processed for user `e384f0ef36a641b4876e2d6f2ff6208c`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:41.910128 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-13043e16-aaea-433c-b523-a04d591d4f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:41.954111 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793938bb-9751-4e7a-9f6b-4d79aab483e1 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:41.959001 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e88b56-b86a-43dc-a2cc-48737f48e768 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:41.959662 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e88b56-b86a-43dc-a2cc-48737f48e768 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:41.959948 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e88b56-b86a-43dc-a2cc-48737f48e768 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:41.960251 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e88b56-b86a-43dc-a2cc-48737f48e768 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:41.962133 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-71e88b56-b86a-43dc-a2cc-48737f48e768 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:41.977498 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1370/2741] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:44:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:41.982169 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13043e16-aaea-433c-b523-a04d591d4f11 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:41.996483 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:42.053215 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e88b56-b86a-43dc-a2cc-48737f48e768 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:42.054673 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e88b56-b86a-43dc-a2cc-48737f48e768 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:42.059087 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13043e16-aaea-433c-b523-a04d591d4f11 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:42.063849 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0720b-4b11-4678-a2ae-abbdeb6c258a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:42.064507 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0720b-4b11-4678-a2ae-abbdeb6c258a admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:42.064791 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0720b-4b11-4678-a2ae-abbdeb6c258a admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:42.065104 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0720b-4b11-4678-a2ae-abbdeb6c258a admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:42.065810 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b0720b-4b11-4678-a2ae-abbdeb6c258a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:42.067322 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1372/2742] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:44:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:44:42.067706 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b0720b-4b11-4678-a2ae-abbdeb6c258a admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:42.071184 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:42.107684 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1371/2743] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:44:41 2022] POST /identity/v3/projects => generated 373 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:44:42.108863 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e88b56-b86a-43dc-a2cc-48737f48e768 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:42.119689 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e88b56-b86a-43dc-a2cc-48737f48e768 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:42.185064 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48706c31-8e05-4edf-944b-01101dc837e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:42.185742 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48706c31-8e05-4edf-944b-01101dc837e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:42.186008 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48706c31-8e05-4edf-944b-01101dc837e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:42.186280 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48706c31-8e05-4edf-944b-01101dc837e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:42.187592 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48706c31-8e05-4edf-944b-01101dc837e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:42.189605 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48706c31-8e05-4edf-944b-01101dc837e7 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:42.209733 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1373/2744] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:44:42 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:44:42.213481 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0720b-4b11-4678-a2ae-abbdeb6c258a admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:42.223902 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0720b-4b11-4678-a2ae-abbdeb6c258a admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:42.228488 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131534bb-ac18-42dd-9c03-b4df63b184cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:42.229173 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131534bb-ac18-42dd-9c03-b4df63b184cd admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:42.229454 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131534bb-ac18-42dd-9c03-b4df63b184cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:42.229728 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131534bb-ac18-42dd-9c03-b4df63b184cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:42.230465 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131534bb-ac18-42dd-9c03-b4df63b184cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:42.232059 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131534bb-ac18-42dd-9c03-b4df63b184cd admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:42.242666 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1372/2745] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:44:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:44:42.246779 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48706c31-8e05-4edf-944b-01101dc837e7 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:42.257601 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48706c31-8e05-4edf-944b-01101dc837e7 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:42.262289 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a827046-c418-41c2-ba2a-aef27ff30c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:42.263161 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a827046-c418-41c2-ba2a-aef27ff30c2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:42.263439 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a827046-c418-41c2-ba2a-aef27ff30c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:42.263712 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a827046-c418-41c2-ba2a-aef27ff30c2e admin admin] PATH_INFO: `/v3/projects/81833e388ffc45459bb66566aa918789/users/02111aefb5f5400b8c59eb4086719b90/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:42.278430 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a827046-c418-41c2-ba2a-aef27ff30c2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=81833e388ffc45459bb66566aa918789, user_id=02111aefb5f5400b8c59eb4086719b90, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:42.281192 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a827046-c418-41c2-ba2a-aef27ff30c2e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:42.298165 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1374/2746] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:44:42 2022] PUT /identity/v3/projects/81833e388ffc45459bb66566aa918789/users/02111aefb5f5400b8c59eb4086719b90/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:42.303881 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131534bb-ac18-42dd-9c03-b4df63b184cd admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:42.315104 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131534bb-ac18-42dd-9c03-b4df63b184cd admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:42.379287 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a19fe4-7e51-454d-85be-321e9b521e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:42.379945 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a19fe4-7e51-454d-85be-321e9b521e91 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:42.380234 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a19fe4-7e51-454d-85be-321e9b521e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:42.380580 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a19fe4-7e51-454d-85be-321e9b521e91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:42.381496 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a19fe4-7e51-454d-85be-321e9b521e91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:42.383193 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a19fe4-7e51-454d-85be-321e9b521e91 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:42.396973 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1373/2747] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:44:42 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:44:42.401320 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a827046-c418-41c2-ba2a-aef27ff30c2e admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:42.412787 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a827046-c418-41c2-ba2a-aef27ff30c2e admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:42.417496 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d36308-de45-4576-9157-ba701e157c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:42.418387 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d36308-de45-4576-9157-ba701e157c59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:42.418673 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d36308-de45-4576-9157-ba701e157c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:42.418954 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d36308-de45-4576-9157-ba701e157c59 admin admin] PATH_INFO: `/v3/projects/81833e388ffc45459bb66566aa918789/users/02111aefb5f5400b8c59eb4086719b90/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:42.421847 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d36308-de45-4576-9157-ba701e157c59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81833e388ffc45459bb66566aa918789, user_id=02111aefb5f5400b8c59eb4086719b90, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:42.424508 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d36308-de45-4576-9157-ba701e157c59 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:42.436780 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1375/2748] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:44:42 2022] PUT /identity/v3/projects/81833e388ffc45459bb66566aa918789/users/02111aefb5f5400b8c59eb4086719b90/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:42.447278 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315327fc-68e8-43b3-ad27-680125e430bb None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:42.447602 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315327fc-68e8-43b3-ad27-680125e430bb None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:42.447925 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315327fc-68e8-43b3-ad27-680125e430bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:42.480611 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-315327fc-68e8-43b3-ad27-680125e430bb None None] MFA Rules not processed for user `02111aefb5f5400b8c59eb4086719b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:42.482034 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-315327fc-68e8-43b3-ad27-680125e430bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:42.584666 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1374/2749] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:44:42 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:42.593530 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d36308-de45-4576-9157-ba701e157c59 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:42.595621 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-50d36308-de45-4576-9157-ba701e157c59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:42.656470 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d36308-de45-4576-9157-ba701e157c59 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:42.660263 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f8a8e2-dee2-4a64-901a-9ab575d8781f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:42.661188 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f8a8e2-dee2-4a64-901a-9ab575d8781f service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:42.661479 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f8a8e2-dee2-4a64-901a-9ab575d8781f service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:42.661766 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f8a8e2-dee2-4a64-901a-9ab575d8781f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:42.671343 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f8a8e2-dee2-4a64-901a-9ab575d8781f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:42.672796 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f8a8e2-dee2-4a64-901a-9ab575d8781f service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:42.682368 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1376/2750] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:44:42 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:44:43.055877 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315327fc-68e8-43b3-ad27-680125e430bb None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:43.114316 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:43.120789 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315327fc-68e8-43b3-ad27-680125e430bb None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:43.125811 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e53dc5e-a364-40e1-895e-836ed8651353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:43.126668 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53dc5e-a364-40e1-895e-836ed8651353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:43.126952 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53dc5e-a364-40e1-895e-836ed8651353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:43.127230 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53dc5e-a364-40e1-895e-836ed8651353 admin admin] PATH_INFO: `/v3/users/e384f0ef36a641b4876e2d6f2ff6208c` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:43.128459 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e53dc5e-a364-40e1-895e-836ed8651353 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e384f0ef36a641b4876e2d6f2ff6208c)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:43.130440 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e53dc5e-a364-40e1-895e-836ed8651353 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:43.179371 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-5e53dc5e-a364-40e1-895e-836ed8651353 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e384f0ef36a641b4876e2d6f2ff6208c'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:43.180078 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-5e53dc5e-a364-40e1-895e-836ed8651353 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e384f0ef36a641b4876e2d6f2ff6208c'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:43.180710 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-5e53dc5e-a364-40e1-895e-836ed8651353 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e384f0ef36a641b4876e2d6f2ff6208c'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:43.189444 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-5e53dc5e-a364-40e1-895e-836ed8651353 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e384f0ef36a641b4876e2d6f2ff6208c'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:43.206985 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-5e53dc5e-a364-40e1-895e-836ed8651353 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e384f0ef36a641b4876e2d6f2ff6208c'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:43.221893 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1375/2751] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:44:43 2022] DELETE /identity/v3/users/e384f0ef36a641b4876e2d6f2ff6208c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:44:43.226617 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe94c1-7923-474f-8e2f-5dab64435c6f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:43.226928 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe94c1-7923-474f-8e2f-5dab64435c6f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:43.227206 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe94c1-7923-474f-8e2f-5dab64435c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:43.244542 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:43.252526 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-adfe94c1-7923-474f-8e2f-5dab64435c6f None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:43.253992 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-adfe94c1-7923-474f-8e2f-5dab64435c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:43.327955 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1377/2752] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:44:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:44:43.338227 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e53dc5e-a364-40e1-895e-836ed8651353 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:43.339829 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-5e53dc5e-a364-40e1-895e-836ed8651353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:43.404357 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e53dc5e-a364-40e1-895e-836ed8651353 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:43.408862 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6c1a3-0a68-4556-96e0-d6c7503077ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:43.409543 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6c1a3-0a68-4556-96e0-d6c7503077ef service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:43.409828 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6c1a3-0a68-4556-96e0-d6c7503077ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:43.410106 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6c1a3-0a68-4556-96e0-d6c7503077ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:43.420244 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a6c1a3-0a68-4556-96e0-d6c7503077ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:43.422343 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a6c1a3-0a68-4556-96e0-d6c7503077ef service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:43.433084 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1376/2753] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:44:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:44:43.777642 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfe94c1-7923-474f-8e2f-5dab64435c6f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:43.780033 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-adfe94c1-7923-474f-8e2f-5dab64435c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:43.801192 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfe94c1-7923-474f-8e2f-5dab64435c6f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:43.810378 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5868bf-9b81-4ff6-a183-36652c0955a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:43.811298 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5868bf-9b81-4ff6-a183-36652c0955a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:43.811579 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5868bf-9b81-4ff6-a183-36652c0955a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:43.812421 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5868bf-9b81-4ff6-a183-36652c0955a8 admin admin] PATH_INFO: `/v3/projects/2c3924a41dab4148bad7b53872f2b57b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:43.814970 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5868bf-9b81-4ff6-a183-36652c0955a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c3924a41dab4148bad7b53872f2b57b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:43.818801 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5868bf-9b81-4ff6-a183-36652c0955a8 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:43.889621 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ed5868bf-9b81-4ff6-a183-36652c0955a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c3924a41dab4148bad7b53872f2b57b', 'request_id': 'req-ed5868bf-9b81-4ff6-a183-36652c0955a8'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:43.896505 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ed5868bf-9b81-4ff6-a183-36652c0955a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c3924a41dab4148bad7b53872f2b57b', 'request_id': 'req-ed5868bf-9b81-4ff6-a183-36652c0955a8'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:43.902930 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ed5868bf-9b81-4ff6-a183-36652c0955a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c3924a41dab4148bad7b53872f2b57b', 'request_id': 'req-ed5868bf-9b81-4ff6-a183-36652c0955a8'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:43.917574 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ed5868bf-9b81-4ff6-a183-36652c0955a8 admin admin] The token cache is being invalidate because project 2c3924a41dab4148bad7b53872f2b57b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:44:43.917875 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ed5868bf-9b81-4ff6-a183-36652c0955a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:43.918526 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ed5868bf-9b81-4ff6-a183-36652c0955a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:43.920088 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1378/2754] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:44:43 2022] DELETE /identity/v3/projects/2c3924a41dab4148bad7b53872f2b57b => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:43.924250 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6c1a3-0a68-4556-96e0-d6c7503077ef service neutron] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:43.934158 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6c1a3-0a68-4556-96e0-d6c7503077ef service neutron] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:43.996105 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e285bb-d6a1-42e7-b976-d1909527f1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:43.997277 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e285bb-d6a1-42e7-b976-d1909527f1d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:43.997558 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e285bb-d6a1-42e7-b976-d1909527f1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:43.997830 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e285bb-d6a1-42e7-b976-d1909527f1d4 admin admin] PATH_INFO: `/v3/users/02111aefb5f5400b8c59eb4086719b90` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:43.999062 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e285bb-d6a1-42e7-b976-d1909527f1d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02111aefb5f5400b8c59eb4086719b90)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:44.001599 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e285bb-d6a1-42e7-b976-d1909527f1d4 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:44.025420 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:44.057950 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-80e285bb-d6a1-42e7-b976-d1909527f1d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02111aefb5f5400b8c59eb4086719b90'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:44.058682 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-80e285bb-d6a1-42e7-b976-d1909527f1d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02111aefb5f5400b8c59eb4086719b90'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:44.059282 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-80e285bb-d6a1-42e7-b976-d1909527f1d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02111aefb5f5400b8c59eb4086719b90'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:44.069222 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-80e285bb-d6a1-42e7-b976-d1909527f1d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02111aefb5f5400b8c59eb4086719b90'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:44.084431 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-80e285bb-d6a1-42e7-b976-d1909527f1d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02111aefb5f5400b8c59eb4086719b90'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:44.098253 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1377/2755] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:44:43 2022] DELETE /identity/v3/users/02111aefb5f5400b8c59eb4086719b90 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:44.379093 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5868bf-9b81-4ff6-a183-36652c0955a8 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:44.380636 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ed5868bf-9b81-4ff6-a183-36652c0955a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:44.395008 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5868bf-9b81-4ff6-a183-36652c0955a8 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:44.462572 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5005daef-7507-4a25-867b-5d3f5a4aa9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:44.463355 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005daef-7507-4a25-867b-5d3f5a4aa9d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:44.463638 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005daef-7507-4a25-867b-5d3f5a4aa9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:44.463914 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005daef-7507-4a25-867b-5d3f5a4aa9d2 admin admin] PATH_INFO: `/v3/projects/81833e388ffc45459bb66566aa918789` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:44.465192 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5005daef-7507-4a25-867b-5d3f5a4aa9d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81833e388ffc45459bb66566aa918789)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:44.467117 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5005daef-7507-4a25-867b-5d3f5a4aa9d2 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:44.502578 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:44.515435 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5005daef-7507-4a25-867b-5d3f5a4aa9d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81833e388ffc45459bb66566aa918789', 'request_id': 'req-5005daef-7507-4a25-867b-5d3f5a4aa9d2'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:44.520794 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5005daef-7507-4a25-867b-5d3f5a4aa9d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81833e388ffc45459bb66566aa918789', 'request_id': 'req-5005daef-7507-4a25-867b-5d3f5a4aa9d2'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:44.526935 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5005daef-7507-4a25-867b-5d3f5a4aa9d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81833e388ffc45459bb66566aa918789', 'request_id': 'req-5005daef-7507-4a25-867b-5d3f5a4aa9d2'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:44.539807 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5005daef-7507-4a25-867b-5d3f5a4aa9d2 admin admin] The token cache is being invalidate because project 81833e388ffc45459bb66566aa918789 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:44:44.540092 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5005daef-7507-4a25-867b-5d3f5a4aa9d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:44.540704 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5005daef-7507-4a25-867b-5d3f5a4aa9d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:44.542264 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1379/2756] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:44:44 2022] DELETE /identity/v3/projects/81833e388ffc45459bb66566aa918789 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:44.547820 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7234d-7c08-4a5b-939f-95d45614b236 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:44.548342 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7234d-7c08-4a5b-939f-95d45614b236 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:44.548444 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7234d-7c08-4a5b-939f-95d45614b236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:44.566590 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-7fb7234d-7c08-4a5b-939f-95d45614b236 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:44.567812 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-7fb7234d-7c08-4a5b-939f-95d45614b236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:44.628173 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1378/2757] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:44:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:44.636142 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84cbf5-bd64-4090-9199-9658212b3221 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:44.636540 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84cbf5-bd64-4090-9199-9658212b3221 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:44.636827 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84cbf5-bd64-4090-9199-9658212b3221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:44.654761 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-1b84cbf5-bd64-4090-9199-9658212b3221 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:44.656511 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1b84cbf5-bd64-4090-9199-9658212b3221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:44.665163 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1380/2758] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:44:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:44.669508 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb7234d-7c08-4a5b-939f-95d45614b236 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:44.679927 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb7234d-7c08-4a5b-939f-95d45614b236 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:44.684401 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f83ae82-c749-4d49-b3b6-698c21cdd709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:44.685074 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83ae82-c749-4d49-b3b6-698c21cdd709 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:44.685356 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83ae82-c749-4d49-b3b6-698c21cdd709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:44.685629 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83ae82-c749-4d49-b3b6-698c21cdd709 admin admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:44.686375 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f83ae82-c749-4d49-b3b6-698c21cdd709 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:44:44.686677 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f83ae82-c749-4d49-b3b6-698c21cdd709 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:44.688252 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f83ae82-c749-4d49-b3b6-698c21cdd709 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:44.700585 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1379/2759] 10.222.0.16 () {58 vars in 1152 bytes} [Thu May 26 12:44:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:44:44.705061 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b84cbf5-bd64-4090-9199-9658212b3221 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:44.714475 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b84cbf5-bd64-4090-9199-9658212b3221 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:44.720548 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca546e96-d432-485a-9136-740541432f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:44.721238 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca546e96-d432-485a-9136-740541432f91 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:44.721522 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca546e96-d432-485a-9136-740541432f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:44.722079 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca546e96-d432-485a-9136-740541432f91 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:44.722476 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca546e96-d432-485a-9136-740541432f91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:44.724415 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca546e96-d432-485a-9136-740541432f91 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:44.759397 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1381/2760] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:44:44 2022] POST /identity/v3/projects => generated 369 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:44:44.760390 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f83ae82-c749-4d49-b3b6-698c21cdd709 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:44.770558 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f83ae82-c749-4d49-b3b6-698c21cdd709 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:44.834629 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c9205a-7381-447a-890a-90745f9eceeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:44.835294 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9205a-7381-447a-890a-90745f9eceeb admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:44.835573 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9205a-7381-447a-890a-90745f9eceeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:44.835846 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9205a-7381-447a-890a-90745f9eceeb admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:44.836553 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c9205a-7381-447a-890a-90745f9eceeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:44.838512 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c9205a-7381-447a-890a-90745f9eceeb admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:44.860087 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1380/2761] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:44:44 2022] POST /identity/v3/users => generated 285 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:44:44.864094 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca546e96-d432-485a-9136-740541432f91 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:44.875204 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca546e96-d432-485a-9136-740541432f91 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:44.880301 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ba803-1a7d-4d3b-a287-3dce167743dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:44.881086 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ba803-1a7d-4d3b-a287-3dce167743dd admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:44.881453 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ba803-1a7d-4d3b-a287-3dce167743dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:44.881646 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ba803-1a7d-4d3b-a287-3dce167743dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:44.882383 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68ba803-1a7d-4d3b-a287-3dce167743dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:44.884024 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68ba803-1a7d-4d3b-a287-3dce167743dd admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:44.895648 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1382/2762] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:44:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:44:44.899632 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c9205a-7381-447a-890a-90745f9eceeb admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:44.909910 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c9205a-7381-447a-890a-90745f9eceeb admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:44.914543 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9235715e-c702-4553-9605-fa3bcebc17a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:44.915176 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9235715e-c702-4553-9605-fa3bcebc17a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:44.915464 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9235715e-c702-4553-9605-fa3bcebc17a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:44.915739 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9235715e-c702-4553-9605-fa3bcebc17a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:44.916460 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9235715e-c702-4553-9605-fa3bcebc17a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:44.918105 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9235715e-c702-4553-9605-fa3bcebc17a6 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:44.928285 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1381/2763] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:44:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:44:44.932485 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ba803-1a7d-4d3b-a287-3dce167743dd admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:44.943104 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ba803-1a7d-4d3b-a287-3dce167743dd admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:44.947668 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b4dc24-6755-4eef-b60a-bff84821288e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:44.948550 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4dc24-6755-4eef-b60a-bff84821288e admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:44.948855 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4dc24-6755-4eef-b60a-bff84821288e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:44.949140 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4dc24-6755-4eef-b60a-bff84821288e admin admin] PATH_INFO: `/v3/projects/2707972e782b457fb8e0ff6de6297e52/users/f46587845a9642ceb0695173f4f6431e/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:44.964926 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b4dc24-6755-4eef-b60a-bff84821288e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2707972e782b457fb8e0ff6de6297e52, user_id=f46587845a9642ceb0695173f4f6431e, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:44.967525 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b4dc24-6755-4eef-b60a-bff84821288e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:44.979808 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1383/2764] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:44:44 2022] PUT /identity/v3/projects/2707972e782b457fb8e0ff6de6297e52/users/f46587845a9642ceb0695173f4f6431e/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:44.991149 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f48af12-6c3a-4931-b2fe-df36e32bcd96 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:44.991440 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f48af12-6c3a-4931-b2fe-df36e32bcd96 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:44.991719 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f48af12-6c3a-4931-b2fe-df36e32bcd96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:44.997874 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:45.021518 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-6f48af12-6c3a-4931-b2fe-df36e32bcd96 None None] MFA Rules not processed for user `f46587845a9642ceb0695173f4f6431e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:45.022734 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-6f48af12-6c3a-4931-b2fe-df36e32bcd96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:45.086791 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1382/2765] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:44:44 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:45.091397 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b4dc24-6755-4eef-b60a-bff84821288e admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:45.153162 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b4dc24-6755-4eef-b60a-bff84821288e admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:45.158304 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77052dfc-11ca-4ea1-a1d5-a07f5f594852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:45.158956 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77052dfc-11ca-4ea1-a1d5-a07f5f594852 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:45.159266 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77052dfc-11ca-4ea1-a1d5-a07f5f594852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:45.159539 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77052dfc-11ca-4ea1-a1d5-a07f5f594852 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:45.160227 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77052dfc-11ca-4ea1-a1d5-a07f5f594852 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:45.162167 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77052dfc-11ca-4ea1-a1d5-a07f5f594852 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:45.189222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1384/2766] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:44:45 2022] POST /identity/v3/projects => generated 365 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:44:45.193087 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f48af12-6c3a-4931-b2fe-df36e32bcd96 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:45.204657 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f48af12-6c3a-4931-b2fe-df36e32bcd96 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:45.261923 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58107738-c830-4ad6-9575-400c73e73463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:45.262588 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58107738-c830-4ad6-9575-400c73e73463 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:45.262869 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58107738-c830-4ad6-9575-400c73e73463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:45.263143 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58107738-c830-4ad6-9575-400c73e73463 admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:45.263863 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58107738-c830-4ad6-9575-400c73e73463 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:45.266400 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58107738-c830-4ad6-9575-400c73e73463 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:45.287540 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1383/2767] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:44:45 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:44:45.291601 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77052dfc-11ca-4ea1-a1d5-a07f5f594852 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:45.302489 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77052dfc-11ca-4ea1-a1d5-a07f5f594852 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:45.307385 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59d7f37-bf71-440e-8ce6-fc19aa67d949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:45.308040 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d7f37-bf71-440e-8ce6-fc19aa67d949 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:45.308320 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d7f37-bf71-440e-8ce6-fc19aa67d949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:45.308621 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d7f37-bf71-440e-8ce6-fc19aa67d949 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:45.309377 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59d7f37-bf71-440e-8ce6-fc19aa67d949 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:45.311129 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59d7f37-bf71-440e-8ce6-fc19aa67d949 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:45.322438 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1385/2768] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:44:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:44:45.327731 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58107738-c830-4ad6-9575-400c73e73463 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:45.338307 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58107738-c830-4ad6-9575-400c73e73463 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:45.343831 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19cdeed-7bd7-469c-ae52-5f0d6460c435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:45.344744 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19cdeed-7bd7-469c-ae52-5f0d6460c435 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:45.345100 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19cdeed-7bd7-469c-ae52-5f0d6460c435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:45.345433 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19cdeed-7bd7-469c-ae52-5f0d6460c435 admin admin] PATH_INFO: `/v3/projects/ac5eaac352c94814994ec8dbb0f5ea62/users/56b45133e79b44529e36770a6730dd50/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:45.361494 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19cdeed-7bd7-469c-ae52-5f0d6460c435 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac5eaac352c94814994ec8dbb0f5ea62, user_id=56b45133e79b44529e36770a6730dd50, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:45.364165 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19cdeed-7bd7-469c-ae52-5f0d6460c435 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:45.377847 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1384/2769] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:44:45 2022] PUT /identity/v3/projects/ac5eaac352c94814994ec8dbb0f5ea62/users/56b45133e79b44529e36770a6730dd50/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:44:45.384747 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59d7f37-bf71-440e-8ce6-fc19aa67d949 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:45.395016 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59d7f37-bf71-440e-8ce6-fc19aa67d949 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:45.430670 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:45.461341 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c803fc3-7b83-4f60-974e-e6657354af96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:45.462056 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c803fc3-7b83-4f60-974e-e6657354af96 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:45.462347 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c803fc3-7b83-4f60-974e-e6657354af96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:45.462627 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c803fc3-7b83-4f60-974e-e6657354af96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:45.463372 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c803fc3-7b83-4f60-974e-e6657354af96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:45.465064 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c803fc3-7b83-4f60-974e-e6657354af96 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:45.481507 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1386/2770] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:44:45 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:44:45.486353 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19cdeed-7bd7-469c-ae52-5f0d6460c435 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:45.497820 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19cdeed-7bd7-469c-ae52-5f0d6460c435 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:45.503009 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9dabfe-b2f2-4119-8f20-c6e8758cb734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:45.504049 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9dabfe-b2f2-4119-8f20-c6e8758cb734 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:45.504402 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9dabfe-b2f2-4119-8f20-c6e8758cb734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:45.504748 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9dabfe-b2f2-4119-8f20-c6e8758cb734 admin admin] PATH_INFO: `/v3/projects/ac5eaac352c94814994ec8dbb0f5ea62/users/56b45133e79b44529e36770a6730dd50/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:45.506847 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9dabfe-b2f2-4119-8f20-c6e8758cb734 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac5eaac352c94814994ec8dbb0f5ea62, user_id=56b45133e79b44529e36770a6730dd50, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:45.509609 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9dabfe-b2f2-4119-8f20-c6e8758cb734 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:45.523228 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1385/2771] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:44:45 2022] PUT /identity/v3/projects/ac5eaac352c94814994ec8dbb0f5ea62/users/56b45133e79b44529e36770a6730dd50/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:44:45.531309 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c803fc3-7b83-4f60-974e-e6657354af96 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:45.533077 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8c803fc3-7b83-4f60-974e-e6657354af96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:45.534054 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307eb601-5147-46e0-af74-d1aad24e8fc8 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:45.534347 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307eb601-5147-46e0-af74-d1aad24e8fc8 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:45.534347 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307eb601-5147-46e0-af74-d1aad24e8fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:45.562077 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-307eb601-5147-46e0-af74-d1aad24e8fc8 None None] MFA Rules not processed for user `56b45133e79b44529e36770a6730dd50`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:45.563309 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-307eb601-5147-46e0-af74-d1aad24e8fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:45.596081 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:45.596890 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c803fc3-7b83-4f60-974e-e6657354af96 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:45.635868 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1386/2772] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:44:45 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:44:45.647349 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307eb601-5147-46e0-af74-d1aad24e8fc8 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:45.648889 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-307eb601-5147-46e0-af74-d1aad24e8fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:45.651595 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc650d3-5888-41e9-ad5d-874240caa0d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:45.652244 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc650d3-5888-41e9-ad5d-874240caa0d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:45.652524 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc650d3-5888-41e9-ad5d-874240caa0d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:45.652823 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc650d3-5888-41e9-ad5d-874240caa0d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:45.654712 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-cdc650d3-5888-41e9-ad5d-874240caa0d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:45.661637 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307eb601-5147-46e0-af74-d1aad24e8fc8 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:45.665368 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2bda54-9920-48b8-bafc-c630dea5d5c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:45.666004 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2bda54-9920-48b8-bafc-c630dea5d5c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:45.666271 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2bda54-9920-48b8-bafc-c630dea5d5c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:45.666545 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2bda54-9920-48b8-bafc-c630dea5d5c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:45.676335 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2bda54-9920-48b8-bafc-c630dea5d5c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:45.677788 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2bda54-9920-48b8-bafc-c630dea5d5c9 service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:45.688013 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1387/2773] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:44:45 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:44:45.721686 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc650d3-5888-41e9-ad5d-874240caa0d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:45.723117 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc650d3-5888-41e9-ad5d-874240caa0d3 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:45.731598 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2bda54-9920-48b8-bafc-c630dea5d5c9 service cinder] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:45.733061 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1387/2774] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:44:45 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:44:45.740320 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2bda54-9920-48b8-bafc-c630dea5d5c9 service cinder] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:45.744792 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c021259-928b-4dac-b787-1feb6bf28895 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:45.745893 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c021259-928b-4dac-b787-1feb6bf28895 service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:45.746181 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c021259-928b-4dac-b787-1feb6bf28895 service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:45.746461 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c021259-928b-4dac-b787-1feb6bf28895 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:45.808198 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c021259-928b-4dac-b787-1feb6bf28895 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:45.809753 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c021259-928b-4dac-b787-1feb6bf28895 service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:45.820296 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1388/2775] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:44:45 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:44:45.960598 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc650d3-5888-41e9-ad5d-874240caa0d3 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:45.962555 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-cdc650d3-5888-41e9-ad5d-874240caa0d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:46.005040 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:46.035798 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc650d3-5888-41e9-ad5d-874240caa0d3 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:46.039964 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69aedd0-4a3f-4414-b3d4-9fdbd3c45e4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:46.040668 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69aedd0-4a3f-4414-b3d4-9fdbd3c45e4e service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:46.040971 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69aedd0-4a3f-4414-b3d4-9fdbd3c45e4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:46.041247 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69aedd0-4a3f-4414-b3d4-9fdbd3c45e4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:46.043412 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e69aedd0-4a3f-4414-b3d4-9fdbd3c45e4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:46.172379 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69aedd0-4a3f-4414-b3d4-9fdbd3c45e4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:46.174044 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69aedd0-4a3f-4414-b3d4-9fdbd3c45e4e service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:46.188036 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1388/2776] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:44:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:44:49.270646 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c021259-928b-4dac-b787-1feb6bf28895 service cinder] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:49.358217 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c021259-928b-4dac-b787-1feb6bf28895 service cinder] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:49.364284 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef0aad0-15b7-4388-8d2f-6f5ce8a63281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:49.365392 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0aad0-15b7-4388-8d2f-6f5ce8a63281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:49.365678 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0aad0-15b7-4388-8d2f-6f5ce8a63281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:49.366032 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0aad0-15b7-4388-8d2f-6f5ce8a63281 admin admin] PATH_INFO: `/v3/users/f46587845a9642ceb0695173f4f6431e` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:49.367268 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef0aad0-15b7-4388-8d2f-6f5ce8a63281 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f46587845a9642ceb0695173f4f6431e)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:49.369494 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef0aad0-15b7-4388-8d2f-6f5ce8a63281 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:49.423939 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-7ef0aad0-15b7-4388-8d2f-6f5ce8a63281 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f46587845a9642ceb0695173f4f6431e'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:49.424870 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-7ef0aad0-15b7-4388-8d2f-6f5ce8a63281 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f46587845a9642ceb0695173f4f6431e'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:49.425542 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-7ef0aad0-15b7-4388-8d2f-6f5ce8a63281 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f46587845a9642ceb0695173f4f6431e'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:49.433562 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-7ef0aad0-15b7-4388-8d2f-6f5ce8a63281 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f46587845a9642ceb0695173f4f6431e'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:49.435813 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:49.448290 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-7ef0aad0-15b7-4388-8d2f-6f5ce8a63281 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f46587845a9642ceb0695173f4f6431e'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:49.460600 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1389/2777] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:44:49 2022] DELETE /identity/v3/users/f46587845a9642ceb0695173f4f6431e => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:49.465156 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785bd8b-f534-470c-99b0-92485a96a258 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:49.465663 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785bd8b-f534-470c-99b0-92485a96a258 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:49.465782 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785bd8b-f534-470c-99b0-92485a96a258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:49.483951 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-4785bd8b-f534-470c-99b0-92485a96a258 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:49.485200 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4785bd8b-f534-470c-99b0-92485a96a258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:49.543129 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1389/2778] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:44:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:49.553375 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef0aad0-15b7-4388-8d2f-6f5ce8a63281 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:49.554775 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-7ef0aad0-15b7-4388-8d2f-6f5ce8a63281 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:49.611664 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef0aad0-15b7-4388-8d2f-6f5ce8a63281 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:49.615242 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c5bea-5f70-436f-a5da-20eb63ef8cc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:49.615879 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c5bea-5f70-436f-a5da-20eb63ef8cc2 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:49.616191 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c5bea-5f70-436f-a5da-20eb63ef8cc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:49.616469 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c5bea-5f70-436f-a5da-20eb63ef8cc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:49.627578 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709c5bea-5f70-436f-a5da-20eb63ef8cc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:49.629114 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709c5bea-5f70-436f-a5da-20eb63ef8cc2 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:49.639052 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1390/2779] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:44:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:44:50.008591 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4785bd8b-f534-470c-99b0-92485a96a258 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:50.010204 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4785bd8b-f534-470c-99b0-92485a96a258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:50.022781 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4785bd8b-f534-470c-99b0-92485a96a258 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:50.028961 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036d8b4-d3ff-4879-859d-6f63b5f97ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:50.030661 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036d8b4-d3ff-4879-859d-6f63b5f97ebb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:50.030948 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036d8b4-d3ff-4879-859d-6f63b5f97ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:50.031512 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036d8b4-d3ff-4879-859d-6f63b5f97ebb admin admin] PATH_INFO: `/v3/projects/2707972e782b457fb8e0ff6de6297e52` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:50.033316 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b036d8b4-d3ff-4879-859d-6f63b5f97ebb admin admin] RBAC: Authorizing `identity:delete_project(project_id=2707972e782b457fb8e0ff6de6297e52)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:50.035250 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b036d8b4-d3ff-4879-859d-6f63b5f97ebb admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:50.113917 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b036d8b4-d3ff-4879-859d-6f63b5f97ebb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2707972e782b457fb8e0ff6de6297e52', 'request_id': 'req-b036d8b4-d3ff-4879-859d-6f63b5f97ebb'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:50.124386 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b036d8b4-d3ff-4879-859d-6f63b5f97ebb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2707972e782b457fb8e0ff6de6297e52', 'request_id': 'req-b036d8b4-d3ff-4879-859d-6f63b5f97ebb'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:50.132868 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b036d8b4-d3ff-4879-859d-6f63b5f97ebb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2707972e782b457fb8e0ff6de6297e52', 'request_id': 'req-b036d8b4-d3ff-4879-859d-6f63b5f97ebb'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:50.146032 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:50.154008 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b036d8b4-d3ff-4879-859d-6f63b5f97ebb admin admin] The token cache is being invalidate because project 2707972e782b457fb8e0ff6de6297e52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:44:50.156122 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b036d8b4-d3ff-4879-859d-6f63b5f97ebb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:50.158835 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b036d8b4-d3ff-4879-859d-6f63b5f97ebb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:50.161597 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1390/2780] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:44:50 2022] DELETE /identity/v3/projects/2707972e782b457fb8e0ff6de6297e52 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:50.165667 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c5bea-5f70-436f-a5da-20eb63ef8cc2 service neutron] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:50.177891 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c5bea-5f70-436f-a5da-20eb63ef8cc2 service neutron] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:50.259495 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e2c90-ad0b-4ac2-ad28-fdd817b6537a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:50.260745 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e2c90-ad0b-4ac2-ad28-fdd817b6537a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:50.261347 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e2c90-ad0b-4ac2-ad28-fdd817b6537a admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:50.261492 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e2c90-ad0b-4ac2-ad28-fdd817b6537a admin admin] PATH_INFO: `/v3/users/56b45133e79b44529e36770a6730dd50` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:50.263084 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683e2c90-ad0b-4ac2-ad28-fdd817b6537a admin admin] RBAC: Authorizing `identity:delete_user(user_id=56b45133e79b44529e36770a6730dd50)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:50.266522 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683e2c90-ad0b-4ac2-ad28-fdd817b6537a admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:50.323202 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-683e2c90-ad0b-4ac2-ad28-fdd817b6537a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56b45133e79b44529e36770a6730dd50'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:50.324017 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-683e2c90-ad0b-4ac2-ad28-fdd817b6537a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56b45133e79b44529e36770a6730dd50'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:50.324712 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-683e2c90-ad0b-4ac2-ad28-fdd817b6537a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56b45133e79b44529e36770a6730dd50'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:50.333246 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-683e2c90-ad0b-4ac2-ad28-fdd817b6537a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56b45133e79b44529e36770a6730dd50'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:50.346309 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-683e2c90-ad0b-4ac2-ad28-fdd817b6537a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56b45133e79b44529e36770a6730dd50'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:50.351890 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:50.362116 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1391/2781] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:44:50 2022] DELETE /identity/v3/users/56b45133e79b44529e36770a6730dd50 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:50.681260 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036d8b4-d3ff-4879-859d-6f63b5f97ebb admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:50.683163 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b036d8b4-d3ff-4879-859d-6f63b5f97ebb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:50.700600 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036d8b4-d3ff-4879-859d-6f63b5f97ebb admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:50.784515 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd3cfc-a0bd-4b59-9c54-c04e1b747628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:50.785455 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd3cfc-a0bd-4b59-9c54-c04e1b747628 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:50.785710 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd3cfc-a0bd-4b59-9c54-c04e1b747628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:50.785975 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd3cfc-a0bd-4b59-9c54-c04e1b747628 admin admin] PATH_INFO: `/v3/projects/ac5eaac352c94814994ec8dbb0f5ea62` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:50.787503 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd3cfc-a0bd-4b59-9c54-c04e1b747628 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac5eaac352c94814994ec8dbb0f5ea62)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:50.790271 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd3cfc-a0bd-4b59-9c54-c04e1b747628 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:50.846237 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e6dd3cfc-a0bd-4b59-9c54-c04e1b747628 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac5eaac352c94814994ec8dbb0f5ea62', 'request_id': 'req-e6dd3cfc-a0bd-4b59-9c54-c04e1b747628'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:50.852941 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e6dd3cfc-a0bd-4b59-9c54-c04e1b747628 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac5eaac352c94814994ec8dbb0f5ea62', 'request_id': 'req-e6dd3cfc-a0bd-4b59-9c54-c04e1b747628'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:50.861685 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e6dd3cfc-a0bd-4b59-9c54-c04e1b747628 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac5eaac352c94814994ec8dbb0f5ea62', 'request_id': 'req-e6dd3cfc-a0bd-4b59-9c54-c04e1b747628'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:50.877985 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e6dd3cfc-a0bd-4b59-9c54-c04e1b747628 admin admin] The token cache is being invalidate because project ac5eaac352c94814994ec8dbb0f5ea62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:44:50.878546 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e6dd3cfc-a0bd-4b59-9c54-c04e1b747628 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:50.879599 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e6dd3cfc-a0bd-4b59-9c54-c04e1b747628 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:50.882079 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1391/2782] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:44:50 2022] DELETE /identity/v3/projects/ac5eaac352c94814994ec8dbb0f5ea62 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:50.888650 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9183b7-143b-4bef-86ed-fb248781f966 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:50.889184 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9183b7-143b-4bef-86ed-fb248781f966 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:50.889521 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9183b7-143b-4bef-86ed-fb248781f966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:50.911471 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-de9183b7-143b-4bef-86ed-fb248781f966 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:50.912787 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-de9183b7-143b-4bef-86ed-fb248781f966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:50.992423 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1392/2783] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:44:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:51.002519 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92088d66-1eb2-4c3a-ab0e-3a63b796e599 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:51.002898 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92088d66-1eb2-4c3a-ab0e-3a63b796e599 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:51.003319 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92088d66-1eb2-4c3a-ab0e-3a63b796e599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:51.029650 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-92088d66-1eb2-4c3a-ab0e-3a63b796e599 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:51.031940 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-92088d66-1eb2-4c3a-ab0e-3a63b796e599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:51.047343 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1392/2784] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:44:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:44:51.048638 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9183b7-143b-4bef-86ed-fb248781f966 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:51.059271 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9183b7-143b-4bef-86ed-fb248781f966 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:51.064489 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fecb6c-8de6-4c1c-9ff0-81b7444a3bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:51.065194 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fecb6c-8de6-4c1c-9ff0-81b7444a3bff admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:51.065453 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fecb6c-8de6-4c1c-9ff0-81b7444a3bff admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:51.065727 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fecb6c-8de6-4c1c-9ff0-81b7444a3bff admin admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:51.066462 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fecb6c-8de6-4c1c-9ff0-81b7444a3bff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:44:51.066772 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fecb6c-8de6-4c1c-9ff0-81b7444a3bff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:51.068394 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fecb6c-8de6-4c1c-9ff0-81b7444a3bff admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:51.082258 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1393/2785] 10.222.0.16 () {58 vars in 1152 bytes} [Thu May 26 12:44:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:44:51.088798 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92088d66-1eb2-4c3a-ab0e-3a63b796e599 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:51.103825 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92088d66-1eb2-4c3a-ab0e-3a63b796e599 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:51.113690 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e203e747-f069-4f35-ba93-8ea2ed27f188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:51.114527 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e203e747-f069-4f35-ba93-8ea2ed27f188 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:51.114861 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e203e747-f069-4f35-ba93-8ea2ed27f188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:51.115267 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e203e747-f069-4f35-ba93-8ea2ed27f188 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:51.116008 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e203e747-f069-4f35-ba93-8ea2ed27f188 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:51.118821 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e203e747-f069-4f35-ba93-8ea2ed27f188 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:51.154498 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1393/2786] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:44:51 2022] POST /identity/v3/projects => generated 383 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:44:51.159641 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fecb6c-8de6-4c1c-9ff0-81b7444a3bff admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:51.175054 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fecb6c-8de6-4c1c-9ff0-81b7444a3bff admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:51.247622 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc8efad-e72f-488d-b93a-1ee2ced99857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:51.248685 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc8efad-e72f-488d-b93a-1ee2ced99857 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:51.251858 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc8efad-e72f-488d-b93a-1ee2ced99857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:51.252284 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc8efad-e72f-488d-b93a-1ee2ced99857 admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:51.253744 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc8efad-e72f-488d-b93a-1ee2ced99857 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:51.256332 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc8efad-e72f-488d-b93a-1ee2ced99857 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:51.284482 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1394/2787] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:44:51 2022] POST /identity/v3/users => generated 292 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:44:51.288676 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e203e747-f069-4f35-ba93-8ea2ed27f188 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:51.308424 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e203e747-f069-4f35-ba93-8ea2ed27f188 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:51.315248 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3eb90-8891-4d41-bf5d-4f7e5dcaa2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:51.315996 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3eb90-8891-4d41-bf5d-4f7e5dcaa2ee admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:51.316368 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3eb90-8891-4d41-bf5d-4f7e5dcaa2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:51.316808 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3eb90-8891-4d41-bf5d-4f7e5dcaa2ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:51.317696 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db3eb90-8891-4d41-bf5d-4f7e5dcaa2ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:51.319777 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db3eb90-8891-4d41-bf5d-4f7e5dcaa2ee admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:51.332895 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1394/2788] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:44:51 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:44:51.337958 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc8efad-e72f-488d-b93a-1ee2ced99857 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:51.349818 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc8efad-e72f-488d-b93a-1ee2ced99857 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:51.354890 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d305a71b-2707-4aae-8521-a3d630aaf44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:51.355784 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305a71b-2707-4aae-8521-a3d630aaf44d admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:51.356233 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305a71b-2707-4aae-8521-a3d630aaf44d admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:51.356681 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305a71b-2707-4aae-8521-a3d630aaf44d admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:51.357712 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d305a71b-2707-4aae-8521-a3d630aaf44d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:51.360095 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d305a71b-2707-4aae-8521-a3d630aaf44d admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:51.372947 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1395/2789] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:44:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:44:51.378109 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3eb90-8891-4d41-bf5d-4f7e5dcaa2ee admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:51.392452 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3eb90-8891-4d41-bf5d-4f7e5dcaa2ee admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:51.399475 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c78fa34-f928-4b11-9784-3548e81e54df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:51.400941 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78fa34-f928-4b11-9784-3548e81e54df admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:51.401120 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78fa34-f928-4b11-9784-3548e81e54df admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:51.401492 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78fa34-f928-4b11-9784-3548e81e54df admin admin] PATH_INFO: `/v3/projects/59338e27fabd43b998065393a89a9652/users/277a8d070a3e447ba10034dee6621f43/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:51.426571 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c78fa34-f928-4b11-9784-3548e81e54df admin admin] RBAC: Authorizing `identity:create_grant(project_id=59338e27fabd43b998065393a89a9652, user_id=277a8d070a3e447ba10034dee6621f43, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:51.430134 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c78fa34-f928-4b11-9784-3548e81e54df admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:51.447646 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1395/2790] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:44:51 2022] PUT /identity/v3/projects/59338e27fabd43b998065393a89a9652/users/277a8d070a3e447ba10034dee6621f43/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:44:51.466134 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a0d73-ac21-4609-b60e-4d41b6937aac None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:51.466680 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a0d73-ac21-4609-b60e-4d41b6937aac None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:51.467006 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a0d73-ac21-4609-b60e-4d41b6937aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:51.501322 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-dd8a0d73-ac21-4609-b60e-4d41b6937aac None None] MFA Rules not processed for user `277a8d070a3e447ba10034dee6621f43`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:51.502639 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-dd8a0d73-ac21-4609-b60e-4d41b6937aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:51.581486 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:51.605717 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1396/2791] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:44:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:51.611762 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c78fa34-f928-4b11-9784-3548e81e54df admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:51.649101 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:51.700970 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c78fa34-f928-4b11-9784-3548e81e54df admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:51.707000 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed484a2e-1028-433b-891e-4b6268fed2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:51.707660 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed484a2e-1028-433b-891e-4b6268fed2b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:51.708000 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed484a2e-1028-433b-891e-4b6268fed2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:51.708277 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed484a2e-1028-433b-891e-4b6268fed2b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:51.709117 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed484a2e-1028-433b-891e-4b6268fed2b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:51.712076 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed484a2e-1028-433b-891e-4b6268fed2b6 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:51.740566 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1396/2792] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:44:51 2022] POST /identity/v3/projects => generated 385 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:44:51.744945 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8a0d73-ac21-4609-b60e-4d41b6937aac None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:51.761167 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8a0d73-ac21-4609-b60e-4d41b6937aac None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:51.824781 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f70ad-2f68-4375-9355-18a5bf20c96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:51.825433 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f70ad-2f68-4375-9355-18a5bf20c96a admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:51.825721 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f70ad-2f68-4375-9355-18a5bf20c96a admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:51.826001 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f70ad-2f68-4375-9355-18a5bf20c96a admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:51.827230 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039f70ad-2f68-4375-9355-18a5bf20c96a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:51.829185 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039f70ad-2f68-4375-9355-18a5bf20c96a admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:51.850856 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1397/2793] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:44:51 2022] POST /identity/v3/users => generated 299 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:44:51.855087 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed484a2e-1028-433b-891e-4b6268fed2b6 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:51.865919 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed484a2e-1028-433b-891e-4b6268fed2b6 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:51.870992 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c5ff4-f3ae-446e-b538-290eb780d833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:51.871934 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c5ff4-f3ae-446e-b538-290eb780d833 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:51.872253 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c5ff4-f3ae-446e-b538-290eb780d833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:51.872566 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c5ff4-f3ae-446e-b538-290eb780d833 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:51.873362 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2c5ff4-f3ae-446e-b538-290eb780d833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:51.875061 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2c5ff4-f3ae-446e-b538-290eb780d833 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:51.885805 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1397/2794] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:44:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:44:51.890681 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f70ad-2f68-4375-9355-18a5bf20c96a admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:51.900754 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f70ad-2f68-4375-9355-18a5bf20c96a admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:51.906196 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d1a99-e684-4fda-9d3a-b530f5167bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:51.907148 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d1a99-e684-4fda-9d3a-b530f5167bc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:51.907342 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d1a99-e684-4fda-9d3a-b530f5167bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:51.907617 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d1a99-e684-4fda-9d3a-b530f5167bc6 admin admin] PATH_INFO: `/v3/projects/fdb8ba9f6ba34e1ea8a342f23d86e827/users/f5a74a9e86cb489790adb092380684f3/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:51.922694 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001d1a99-e684-4fda-9d3a-b530f5167bc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdb8ba9f6ba34e1ea8a342f23d86e827, user_id=f5a74a9e86cb489790adb092380684f3, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:51.925371 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001d1a99-e684-4fda-9d3a-b530f5167bc6 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:51.938689 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1398/2795] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:44:51 2022] PUT /identity/v3/projects/fdb8ba9f6ba34e1ea8a342f23d86e827/users/f5a74a9e86cb489790adb092380684f3/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:44:51.942804 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c5ff4-f3ae-446e-b538-290eb780d833 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:51.955537 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c5ff4-f3ae-446e-b538-290eb780d833 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:52.017277 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba06525-ce12-4af7-bb6f-1d06048474b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:52.017943 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba06525-ce12-4af7-bb6f-1d06048474b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:52.018224 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba06525-ce12-4af7-bb6f-1d06048474b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:52.018499 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba06525-ce12-4af7-bb6f-1d06048474b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:52.019345 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba06525-ce12-4af7-bb6f-1d06048474b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:52.021034 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba06525-ce12-4af7-bb6f-1d06048474b1 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:52.031775 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1398/2796] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:44:51 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:44:52.036194 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d1a99-e684-4fda-9d3a-b530f5167bc6 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:52.048086 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d1a99-e684-4fda-9d3a-b530f5167bc6 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:52.053222 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae2aa73-0133-46fa-9c9f-28efd501f3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:52.054102 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2aa73-0133-46fa-9c9f-28efd501f3d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:52.054386 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2aa73-0133-46fa-9c9f-28efd501f3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:52.054645 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2aa73-0133-46fa-9c9f-28efd501f3d4 admin admin] PATH_INFO: `/v3/projects/fdb8ba9f6ba34e1ea8a342f23d86e827/users/f5a74a9e86cb489790adb092380684f3/roles/1a8e523ecbc84d818c2a9af0fb54da74` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:52.056658 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae2aa73-0133-46fa-9c9f-28efd501f3d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdb8ba9f6ba34e1ea8a342f23d86e827, user_id=f5a74a9e86cb489790adb092380684f3, role_id=1a8e523ecbc84d818c2a9af0fb54da74)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:52.059538 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae2aa73-0133-46fa-9c9f-28efd501f3d4 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:52.071220 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1399/2797] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:44:52 2022] PUT /identity/v3/projects/fdb8ba9f6ba34e1ea8a342f23d86e827/users/f5a74a9e86cb489790adb092380684f3/roles/1a8e523ecbc84d818c2a9af0fb54da74 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:52.083164 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d686f7-6890-49ef-98f5-fd60b33773fc None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:52.083392 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d686f7-6890-49ef-98f5-fd60b33773fc None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:52.083672 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d686f7-6890-49ef-98f5-fd60b33773fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:52.112011 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-11d686f7-6890-49ef-98f5-fd60b33773fc None None] MFA Rules not processed for user `f5a74a9e86cb489790adb092380684f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:52.113363 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-11d686f7-6890-49ef-98f5-fd60b33773fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:52.183357 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1399/2798] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:44:52 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:52.198620 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae2aa73-0133-46fa-9c9f-28efd501f3d4 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:52.200469 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-1ae2aa73-0133-46fa-9c9f-28efd501f3d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:52.261230 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae2aa73-0133-46fa-9c9f-28efd501f3d4 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:52.265832 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fadb520-ff1e-494a-84f5-f3ec25270a58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:52.266506 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fadb520-ff1e-494a-84f5-f3ec25270a58 service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:52.266789 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fadb520-ff1e-494a-84f5-f3ec25270a58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:52.267066 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fadb520-ff1e-494a-84f5-f3ec25270a58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:52.330307 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fadb520-ff1e-494a-84f5-f3ec25270a58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:52.331980 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fadb520-ff1e-494a-84f5-f3ec25270a58 service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:52.335922 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:52.346406 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1400/2799] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:44:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:44:54.970136 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5e57b-c216-4157-bb7d-92e08eb45e2f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:54.970586 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5e57b-c216-4157-bb7d-92e08eb45e2f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:54.970698 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5e57b-c216-4157-bb7d-92e08eb45e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:54.988613 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-3ca5e57b-c216-4157-bb7d-92e08eb45e2f None None] MFA Rules not processed for user `512b4337083145f9ae57948a63444ced`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:54.989844 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3ca5e57b-c216-4157-bb7d-92e08eb45e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:55.003236 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:55.046616 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1400/2800] 10.222.0.16 () {58 vars in 1009 bytes} [Thu May 26 12:44:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:55.091484 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fadb520-ff1e-494a-84f5-f3ec25270a58 service cinder] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:55.092890 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-2fadb520-ff1e-494a-84f5-f3ec25270a58 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:55.164046 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fadb520-ff1e-494a-84f5-f3ec25270a58 service cinder] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:55.169259 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35f8f0f-7de3-4bb1-998a-415dfad0cd38 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02767dcbd1574e08a9e82a775ac2b289', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:55.169916 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f8f0f-7de3-4bb1-998a-415dfad0cd38 service swift] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:55.170198 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f8f0f-7de3-4bb1-998a-415dfad0cd38 service swift] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:55.171223 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f8f0f-7de3-4bb1-998a-415dfad0cd38 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:55.179873 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35f8f0f-7de3-4bb1-998a-415dfad0cd38 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:55.181642 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35f8f0f-7de3-4bb1-998a-415dfad0cd38 service swift] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:55.190269 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1401/2801] 10.222.0.16 () {60 vars in 1384 bytes} [Thu May 26 12:44:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:44:55.775302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd174332-a855-43a4-a6b4-a0862b875d37 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:55.775597 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd174332-a855-43a4-a6b4-a0862b875d37 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:55.775880 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd174332-a855-43a4-a6b4-a0862b875d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:55.795081 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-cd174332-a855-43a4-a6b4-a0862b875d37 None None] MFA Rules not processed for user `512b4337083145f9ae57948a63444ced`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:55.796354 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-cd174332-a855-43a4-a6b4-a0862b875d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:55.803888 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1401/2802] 10.222.0.16 () {58 vars in 967 bytes} [Thu May 26 12:44:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:55.817146 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35f8f0f-7de3-4bb1-998a-415dfad0cd38 service swift] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:55.829751 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35f8f0f-7de3-4bb1-998a-415dfad0cd38 service swift] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:55.835102 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32094cf-45f2-45a4-acbc-54b15fe7e7b9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02767dcbd1574e08a9e82a775ac2b289', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:55.835788 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32094cf-45f2-45a4-acbc-54b15fe7e7b9 service swift] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:55.836072 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32094cf-45f2-45a4-acbc-54b15fe7e7b9 service swift] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:55.836355 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32094cf-45f2-45a4-acbc-54b15fe7e7b9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:55.846105 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32094cf-45f2-45a4-acbc-54b15fe7e7b9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:55.847718 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32094cf-45f2-45a4-acbc-54b15fe7e7b9 service swift] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:55.856505 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1402/2803] 10.222.0.16 () {60 vars in 1384 bytes} [Thu May 26 12:44:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:44:56.052800 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aadd7c7-fedb-474c-81d7-aaefdca2054e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:56.053328 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aadd7c7-fedb-474c-81d7-aaefdca2054e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:56.053428 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aadd7c7-fedb-474c-81d7-aaefdca2054e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:56.071565 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-8aadd7c7-fedb-474c-81d7-aaefdca2054e None None] MFA Rules not processed for user `512b4337083145f9ae57948a63444ced`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:56.072779 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8aadd7c7-fedb-474c-81d7-aaefdca2054e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:56.080668 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1402/2804] 10.222.0.16 () {58 vars in 1009 bytes} [Thu May 26 12:44:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:56.092909 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32094cf-45f2-45a4-acbc-54b15fe7e7b9 service swift] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:56.103656 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32094cf-45f2-45a4-acbc-54b15fe7e7b9 service swift] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:56.109430 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae69903-1038-413d-86ff-d6a5f37ca6cf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02767dcbd1574e08a9e82a775ac2b289', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:56.110075 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae69903-1038-413d-86ff-d6a5f37ca6cf service swift] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:56.110355 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae69903-1038-413d-86ff-d6a5f37ca6cf service swift] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:56.110628 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae69903-1038-413d-86ff-d6a5f37ca6cf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:56.119505 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae69903-1038-413d-86ff-d6a5f37ca6cf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:56.121154 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae69903-1038-413d-86ff-d6a5f37ca6cf service swift] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:56.130015 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1403/2805] 10.222.0.16 () {60 vars in 1384 bytes} [Thu May 26 12:44:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:44:56.469980 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49432aa-d247-4829-8e2f-a1cfc341946b None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:56.470300 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49432aa-d247-4829-8e2f-a1cfc341946b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:56.470545 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49432aa-d247-4829-8e2f-a1cfc341946b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:56.488946 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d49432aa-d247-4829-8e2f-a1cfc341946b None None] MFA Rules not processed for user `512b4337083145f9ae57948a63444ced`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:56.490197 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d49432aa-d247-4829-8e2f-a1cfc341946b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:56.497924 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1403/2806] 10.222.0.16 () {58 vars in 967 bytes} [Thu May 26 12:44:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:56.510196 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae69903-1038-413d-86ff-d6a5f37ca6cf service swift] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:56.521690 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae69903-1038-413d-86ff-d6a5f37ca6cf service swift] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:56.527240 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ffaf19-9ccc-4070-9d3d-f8c62928b891 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02767dcbd1574e08a9e82a775ac2b289', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:56.527894 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ffaf19-9ccc-4070-9d3d-f8c62928b891 service swift] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:56.528176 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ffaf19-9ccc-4070-9d3d-f8c62928b891 service swift] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:56.528451 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ffaf19-9ccc-4070-9d3d-f8c62928b891 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:56.537678 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ffaf19-9ccc-4070-9d3d-f8c62928b891 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:56.539259 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ffaf19-9ccc-4070-9d3d-f8c62928b891 service swift] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:56.547295 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1404/2807] 10.222.0.16 () {60 vars in 1384 bytes} [Thu May 26 12:44:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 26 12:44:56.699700 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49432aa-d247-4829-8e2f-a1cfc341946b None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:56.701128 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d49432aa-d247-4829-8e2f-a1cfc341946b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:56.716681 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49432aa-d247-4829-8e2f-a1cfc341946b None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:56.720701 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b54f99-df3b-4556-9727-ffcafa968f68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:56.721462 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b54f99-df3b-4556-9727-ffcafa968f68 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:56.721819 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b54f99-df3b-4556-9727-ffcafa968f68 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:56.722165 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b54f99-df3b-4556-9727-ffcafa968f68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:56.732229 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b54f99-df3b-4556-9727-ffcafa968f68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:56.733808 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b54f99-df3b-4556-9727-ffcafa968f68 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:56.743610 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1404/2808] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:44:56 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:44:58.832223 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ffaf19-9ccc-4070-9d3d-f8c62928b891 service swift] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:58.833751 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-00ffaf19-9ccc-4070-9d3d-f8c62928b891 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:58.900619 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ffaf19-9ccc-4070-9d3d-f8c62928b891 service swift] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:58.906056 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abfe373-780e-4d35-b779-d558e473ab01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:58.906989 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfe373-780e-4d35-b779-d558e473ab01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:58.907271 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfe373-780e-4d35-b779-d558e473ab01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:58.907598 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfe373-780e-4d35-b779-d558e473ab01 admin admin] PATH_INFO: `/v3/users/6eb8b883e2a84b59815da4a5200a60e9` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:58.908991 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abfe373-780e-4d35-b779-d558e473ab01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6eb8b883e2a84b59815da4a5200a60e9)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:58.911126 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abfe373-780e-4d35-b779-d558e473ab01 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:58.959898 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-7abfe373-780e-4d35-b779-d558e473ab01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6eb8b883e2a84b59815da4a5200a60e9'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:58.960565 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-7abfe373-780e-4d35-b779-d558e473ab01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6eb8b883e2a84b59815da4a5200a60e9'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:58.961230 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-7abfe373-780e-4d35-b779-d558e473ab01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6eb8b883e2a84b59815da4a5200a60e9'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:58.964151 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:58.969918 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-7abfe373-780e-4d35-b779-d558e473ab01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6eb8b883e2a84b59815da4a5200a60e9'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:58.983259 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-7abfe373-780e-4d35-b779-d558e473ab01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6eb8b883e2a84b59815da4a5200a60e9'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:58.995494 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1405/2809] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:44:58 2022] DELETE /identity/v3/users/6eb8b883e2a84b59815da4a5200a60e9 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:59.000877 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8dada-720a-4e5e-a616-011a0177ec4d None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:59.001384 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8dada-720a-4e5e-a616-011a0177ec4d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:59.001486 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8dada-720a-4e5e-a616-011a0177ec4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:59.019068 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c4c8dada-720a-4e5e-a616-011a0177ec4d None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:59.020272 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c4c8dada-720a-4e5e-a616-011a0177ec4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:59.077738 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1405/2810] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:44:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:59.087305 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abfe373-780e-4d35-b779-d558e473ab01 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:59.088730 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-7abfe373-780e-4d35-b779-d558e473ab01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:59.149416 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abfe373-780e-4d35-b779-d558e473ab01 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:59.153149 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcaf323-6c44-4938-b244-1eb8eabb851b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:59.153731 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcaf323-6c44-4938-b244-1eb8eabb851b service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:59.154015 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcaf323-6c44-4938-b244-1eb8eabb851b service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:59.154295 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcaf323-6c44-4938-b244-1eb8eabb851b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:59.163875 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcaf323-6c44-4938-b244-1eb8eabb851b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:59.165331 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcaf323-6c44-4938-b244-1eb8eabb851b service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:59.176165 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1406/2811] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:44:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:44:59.349287 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c8dada-720a-4e5e-a616-011a0177ec4d None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:59.350752 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c4c8dada-720a-4e5e-a616-011a0177ec4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:59.372525 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c8dada-720a-4e5e-a616-011a0177ec4d None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:59.386738 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9525792-1f4e-4cc4-ba16-3acfb50b2806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:59.387621 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9525792-1f4e-4cc4-ba16-3acfb50b2806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:59.387910 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9525792-1f4e-4cc4-ba16-3acfb50b2806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:59.388187 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9525792-1f4e-4cc4-ba16-3acfb50b2806 admin admin] PATH_INFO: `/v3/projects/3146d0bedb3041c088819f072b016b48` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:59.390090 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9525792-1f4e-4cc4-ba16-3acfb50b2806 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3146d0bedb3041c088819f072b016b48)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:59.392201 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9525792-1f4e-4cc4-ba16-3acfb50b2806 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:59.454844 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c9525792-1f4e-4cc4-ba16-3acfb50b2806 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3146d0bedb3041c088819f072b016b48', 'request_id': 'req-c9525792-1f4e-4cc4-ba16-3acfb50b2806'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:59.465646 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c9525792-1f4e-4cc4-ba16-3acfb50b2806 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3146d0bedb3041c088819f072b016b48', 'request_id': 'req-c9525792-1f4e-4cc4-ba16-3acfb50b2806'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:59.475546 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c9525792-1f4e-4cc4-ba16-3acfb50b2806 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3146d0bedb3041c088819f072b016b48', 'request_id': 'req-c9525792-1f4e-4cc4-ba16-3acfb50b2806'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:59.493348 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c9525792-1f4e-4cc4-ba16-3acfb50b2806 admin admin] The token cache is being invalidate because project 3146d0bedb3041c088819f072b016b48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:44:59.493637 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c9525792-1f4e-4cc4-ba16-3acfb50b2806 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:59.494472 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c9525792-1f4e-4cc4-ba16-3acfb50b2806 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:59.496032 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1406/2812] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:44:59 2022] DELETE /identity/v3/projects/3146d0bedb3041c088819f072b016b48 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:01.692422 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcaf323-6c44-4938-b244-1eb8eabb851b service neutron] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:01.694019 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-fdcaf323-6c44-4938-b244-1eb8eabb851b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:01.707554 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcaf323-6c44-4938-b244-1eb8eabb851b service neutron] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:01.765816 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa4dcb-7a03-477b-9fe4-58a89d9ff46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:01.766703 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa4dcb-7a03-477b-9fe4-58a89d9ff46f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:01.766984 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa4dcb-7a03-477b-9fe4-58a89d9ff46f admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:01.767256 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa4dcb-7a03-477b-9fe4-58a89d9ff46f admin admin] PATH_INFO: `/v3/users/277a8d070a3e447ba10034dee6621f43` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:01.768467 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afa4dcb-7a03-477b-9fe4-58a89d9ff46f admin admin] RBAC: Authorizing `identity:delete_user(user_id=277a8d070a3e447ba10034dee6621f43)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:01.770416 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afa4dcb-7a03-477b-9fe4-58a89d9ff46f admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:01.821812 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-2afa4dcb-7a03-477b-9fe4-58a89d9ff46f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '277a8d070a3e447ba10034dee6621f43'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:01.822473 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-2afa4dcb-7a03-477b-9fe4-58a89d9ff46f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '277a8d070a3e447ba10034dee6621f43'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:01.823077 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-2afa4dcb-7a03-477b-9fe4-58a89d9ff46f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '277a8d070a3e447ba10034dee6621f43'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:01.831758 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-2afa4dcb-7a03-477b-9fe4-58a89d9ff46f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '277a8d070a3e447ba10034dee6621f43'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:01.844823 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-2afa4dcb-7a03-477b-9fe4-58a89d9ff46f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '277a8d070a3e447ba10034dee6621f43'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:01.846067 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:01.863193 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1407/2813] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:45:01 2022] DELETE /identity/v3/users/277a8d070a3e447ba10034dee6621f43 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:01.867985 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde42d3-d509-443d-8a17-d8bb908a53c2 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:01.868459 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde42d3-d509-443d-8a17-d8bb908a53c2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:01.868556 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde42d3-d509-443d-8a17-d8bb908a53c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:01.887237 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-6dde42d3-d509-443d-8a17-d8bb908a53c2 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:01.888469 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6dde42d3-d509-443d-8a17-d8bb908a53c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:01.902528 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:01.964165 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1407/2814] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:45:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:01.973870 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa4dcb-7a03-477b-9fe4-58a89d9ff46f admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:01.975414 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-2afa4dcb-7a03-477b-9fe4-58a89d9ff46f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:02.044829 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa4dcb-7a03-477b-9fe4-58a89d9ff46f admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:02.048855 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e81d1c-fbf7-47c1-8b7d-06108de53587 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:02.049531 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e81d1c-fbf7-47c1-8b7d-06108de53587 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:02.049818 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e81d1c-fbf7-47c1-8b7d-06108de53587 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:02.050095 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e81d1c-fbf7-47c1-8b7d-06108de53587 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:02.059797 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e81d1c-fbf7-47c1-8b7d-06108de53587 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:02.062167 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e81d1c-fbf7-47c1-8b7d-06108de53587 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:02.073271 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1408/2815] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:45:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:45:02.390127 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde42d3-d509-443d-8a17-d8bb908a53c2 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:02.391672 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6dde42d3-d509-443d-8a17-d8bb908a53c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:02.405909 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde42d3-d509-443d-8a17-d8bb908a53c2 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:02.411222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a257b8ce-eb7f-416d-acd1-a90fa50e56f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:02.412102 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257b8ce-eb7f-416d-acd1-a90fa50e56f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:02.412387 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257b8ce-eb7f-416d-acd1-a90fa50e56f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:02.412664 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257b8ce-eb7f-416d-acd1-a90fa50e56f2 admin admin] PATH_INFO: `/v3/projects/59338e27fabd43b998065393a89a9652` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:02.414145 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a257b8ce-eb7f-416d-acd1-a90fa50e56f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59338e27fabd43b998065393a89a9652)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:02.416215 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a257b8ce-eb7f-416d-acd1-a90fa50e56f2 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:02.484102 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a257b8ce-eb7f-416d-acd1-a90fa50e56f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59338e27fabd43b998065393a89a9652', 'request_id': 'req-a257b8ce-eb7f-416d-acd1-a90fa50e56f2'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:02.490225 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a257b8ce-eb7f-416d-acd1-a90fa50e56f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59338e27fabd43b998065393a89a9652', 'request_id': 'req-a257b8ce-eb7f-416d-acd1-a90fa50e56f2'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:02.498690 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a257b8ce-eb7f-416d-acd1-a90fa50e56f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59338e27fabd43b998065393a89a9652', 'request_id': 'req-a257b8ce-eb7f-416d-acd1-a90fa50e56f2'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:02.515669 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a257b8ce-eb7f-416d-acd1-a90fa50e56f2 admin admin] The token cache is being invalidate because project 59338e27fabd43b998065393a89a9652 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:45:02.516269 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a257b8ce-eb7f-416d-acd1-a90fa50e56f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:02.517007 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a257b8ce-eb7f-416d-acd1-a90fa50e56f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:02.518760 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1408/2816] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:45:02 2022] DELETE /identity/v3/projects/59338e27fabd43b998065393a89a9652 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:02.523114 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e81d1c-fbf7-47c1-8b7d-06108de53587 service neutron] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:02.534228 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e81d1c-fbf7-47c1-8b7d-06108de53587 service neutron] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:02.604479 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca0d79f-97a7-419d-b793-02c871b5f003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:02.605640 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0d79f-97a7-419d-b793-02c871b5f003 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:02.606082 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0d79f-97a7-419d-b793-02c871b5f003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:02.606456 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0d79f-97a7-419d-b793-02c871b5f003 admin admin] PATH_INFO: `/v3/users/f5a74a9e86cb489790adb092380684f3` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:02.607870 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca0d79f-97a7-419d-b793-02c871b5f003 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5a74a9e86cb489790adb092380684f3)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:02.610417 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca0d79f-97a7-419d-b793-02c871b5f003 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:02.663910 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-1ca0d79f-97a7-419d-b793-02c871b5f003 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5a74a9e86cb489790adb092380684f3'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:02.664528 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-1ca0d79f-97a7-419d-b793-02c871b5f003 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5a74a9e86cb489790adb092380684f3'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:02.665155 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-1ca0d79f-97a7-419d-b793-02c871b5f003 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5a74a9e86cb489790adb092380684f3'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:02.673443 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-1ca0d79f-97a7-419d-b793-02c871b5f003 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5a74a9e86cb489790adb092380684f3'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:02.689071 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-1ca0d79f-97a7-419d-b793-02c871b5f003 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5a74a9e86cb489790adb092380684f3'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:02.707719 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1409/2817] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:45:02 2022] DELETE /identity/v3/users/f5a74a9e86cb489790adb092380684f3 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:03.019511 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a257b8ce-eb7f-416d-acd1-a90fa50e56f2 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:03.021896 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a257b8ce-eb7f-416d-acd1-a90fa50e56f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:03.040714 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a257b8ce-eb7f-416d-acd1-a90fa50e56f2 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:03.105935 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef18e23-f7ab-4b8f-a166-9f7a81239721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:03.106808 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef18e23-f7ab-4b8f-a166-9f7a81239721 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:03.107095 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef18e23-f7ab-4b8f-a166-9f7a81239721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:03.107412 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef18e23-f7ab-4b8f-a166-9f7a81239721 admin admin] PATH_INFO: `/v3/projects/fdb8ba9f6ba34e1ea8a342f23d86e827` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:03.108655 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef18e23-f7ab-4b8f-a166-9f7a81239721 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdb8ba9f6ba34e1ea8a342f23d86e827)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:03.110741 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef18e23-f7ab-4b8f-a166-9f7a81239721 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:03.161875 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:03.171376 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6ef18e23-f7ab-4b8f-a166-9f7a81239721 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdb8ba9f6ba34e1ea8a342f23d86e827', 'request_id': 'req-6ef18e23-f7ab-4b8f-a166-9f7a81239721'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:03.178439 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6ef18e23-f7ab-4b8f-a166-9f7a81239721 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdb8ba9f6ba34e1ea8a342f23d86e827', 'request_id': 'req-6ef18e23-f7ab-4b8f-a166-9f7a81239721'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:03.184872 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6ef18e23-f7ab-4b8f-a166-9f7a81239721 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdb8ba9f6ba34e1ea8a342f23d86e827', 'request_id': 'req-6ef18e23-f7ab-4b8f-a166-9f7a81239721'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:03.198468 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6ef18e23-f7ab-4b8f-a166-9f7a81239721 admin admin] The token cache is being invalidate because project fdb8ba9f6ba34e1ea8a342f23d86e827 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:45:03.198758 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6ef18e23-f7ab-4b8f-a166-9f7a81239721 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:03.199410 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6ef18e23-f7ab-4b8f-a166-9f7a81239721 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:03.201604 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1409/2818] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:45:03 2022] DELETE /identity/v3/projects/fdb8ba9f6ba34e1ea8a342f23d86e827 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:03.207747 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0270e-eeb4-41db-84bd-208134c9afd8 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:03.208061 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0270e-eeb4-41db-84bd-208134c9afd8 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:03.208341 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0270e-eeb4-41db-84bd-208134c9afd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:03.227979 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-87a0270e-eeb4-41db-84bd-208134c9afd8 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:03.229257 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-87a0270e-eeb4-41db-84bd-208134c9afd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:03.235655 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:03.295370 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1410/2819] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:45:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:45:03.305238 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc422933-0563-4904-b806-b669312bd0f0 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:03.305529 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc422933-0563-4904-b806-b669312bd0f0 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:03.305811 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc422933-0563-4904-b806-b669312bd0f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:03.325181 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-dc422933-0563-4904-b806-b669312bd0f0 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:03.326466 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-dc422933-0563-4904-b806-b669312bd0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:03.334570 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1410/2820] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:45:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:45:03.338896 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a0270e-eeb4-41db-84bd-208134c9afd8 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:03.348917 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a0270e-eeb4-41db-84bd-208134c9afd8 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:03.353643 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eddc52-7716-40e4-bbe3-20f8aef9d775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:03.354302 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eddc52-7716-40e4-bbe3-20f8aef9d775 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:03.354588 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eddc52-7716-40e4-bbe3-20f8aef9d775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:03.354868 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eddc52-7716-40e4-bbe3-20f8aef9d775 admin admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:03.355600 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eddc52-7716-40e4-bbe3-20f8aef9d775 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:45:03.355912 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eddc52-7716-40e4-bbe3-20f8aef9d775 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:03.358114 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eddc52-7716-40e4-bbe3-20f8aef9d775 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:03.370575 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1411/2821] 10.222.0.16 () {58 vars in 1152 bytes} [Thu May 26 12:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:45:03.378344 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc422933-0563-4904-b806-b669312bd0f0 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:03.388064 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc422933-0563-4904-b806-b669312bd0f0 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:03.392772 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d059e2b7-2374-4a8d-b1f4-4bceddfeb575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:03.393463 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059e2b7-2374-4a8d-b1f4-4bceddfeb575 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:03.393745 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059e2b7-2374-4a8d-b1f4-4bceddfeb575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:03.394021 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059e2b7-2374-4a8d-b1f4-4bceddfeb575 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:03.394719 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d059e2b7-2374-4a8d-b1f4-4bceddfeb575 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:03.396638 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d059e2b7-2374-4a8d-b1f4-4bceddfeb575 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:03.425045 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1411/2822] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:45:03 2022] POST /identity/v3/projects => generated 359 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:45:03.432460 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eddc52-7716-40e4-bbe3-20f8aef9d775 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:03.442825 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eddc52-7716-40e4-bbe3-20f8aef9d775 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:03.507436 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c6bc98-96b3-4204-8516-cecfb41c3488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:03.508117 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6bc98-96b3-4204-8516-cecfb41c3488 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:03.508402 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6bc98-96b3-4204-8516-cecfb41c3488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:03.508682 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6bc98-96b3-4204-8516-cecfb41c3488 admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:03.509442 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c6bc98-96b3-4204-8516-cecfb41c3488 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:03.511379 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c6bc98-96b3-4204-8516-cecfb41c3488 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:03.533330 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1412/2823] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:45:03 2022] POST /identity/v3/users => generated 280 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:45:03.537738 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d059e2b7-2374-4a8d-b1f4-4bceddfeb575 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:03.549484 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d059e2b7-2374-4a8d-b1f4-4bceddfeb575 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:03.554205 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54942552-a97f-4afc-be32-72cd55ddb910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:03.554873 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54942552-a97f-4afc-be32-72cd55ddb910 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:03.555159 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54942552-a97f-4afc-be32-72cd55ddb910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:03.555437 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54942552-a97f-4afc-be32-72cd55ddb910 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:03.556176 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54942552-a97f-4afc-be32-72cd55ddb910 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:03.557949 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54942552-a97f-4afc-be32-72cd55ddb910 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:03.572096 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1412/2824] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:45:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:45:03.573352 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c6bc98-96b3-4204-8516-cecfb41c3488 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:03.583795 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c6bc98-96b3-4204-8516-cecfb41c3488 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:03.588994 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce35f42-006d-4167-84c8-a52076657b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:03.589667 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce35f42-006d-4167-84c8-a52076657b78 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:03.589978 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce35f42-006d-4167-84c8-a52076657b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:03.590256 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce35f42-006d-4167-84c8-a52076657b78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:03.590991 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce35f42-006d-4167-84c8-a52076657b78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:03.593303 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce35f42-006d-4167-84c8-a52076657b78 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:03.604487 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1413/2825] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:45:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:45:03.608999 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54942552-a97f-4afc-be32-72cd55ddb910 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:03.620376 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54942552-a97f-4afc-be32-72cd55ddb910 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:03.626869 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1643e1cd-ddbe-43ac-8bb2-0c0af3543f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:03.628172 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1643e1cd-ddbe-43ac-8bb2-0c0af3543f1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:03.628610 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1643e1cd-ddbe-43ac-8bb2-0c0af3543f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:03.629213 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1643e1cd-ddbe-43ac-8bb2-0c0af3543f1c admin admin] PATH_INFO: `/v3/projects/65c6f1a4de644a81a8cdefb2d955bcb8/users/003eb118a5e84b37af9b50ab193244f6/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:03.645920 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1643e1cd-ddbe-43ac-8bb2-0c0af3543f1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=65c6f1a4de644a81a8cdefb2d955bcb8, user_id=003eb118a5e84b37af9b50ab193244f6, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:03.648749 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1643e1cd-ddbe-43ac-8bb2-0c0af3543f1c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:03.662129 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1413/2826] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:45:03 2022] PUT /identity/v3/projects/65c6f1a4de644a81a8cdefb2d955bcb8/users/003eb118a5e84b37af9b50ab193244f6/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:03.673482 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84212e6-2f06-4906-b3c9-800870ce73f4 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:03.673779 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84212e6-2f06-4906-b3c9-800870ce73f4 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:03.674180 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84212e6-2f06-4906-b3c9-800870ce73f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:03.704943 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-d84212e6-2f06-4906-b3c9-800870ce73f4 None None] MFA Rules not processed for user `003eb118a5e84b37af9b50ab193244f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:03.706199 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-d84212e6-2f06-4906-b3c9-800870ce73f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:03.793203 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1414/2827] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:45:03 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:03.827898 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1643e1cd-ddbe-43ac-8bb2-0c0af3543f1c admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:03.829768 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1643e1cd-ddbe-43ac-8bb2-0c0af3543f1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:03.895462 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1643e1cd-ddbe-43ac-8bb2-0c0af3543f1c admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:03.899313 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2aeac9-9a11-471f-8ef6-988d4323ba0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:03.900107 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2aeac9-9a11-471f-8ef6-988d4323ba0c service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:03.900493 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2aeac9-9a11-471f-8ef6-988d4323ba0c service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:03.900783 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2aeac9-9a11-471f-8ef6-988d4323ba0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:03.910873 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2aeac9-9a11-471f-8ef6-988d4323ba0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:03.912572 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2aeac9-9a11-471f-8ef6-988d4323ba0c service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:03.923614 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1414/2828] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:45:03 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:45:03.938651 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84212e6-2f06-4906-b3c9-800870ce73f4 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:03.947534 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:04.004302 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84212e6-2f06-4906-b3c9-800870ce73f4 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:04.008882 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dd4c34-2dbe-4153-9eb5-8e65d3201f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:04.009757 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd4c34-2dbe-4153-9eb5-8e65d3201f1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:04.010037 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd4c34-2dbe-4153-9eb5-8e65d3201f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:04.010340 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd4c34-2dbe-4153-9eb5-8e65d3201f1f admin admin] PATH_INFO: `/v3/users/003eb118a5e84b37af9b50ab193244f6` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:04.011539 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dd4c34-2dbe-4153-9eb5-8e65d3201f1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=003eb118a5e84b37af9b50ab193244f6)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:04.014010 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dd4c34-2dbe-4153-9eb5-8e65d3201f1f admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:04.060655 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-c6dd4c34-2dbe-4153-9eb5-8e65d3201f1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '003eb118a5e84b37af9b50ab193244f6'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:04.061239 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-c6dd4c34-2dbe-4153-9eb5-8e65d3201f1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '003eb118a5e84b37af9b50ab193244f6'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:04.061847 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-c6dd4c34-2dbe-4153-9eb5-8e65d3201f1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '003eb118a5e84b37af9b50ab193244f6'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:04.069460 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-c6dd4c34-2dbe-4153-9eb5-8e65d3201f1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '003eb118a5e84b37af9b50ab193244f6'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:04.081846 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-c6dd4c34-2dbe-4153-9eb5-8e65d3201f1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '003eb118a5e84b37af9b50ab193244f6'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:04.094499 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1415/2829] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:45:03 2022] DELETE /identity/v3/users/003eb118a5e84b37af9b50ab193244f6 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:04.099005 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbf19b-0094-414d-9549-25512e5eb174 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:04.099516 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbf19b-0094-414d-9549-25512e5eb174 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:04.099673 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbf19b-0094-414d-9549-25512e5eb174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:04.117122 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-6ffbf19b-0094-414d-9549-25512e5eb174 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:04.118376 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6ffbf19b-0094-414d-9549-25512e5eb174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:04.176960 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1415/2830] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:45:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:04.187110 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dd4c34-2dbe-4153-9eb5-8e65d3201f1f admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:04.188485 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-c6dd4c34-2dbe-4153-9eb5-8e65d3201f1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:04.249795 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dd4c34-2dbe-4153-9eb5-8e65d3201f1f admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:04.253486 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad72fa-589b-4935-b96b-0bd2a115209a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:04.254189 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad72fa-589b-4935-b96b-0bd2a115209a service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:04.254474 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad72fa-589b-4935-b96b-0bd2a115209a service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:04.254746 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad72fa-589b-4935-b96b-0bd2a115209a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:04.264998 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fad72fa-589b-4935-b96b-0bd2a115209a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:04.266424 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fad72fa-589b-4935-b96b-0bd2a115209a service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:04.276401 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1416/2831] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:45:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:45:04.548690 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffbf19b-0094-414d-9549-25512e5eb174 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:04.550204 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6ffbf19b-0094-414d-9549-25512e5eb174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:04.562347 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffbf19b-0094-414d-9549-25512e5eb174 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:04.567026 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee986cf6-0bcf-4e69-b346-43436a134074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:04.567912 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee986cf6-0bcf-4e69-b346-43436a134074 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:04.568234 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee986cf6-0bcf-4e69-b346-43436a134074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:04.568543 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee986cf6-0bcf-4e69-b346-43436a134074 admin admin] PATH_INFO: `/v3/projects/65c6f1a4de644a81a8cdefb2d955bcb8` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:04.569807 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee986cf6-0bcf-4e69-b346-43436a134074 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65c6f1a4de644a81a8cdefb2d955bcb8)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:04.571754 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee986cf6-0bcf-4e69-b346-43436a134074 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:04.574417 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:04.634276 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ee986cf6-0bcf-4e69-b346-43436a134074 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65c6f1a4de644a81a8cdefb2d955bcb8', 'request_id': 'req-ee986cf6-0bcf-4e69-b346-43436a134074'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:04.639847 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ee986cf6-0bcf-4e69-b346-43436a134074 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65c6f1a4de644a81a8cdefb2d955bcb8', 'request_id': 'req-ee986cf6-0bcf-4e69-b346-43436a134074'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:04.646162 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ee986cf6-0bcf-4e69-b346-43436a134074 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65c6f1a4de644a81a8cdefb2d955bcb8', 'request_id': 'req-ee986cf6-0bcf-4e69-b346-43436a134074'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:04.658579 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ee986cf6-0bcf-4e69-b346-43436a134074 admin admin] The token cache is being invalidate because project 65c6f1a4de644a81a8cdefb2d955bcb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:45:04.658872 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ee986cf6-0bcf-4e69-b346-43436a134074 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:04.659516 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ee986cf6-0bcf-4e69-b346-43436a134074 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:04.661123 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1416/2832] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:45:04 2022] DELETE /identity/v3/projects/65c6f1a4de644a81a8cdefb2d955bcb8 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:04.666104 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bba5ca-b70a-4416-b7c8-279d59ab0d22 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:04.666393 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bba5ca-b70a-4416-b7c8-279d59ab0d22 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:04.666671 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bba5ca-b70a-4416-b7c8-279d59ab0d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:04.685102 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-e4bba5ca-b70a-4416-b7c8-279d59ab0d22 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:04.686956 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-e4bba5ca-b70a-4416-b7c8-279d59ab0d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:04.712827 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:04.752357 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1417/2833] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:45:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:04.760943 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636f4a2-2d0c-4ca4-9c9a-fb0e81c9e815 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:04.761346 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636f4a2-2d0c-4ca4-9c9a-fb0e81c9e815 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:04.761708 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636f4a2-2d0c-4ca4-9c9a-fb0e81c9e815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:04.780530 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-2636f4a2-2d0c-4ca4-9c9a-fb0e81c9e815 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:04.781910 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2636f4a2-2d0c-4ca4-9c9a-fb0e81c9e815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:04.789961 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1417/2834] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:45:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:04.794216 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bba5ca-b70a-4416-b7c8-279d59ab0d22 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:04.805283 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bba5ca-b70a-4416-b7c8-279d59ab0d22 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:04.810101 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c683be3f-e35e-455a-a40a-63bd9ccbed2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:04.811275 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683be3f-e35e-455a-a40a-63bd9ccbed2d admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:04.811561 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683be3f-e35e-455a-a40a-63bd9ccbed2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:04.811809 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683be3f-e35e-455a-a40a-63bd9ccbed2d admin admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:04.812533 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c683be3f-e35e-455a-a40a-63bd9ccbed2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:45:04.812855 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c683be3f-e35e-455a-a40a-63bd9ccbed2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:04.814457 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c683be3f-e35e-455a-a40a-63bd9ccbed2d admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:04.830794 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1418/2835] 10.222.0.16 () {58 vars in 1152 bytes} [Thu May 26 12:45:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:45:04.831938 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636f4a2-2d0c-4ca4-9c9a-fb0e81c9e815 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:04.842159 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636f4a2-2d0c-4ca4-9c9a-fb0e81c9e815 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:04.846987 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc63e39-b9d9-482f-8d14-3b7b0fcd2533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:04.847645 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc63e39-b9d9-482f-8d14-3b7b0fcd2533 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:04.847932 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc63e39-b9d9-482f-8d14-3b7b0fcd2533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:04.848211 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc63e39-b9d9-482f-8d14-3b7b0fcd2533 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:04.848959 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc63e39-b9d9-482f-8d14-3b7b0fcd2533 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:04.850911 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc63e39-b9d9-482f-8d14-3b7b0fcd2533 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:04.880083 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1418/2836] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:45:04 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:45:04.881762 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c683be3f-e35e-455a-a40a-63bd9ccbed2d admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:04.894293 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c683be3f-e35e-455a-a40a-63bd9ccbed2d admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:04.957167 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0671fb98-cf7c-4737-b2ff-d27d23445214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:04.957993 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0671fb98-cf7c-4737-b2ff-d27d23445214 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:04.958384 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0671fb98-cf7c-4737-b2ff-d27d23445214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:04.958669 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0671fb98-cf7c-4737-b2ff-d27d23445214 admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:04.959366 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0671fb98-cf7c-4737-b2ff-d27d23445214 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:04.961326 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0671fb98-cf7c-4737-b2ff-d27d23445214 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:04.981481 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1419/2837] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:45:04 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:45:04.985866 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc63e39-b9d9-482f-8d14-3b7b0fcd2533 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:04.997211 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc63e39-b9d9-482f-8d14-3b7b0fcd2533 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:05.002887 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80afe59-8d41-4b48-af33-eae21b2b6511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:05.003569 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80afe59-8d41-4b48-af33-eae21b2b6511 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:05.003866 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80afe59-8d41-4b48-af33-eae21b2b6511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:05.004141 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80afe59-8d41-4b48-af33-eae21b2b6511 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:05.005255 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80afe59-8d41-4b48-af33-eae21b2b6511 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:05.006573 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80afe59-8d41-4b48-af33-eae21b2b6511 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:05.018323 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1419/2838] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:45:05.022345 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0671fb98-cf7c-4737-b2ff-d27d23445214 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:05.033107 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0671fb98-cf7c-4737-b2ff-d27d23445214 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:05.038683 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e13a2-5c35-4a30-967c-3fd77b9f0739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:05.039449 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e13a2-5c35-4a30-967c-3fd77b9f0739 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:05.039759 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e13a2-5c35-4a30-967c-3fd77b9f0739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:05.040018 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e13a2-5c35-4a30-967c-3fd77b9f0739 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:05.040814 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79e13a2-5c35-4a30-967c-3fd77b9f0739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:05.042506 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79e13a2-5c35-4a30-967c-3fd77b9f0739 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:05.053373 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1420/2839] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:45:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:45:05.057644 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80afe59-8d41-4b48-af33-eae21b2b6511 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:05.068228 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80afe59-8d41-4b48-af33-eae21b2b6511 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:05.073033 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a998d20-7608-44fc-b725-47fd30534859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:05.073931 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a998d20-7608-44fc-b725-47fd30534859 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:05.074216 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a998d20-7608-44fc-b725-47fd30534859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:05.074493 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a998d20-7608-44fc-b725-47fd30534859 admin admin] PATH_INFO: `/v3/projects/5b112898e0b14c62b0641df0b1cb61b9/users/4e4f8738cc6e4a0a841c37cee863e1e9/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:05.091695 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a998d20-7608-44fc-b725-47fd30534859 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b112898e0b14c62b0641df0b1cb61b9, user_id=4e4f8738cc6e4a0a841c37cee863e1e9, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:05.094444 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a998d20-7608-44fc-b725-47fd30534859 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:05.111642 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1420/2840] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:45:05 2022] PUT /identity/v3/projects/5b112898e0b14c62b0641df0b1cb61b9/users/4e4f8738cc6e4a0a841c37cee863e1e9/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:05.116731 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86ba6a-8492-420f-9c94-8bb608cb1f0c None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:05.117066 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86ba6a-8492-420f-9c94-8bb608cb1f0c None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:05.117348 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86ba6a-8492-420f-9c94-8bb608cb1f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:05.143963 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-4e86ba6a-8492-420f-9c94-8bb608cb1f0c None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:05.146090 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-4e86ba6a-8492-420f-9c94-8bb608cb1f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:05.222862 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1421/2841] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:45:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:05.241755 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a998d20-7608-44fc-b725-47fd30534859 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:05.243500 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9a998d20-7608-44fc-b725-47fd30534859 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:05.301293 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a998d20-7608-44fc-b725-47fd30534859 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:05.305748 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f527957d-3fb8-4bc4-9065-e732842c6908 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:05.306438 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527957d-3fb8-4bc4-9065-e732842c6908 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:05.306783 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527957d-3fb8-4bc4-9065-e732842c6908 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:05.307031 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527957d-3fb8-4bc4-9065-e732842c6908 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:05.317414 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f527957d-3fb8-4bc4-9065-e732842c6908 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:05.318984 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f527957d-3fb8-4bc4-9065-e732842c6908 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:05.330047 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1421/2842] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:45:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:45:06.008132 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e86ba6a-8492-420f-9c94-8bb608cb1f0c None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:06.013403 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-4e86ba6a-8492-420f-9c94-8bb608cb1f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:06.027512 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e86ba6a-8492-420f-9c94-8bb608cb1f0c None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:06.033094 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18629b3b-2383-4369-b25f-c151e7660bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:06.034087 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18629b3b-2383-4369-b25f-c151e7660bb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:06.034400 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18629b3b-2383-4369-b25f-c151e7660bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:06.034685 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18629b3b-2383-4369-b25f-c151e7660bb9 admin admin] PATH_INFO: `/v3/users/995eba56109a4bca9d5578259fcbcb14` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:06.036143 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18629b3b-2383-4369-b25f-c151e7660bb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=995eba56109a4bca9d5578259fcbcb14)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:06.038131 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18629b3b-2383-4369-b25f-c151e7660bb9 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:06.073668 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:06.092403 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-18629b3b-2383-4369-b25f-c151e7660bb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '995eba56109a4bca9d5578259fcbcb14'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:06.093091 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-18629b3b-2383-4369-b25f-c151e7660bb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '995eba56109a4bca9d5578259fcbcb14'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:06.093696 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-18629b3b-2383-4369-b25f-c151e7660bb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '995eba56109a4bca9d5578259fcbcb14'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:06.101841 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-18629b3b-2383-4369-b25f-c151e7660bb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '995eba56109a4bca9d5578259fcbcb14'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:06.115353 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-18629b3b-2383-4369-b25f-c151e7660bb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '995eba56109a4bca9d5578259fcbcb14'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:06.128927 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1422/2843] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:45:06 2022] DELETE /identity/v3/users/995eba56109a4bca9d5578259fcbcb14 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:06.320015 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b8ef5-8416-4396-96df-ea8e6a08e13f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:06.320606 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b8ef5-8416-4396-96df-ea8e6a08e13f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:06.320710 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b8ef5-8416-4396-96df-ea8e6a08e13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:06.334951 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18629b3b-2383-4369-b25f-c151e7660bb9 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:06.336075 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-18629b3b-2383-4369-b25f-c151e7660bb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:06.367235 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-647b8ef5-8416-4396-96df-ea8e6a08e13f None None] MFA Rules not processed for user `4e4f8738cc6e4a0a841c37cee863e1e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:06.368285 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-647b8ef5-8416-4396-96df-ea8e6a08e13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:06.393376 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:06.425475 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18629b3b-2383-4369-b25f-c151e7660bb9 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:06.431042 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e9da5-7c0f-4292-96f7-a3074f402581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:06.431558 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e9da5-7c0f-4292-96f7-a3074f402581 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:06.431838 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e9da5-7c0f-4292-96f7-a3074f402581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:06.432109 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e9da5-7c0f-4292-96f7-a3074f402581 admin admin] PATH_INFO: `/v3/projects/91ca7db52106461d9c2d02fed29bd080` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:06.433337 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64e9da5-7c0f-4292-96f7-a3074f402581 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91ca7db52106461d9c2d02fed29bd080)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:06.435990 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64e9da5-7c0f-4292-96f7-a3074f402581 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:06.452547 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1422/2844] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:45:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:45:06.463994 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b8ef5-8416-4396-96df-ea8e6a08e13f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:06.465423 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-647b8ef5-8416-4396-96df-ea8e6a08e13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:06.495919 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-f64e9da5-7c0f-4292-96f7-a3074f402581 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91ca7db52106461d9c2d02fed29bd080', 'request_id': 'req-f64e9da5-7c0f-4292-96f7-a3074f402581'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:06.503841 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-f64e9da5-7c0f-4292-96f7-a3074f402581 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91ca7db52106461d9c2d02fed29bd080', 'request_id': 'req-f64e9da5-7c0f-4292-96f7-a3074f402581'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:06.510342 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-f64e9da5-7c0f-4292-96f7-a3074f402581 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91ca7db52106461d9c2d02fed29bd080', 'request_id': 'req-f64e9da5-7c0f-4292-96f7-a3074f402581'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:06.521333 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-f64e9da5-7c0f-4292-96f7-a3074f402581 admin admin] The token cache is being invalidate because project 91ca7db52106461d9c2d02fed29bd080 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:45:06.521605 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-f64e9da5-7c0f-4292-96f7-a3074f402581 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:06.522289 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-f64e9da5-7c0f-4292-96f7-a3074f402581 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:06.523936 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1423/2845] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:45:06 2022] DELETE /identity/v3/projects/91ca7db52106461d9c2d02fed29bd080 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:06.529752 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e9da5-7c0f-4292-96f7-a3074f402581 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:06.530801 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b8ef5-8416-4396-96df-ea8e6a08e13f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:06.531000 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-f64e9da5-7c0f-4292-96f7-a3074f402581 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:06.578026 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:06.582265 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fd9f15-19bb-4fab-bf46-bce6ce7c5833 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:06.582935 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd9f15-19bb-4fab-bf46-bce6ce7c5833 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:06.583210 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd9f15-19bb-4fab-bf46-bce6ce7c5833 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:06.583480 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd9f15-19bb-4fab-bf46-bce6ce7c5833 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:06.585767 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-73fd9f15-19bb-4fab-bf46-bce6ce7c5833 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:06.604235 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e9da5-7c0f-4292-96f7-a3074f402581 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:06.609810 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45f685-00e9-4ebf-be57-2af1488b10b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:06.610863 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45f685-00e9-4ebf-be57-2af1488b10b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:06.611140 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45f685-00e9-4ebf-be57-2af1488b10b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:06.611419 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45f685-00e9-4ebf-be57-2af1488b10b2 admin admin] PATH_INFO: `/v3/users/5657945f633c48ea941971f2cf602684` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:06.612650 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e45f685-00e9-4ebf-be57-2af1488b10b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5657945f633c48ea941971f2cf602684)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:06.614622 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e45f685-00e9-4ebf-be57-2af1488b10b2 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:06.659794 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fd9f15-19bb-4fab-bf46-bce6ce7c5833 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:06.661994 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fd9f15-19bb-4fab-bf46-bce6ce7c5833 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:06.672328 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1423/2846] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:45:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:45:06.675220 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-7e45f685-00e9-4ebf-be57-2af1488b10b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5657945f633c48ea941971f2cf602684'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:06.676145 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-7e45f685-00e9-4ebf-be57-2af1488b10b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5657945f633c48ea941971f2cf602684'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:06.676800 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-7e45f685-00e9-4ebf-be57-2af1488b10b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5657945f633c48ea941971f2cf602684'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:06.684907 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-7e45f685-00e9-4ebf-be57-2af1488b10b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5657945f633c48ea941971f2cf602684'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:06.697491 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-7e45f685-00e9-4ebf-be57-2af1488b10b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5657945f633c48ea941971f2cf602684'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:06.710548 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1424/2847] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:45:06 2022] DELETE /identity/v3/users/5657945f633c48ea941971f2cf602684 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:45:06.889490 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fd9f15-19bb-4fab-bf46-bce6ce7c5833 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:06.905511 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fd9f15-19bb-4fab-bf46-bce6ce7c5833 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:06.939465 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:06.974927 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edeba97-8d2d-421a-b386-b56f60162c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:06.976036 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edeba97-8d2d-421a-b386-b56f60162c17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:06.976435 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edeba97-8d2d-421a-b386-b56f60162c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:06.976877 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edeba97-8d2d-421a-b386-b56f60162c17 admin admin] PATH_INFO: `/v3/projects/5937b262917e40a9bfaebcb8bba659f8` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:06.978569 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edeba97-8d2d-421a-b386-b56f60162c17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5937b262917e40a9bfaebcb8bba659f8)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:06.980493 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edeba97-8d2d-421a-b386-b56f60162c17 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:07.032158 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8edeba97-8d2d-421a-b386-b56f60162c17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5937b262917e40a9bfaebcb8bba659f8', 'request_id': 'req-8edeba97-8d2d-421a-b386-b56f60162c17'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:07.039527 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8edeba97-8d2d-421a-b386-b56f60162c17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5937b262917e40a9bfaebcb8bba659f8', 'request_id': 'req-8edeba97-8d2d-421a-b386-b56f60162c17'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:07.046287 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8edeba97-8d2d-421a-b386-b56f60162c17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5937b262917e40a9bfaebcb8bba659f8', 'request_id': 'req-8edeba97-8d2d-421a-b386-b56f60162c17'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:07.059294 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8edeba97-8d2d-421a-b386-b56f60162c17 admin admin] The token cache is being invalidate because project 5937b262917e40a9bfaebcb8bba659f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:45:07.059580 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8edeba97-8d2d-421a-b386-b56f60162c17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:07.060308 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8edeba97-8d2d-421a-b386-b56f60162c17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:07.061882 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1424/2848] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:45:06 2022] DELETE /identity/v3/projects/5937b262917e40a9bfaebcb8bba659f8 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:07.066905 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8aa2e-4b26-40e3-b001-f1c7a81652b7 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:07.067374 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8aa2e-4b26-40e3-b001-f1c7a81652b7 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:07.067492 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8aa2e-4b26-40e3-b001-f1c7a81652b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:07.085560 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-83b8aa2e-4b26-40e3-b001-f1c7a81652b7 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:07.086770 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-83b8aa2e-4b26-40e3-b001-f1c7a81652b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:07.148143 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1425/2849] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:45:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:45:07.157092 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81fab5-c714-49e2-a2b1-a604f867264b None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:07.157382 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81fab5-c714-49e2-a2b1-a604f867264b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:07.157655 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81fab5-c714-49e2-a2b1-a604f867264b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:07.175840 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-4c81fab5-c714-49e2-a2b1-a604f867264b None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:07.177079 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4c81fab5-c714-49e2-a2b1-a604f867264b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:07.185922 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1425/2850] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:45:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:07.190328 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8aa2e-4b26-40e3-b001-f1c7a81652b7 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:07.200257 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8aa2e-4b26-40e3-b001-f1c7a81652b7 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:07.205463 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e469363-d849-4b92-9d02-0c10568fbc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:07.206120 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e469363-d849-4b92-9d02-0c10568fbc9d admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:07.206402 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e469363-d849-4b92-9d02-0c10568fbc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:07.206685 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e469363-d849-4b92-9d02-0c10568fbc9d admin admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:07.207414 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e469363-d849-4b92-9d02-0c10568fbc9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:45:07.207721 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e469363-d849-4b92-9d02-0c10568fbc9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:07.209419 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e469363-d849-4b92-9d02-0c10568fbc9d admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:07.221377 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1426/2851] 10.222.0.16 () {58 vars in 1152 bytes} [Thu May 26 12:45:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:45:07.225877 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c81fab5-c714-49e2-a2b1-a604f867264b None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:07.236195 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c81fab5-c714-49e2-a2b1-a604f867264b None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:07.240890 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab274b-cebf-40df-8b51-15b5f5c8586a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:07.241548 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab274b-cebf-40df-8b51-15b5f5c8586a admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:07.241833 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab274b-cebf-40df-8b51-15b5f5c8586a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:07.242111 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab274b-cebf-40df-8b51-15b5f5c8586a admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:07.242806 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ab274b-cebf-40df-8b51-15b5f5c8586a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:07.244751 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ab274b-cebf-40df-8b51-15b5f5c8586a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:07.272077 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1426/2852] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:45:07 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:45:07.276224 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e469363-d849-4b92-9d02-0c10568fbc9d admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:07.286363 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e469363-d849-4b92-9d02-0c10568fbc9d admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:07.328536 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:07.346101 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168e194-78df-4966-9c44-b58f959878b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:07.346805 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168e194-78df-4966-9c44-b58f959878b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:07.347086 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168e194-78df-4966-9c44-b58f959878b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:07.347359 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168e194-78df-4966-9c44-b58f959878b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:07.348051 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b168e194-78df-4966-9c44-b58f959878b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:07.350005 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b168e194-78df-4966-9c44-b58f959878b1 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:07.370103 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1427/2853] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:45:07 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:45:07.374481 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab274b-cebf-40df-8b51-15b5f5c8586a admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:07.384902 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab274b-cebf-40df-8b51-15b5f5c8586a admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:07.389836 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a779427-0871-45de-a7d4-e481ac877934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:07.390501 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a779427-0871-45de-a7d4-e481ac877934 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:07.390783 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a779427-0871-45de-a7d4-e481ac877934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:07.391057 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a779427-0871-45de-a7d4-e481ac877934 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:07.391787 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a779427-0871-45de-a7d4-e481ac877934 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:07.393423 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a779427-0871-45de-a7d4-e481ac877934 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:07.404905 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1427/2854] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:45:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:45:07.409114 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168e194-78df-4966-9c44-b58f959878b1 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:07.419130 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168e194-78df-4966-9c44-b58f959878b1 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:07.424347 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d01e9-d67c-497f-9a97-2460d4ec01de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:07.425037 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d01e9-d67c-497f-9a97-2460d4ec01de admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:07.425320 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d01e9-d67c-497f-9a97-2460d4ec01de admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:07.425593 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d01e9-d67c-497f-9a97-2460d4ec01de admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:07.426349 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9d01e9-d67c-497f-9a97-2460d4ec01de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:07.427927 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9d01e9-d67c-497f-9a97-2460d4ec01de admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:07.438175 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1428/2855] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:45:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:45:07.442587 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a779427-0871-45de-a7d4-e481ac877934 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:07.452565 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a779427-0871-45de-a7d4-e481ac877934 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:07.457256 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b5448-f73f-46b6-af50-f81220e3640e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:07.458138 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b5448-f73f-46b6-af50-f81220e3640e admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:07.458424 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b5448-f73f-46b6-af50-f81220e3640e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:07.458702 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b5448-f73f-46b6-af50-f81220e3640e admin admin] PATH_INFO: `/v3/projects/2a190ae2664c4e179e9e66184948490d/users/b51ce7fc8aa54b6b9e41d36c5c712207/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:07.474079 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514b5448-f73f-46b6-af50-f81220e3640e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a190ae2664c4e179e9e66184948490d, user_id=b51ce7fc8aa54b6b9e41d36c5c712207, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:07.476750 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514b5448-f73f-46b6-af50-f81220e3640e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:07.490331 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1428/2856] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:45:07 2022] PUT /identity/v3/projects/2a190ae2664c4e179e9e66184948490d/users/b51ce7fc8aa54b6b9e41d36c5c712207/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:45:07.501860 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbb3a6-3971-4237-82c1-68f1f807de2c None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:07.502150 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbb3a6-3971-4237-82c1-68f1f807de2c None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:07.502426 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbb3a6-3971-4237-82c1-68f1f807de2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:07.530605 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-0ffbb3a6-3971-4237-82c1-68f1f807de2c None None] MFA Rules not processed for user `b51ce7fc8aa54b6b9e41d36c5c712207`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:07.531831 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-0ffbb3a6-3971-4237-82c1-68f1f807de2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:07.599255 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1429/2857] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:45:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:07.611210 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b5448-f73f-46b6-af50-f81220e3640e admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:07.616372 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-514b5448-f73f-46b6-af50-f81220e3640e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:07.676575 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b5448-f73f-46b6-af50-f81220e3640e admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:07.680261 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a013e3c-4f3a-453e-a2f7-a2bea5b31cf0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:07.681025 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a013e3c-4f3a-453e-a2f7-a2bea5b31cf0 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:07.681313 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a013e3c-4f3a-453e-a2f7-a2bea5b31cf0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:07.681764 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a013e3c-4f3a-453e-a2f7-a2bea5b31cf0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:07.704243 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a013e3c-4f3a-453e-a2f7-a2bea5b31cf0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:07.705754 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a013e3c-4f3a-453e-a2f7-a2bea5b31cf0 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:07.710415 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:07.715894 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1429/2858] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:45:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:45:08.054500 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7493c724-dea5-4404-8bc0-e5bc82bb3b23 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:08.054790 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7493c724-dea5-4404-8bc0-e5bc82bb3b23 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:08.055067 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7493c724-dea5-4404-8bc0-e5bc82bb3b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:08.074357 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-7493c724-dea5-4404-8bc0-e5bc82bb3b23 None None] MFA Rules not processed for user `4e4f8738cc6e4a0a841c37cee863e1e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:08.075614 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-7493c724-dea5-4404-8bc0-e5bc82bb3b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:08.132897 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1430/2859] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:45:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:08.690141 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a013e3c-4f3a-453e-a2f7-a2bea5b31cf0 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:08.691694 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5a013e3c-4f3a-453e-a2f7-a2bea5b31cf0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:08.768691 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a013e3c-4f3a-453e-a2f7-a2bea5b31cf0 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:08.773714 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fabf9c-848b-457a-95b6-0a070f9a46b2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4327435c97834afeb7e6806ef02349a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:08.774369 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fabf9c-848b-457a-95b6-0a070f9a46b2 service placement] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:08.774653 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fabf9c-848b-457a-95b6-0a070f9a46b2 service placement] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:08.774935 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fabf9c-848b-457a-95b6-0a070f9a46b2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:08.776746 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d6fabf9c-848b-457a-95b6-0a070f9a46b2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:08.788643 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fabf9c-848b-457a-95b6-0a070f9a46b2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:08.790278 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fabf9c-848b-457a-95b6-0a070f9a46b2 service placement] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:08.800431 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1430/2860] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:45:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:45:10.551928 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7493c724-dea5-4404-8bc0-e5bc82bb3b23 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:10.554138 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-7493c724-dea5-4404-8bc0-e5bc82bb3b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:10.623937 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7493c724-dea5-4404-8bc0-e5bc82bb3b23 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:10.628306 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab4d892-14ad-46b3-87c7-eebfb8bdc04a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:10.629085 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4d892-14ad-46b3-87c7-eebfb8bdc04a service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:10.629369 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4d892-14ad-46b3-87c7-eebfb8bdc04a service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:10.629663 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4d892-14ad-46b3-87c7-eebfb8bdc04a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:10.631539 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-7ab4d892-14ad-46b3-87c7-eebfb8bdc04a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:10.643434 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab4d892-14ad-46b3-87c7-eebfb8bdc04a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:10.644880 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab4d892-14ad-46b3-87c7-eebfb8bdc04a service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:10.649500 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:10.654850 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1431/2861] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:45:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:45:18.796009 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=32 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:20.378773 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fabf9c-848b-457a-95b6-0a070f9a46b2 service placement] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:20.440660 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fabf9c-848b-457a-95b6-0a070f9a46b2 service placement] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:20.445248 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e8b91-28b4-422b-ae88-b6330b1be40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:20.446131 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e8b91-28b4-422b-ae88-b6330b1be40b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:20.446411 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e8b91-28b4-422b-ae88-b6330b1be40b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:20.446684 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e8b91-28b4-422b-ae88-b6330b1be40b admin admin] PATH_INFO: `/v3/users/b51ce7fc8aa54b6b9e41d36c5c712207` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:20.447902 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883e8b91-28b4-422b-ae88-b6330b1be40b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b51ce7fc8aa54b6b9e41d36c5c712207)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:20.450428 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883e8b91-28b4-422b-ae88-b6330b1be40b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:20.498851 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-883e8b91-28b4-422b-ae88-b6330b1be40b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b51ce7fc8aa54b6b9e41d36c5c712207'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:20.506118 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-883e8b91-28b4-422b-ae88-b6330b1be40b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b51ce7fc8aa54b6b9e41d36c5c712207'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:20.506814 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-883e8b91-28b4-422b-ae88-b6330b1be40b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b51ce7fc8aa54b6b9e41d36c5c712207'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:20.507476 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-883e8b91-28b4-422b-ae88-b6330b1be40b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b51ce7fc8aa54b6b9e41d36c5c712207'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:20.514813 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-883e8b91-28b4-422b-ae88-b6330b1be40b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b51ce7fc8aa54b6b9e41d36c5c712207'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:20.532198 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1431/2862] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:45:20 2022] DELETE /identity/v3/users/b51ce7fc8aa54b6b9e41d36c5c712207 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:20.536737 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c125c-8767-442f-b9ee-d462f32997e4 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:20.537268 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c125c-8767-442f-b9ee-d462f32997e4 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:20.537376 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c125c-8767-442f-b9ee-d462f32997e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:20.554672 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-fb9c125c-8767-442f-b9ee-d462f32997e4 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:20.555867 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-fb9c125c-8767-442f-b9ee-d462f32997e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:20.613484 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1432/2863] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:45:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:20.623548 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e8b91-28b4-422b-ae88-b6330b1be40b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:20.625021 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-883e8b91-28b4-422b-ae88-b6330b1be40b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:20.685090 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e8b91-28b4-422b-ae88-b6330b1be40b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:20.688779 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bda3ce5-71e3-484c-9318-0c26f1253f8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:20.689456 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda3ce5-71e3-484c-9318-0c26f1253f8c service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:20.689747 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda3ce5-71e3-484c-9318-0c26f1253f8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:20.690027 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda3ce5-71e3-484c-9318-0c26f1253f8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:20.699130 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bda3ce5-71e3-484c-9318-0c26f1253f8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:20.701245 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bda3ce5-71e3-484c-9318-0c26f1253f8c service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:20.711004 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1432/2864] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:45:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:45:20.982952 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c125c-8767-442f-b9ee-d462f32997e4 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:20.984447 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-fb9c125c-8767-442f-b9ee-d462f32997e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:20.998650 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c125c-8767-442f-b9ee-d462f32997e4 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:21.003378 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9613fe-ceb5-47ec-b240-7c0a3373a2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:21.004334 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9613fe-ceb5-47ec-b240-7c0a3373a2df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:21.004691 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9613fe-ceb5-47ec-b240-7c0a3373a2df admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:21.005070 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9613fe-ceb5-47ec-b240-7c0a3373a2df admin admin] PATH_INFO: `/v3/projects/2a190ae2664c4e179e9e66184948490d` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:21.006348 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9613fe-ceb5-47ec-b240-7c0a3373a2df admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a190ae2664c4e179e9e66184948490d)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:21.008376 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9613fe-ceb5-47ec-b240-7c0a3373a2df admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:21.060432 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-4d9613fe-ceb5-47ec-b240-7c0a3373a2df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a190ae2664c4e179e9e66184948490d', 'request_id': 'req-4d9613fe-ceb5-47ec-b240-7c0a3373a2df'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:21.068148 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-4d9613fe-ceb5-47ec-b240-7c0a3373a2df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a190ae2664c4e179e9e66184948490d', 'request_id': 'req-4d9613fe-ceb5-47ec-b240-7c0a3373a2df'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:21.074561 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-4d9613fe-ceb5-47ec-b240-7c0a3373a2df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a190ae2664c4e179e9e66184948490d', 'request_id': 'req-4d9613fe-ceb5-47ec-b240-7c0a3373a2df'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:21.085431 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-4d9613fe-ceb5-47ec-b240-7c0a3373a2df admin admin] The token cache is being invalidate because project 2a190ae2664c4e179e9e66184948490d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:45:21.085723 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-4d9613fe-ceb5-47ec-b240-7c0a3373a2df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:21.086364 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-4d9613fe-ceb5-47ec-b240-7c0a3373a2df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:21.087897 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1433/2865] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:45:20 2022] DELETE /identity/v3/projects/2a190ae2664c4e179e9e66184948490d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:21.093640 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ccb07d-cede-4f91-8333-1e7832dae619 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:21.093944 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ccb07d-cede-4f91-8333-1e7832dae619 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:21.094222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ccb07d-cede-4f91-8333-1e7832dae619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:21.111834 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b5ccb07d-cede-4f91-8333-1e7832dae619 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:21.113215 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b5ccb07d-cede-4f91-8333-1e7832dae619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:21.130382 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:21.176412 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1433/2866] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:45:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:21.184575 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad43b9f-ad52-47b0-acd6-ff69dd9f268c None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:21.184911 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad43b9f-ad52-47b0-acd6-ff69dd9f268c None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:21.185216 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad43b9f-ad52-47b0-acd6-ff69dd9f268c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:21.204494 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-9ad43b9f-ad52-47b0-acd6-ff69dd9f268c None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:21.205733 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-9ad43b9f-ad52-47b0-acd6-ff69dd9f268c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:21.214318 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1434/2867] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:45:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:21.218862 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ccb07d-cede-4f91-8333-1e7832dae619 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:21.229530 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ccb07d-cede-4f91-8333-1e7832dae619 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:21.235421 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7478c-4c04-45f0-a184-a7cd762bf382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:21.236188 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7478c-4c04-45f0-a184-a7cd762bf382 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:21.236545 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7478c-4c04-45f0-a184-a7cd762bf382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:21.236923 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7478c-4c04-45f0-a184-a7cd762bf382 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:21.237729 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db7478c-4c04-45f0-a184-a7cd762bf382 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:45:21.238048 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db7478c-4c04-45f0-a184-a7cd762bf382 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:21.239657 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db7478c-4c04-45f0-a184-a7cd762bf382 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:21.255859 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1434/2868] 10.222.0.16 () {58 vars in 1152 bytes} [Thu May 26 12:45:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:45:21.257319 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad43b9f-ad52-47b0-acd6-ff69dd9f268c None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:21.267365 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad43b9f-ad52-47b0-acd6-ff69dd9f268c None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:21.272077 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d2835-c5c1-4243-bc62-711f8e854715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:21.272751 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d2835-c5c1-4243-bc62-711f8e854715 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:21.273055 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d2835-c5c1-4243-bc62-711f8e854715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:21.273326 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d2835-c5c1-4243-bc62-711f8e854715 admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:21.274015 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d2835-c5c1-4243-bc62-711f8e854715 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:21.275947 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d2835-c5c1-4243-bc62-711f8e854715 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:21.304587 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1435/2869] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:45:21 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:45:21.308641 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7478c-4c04-45f0-a184-a7cd762bf382 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:21.318916 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7478c-4c04-45f0-a184-a7cd762bf382 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:21.380913 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d08899-3be0-480e-92ba-6f2f805737f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:21.381610 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d08899-3be0-480e-92ba-6f2f805737f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:21.381937 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d08899-3be0-480e-92ba-6f2f805737f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:21.382220 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d08899-3be0-480e-92ba-6f2f805737f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:21.382905 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d08899-3be0-480e-92ba-6f2f805737f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:21.384891 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d08899-3be0-480e-92ba-6f2f805737f2 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:21.406097 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1435/2870] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:45:21 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:45:21.410042 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d2835-c5c1-4243-bc62-711f8e854715 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:21.421187 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d2835-c5c1-4243-bc62-711f8e854715 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:21.425777 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a232a7-688b-4a1a-ba21-6ca1c4ea4daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:21.426428 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a232a7-688b-4a1a-ba21-6ca1c4ea4daa admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:21.426710 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a232a7-688b-4a1a-ba21-6ca1c4ea4daa admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:21.426979 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a232a7-688b-4a1a-ba21-6ca1c4ea4daa admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:21.427696 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a232a7-688b-4a1a-ba21-6ca1c4ea4daa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:21.429315 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a232a7-688b-4a1a-ba21-6ca1c4ea4daa admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:21.439975 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1436/2871] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:45:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:45:21.444128 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d08899-3be0-480e-92ba-6f2f805737f2 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:21.454718 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d08899-3be0-480e-92ba-6f2f805737f2 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:21.459594 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6878c131-e021-4866-8e78-80b9a8842095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:21.460274 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878c131-e021-4866-8e78-80b9a8842095 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:21.460576 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878c131-e021-4866-8e78-80b9a8842095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:21.460898 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878c131-e021-4866-8e78-80b9a8842095 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:21.461633 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6878c131-e021-4866-8e78-80b9a8842095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:21.463252 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6878c131-e021-4866-8e78-80b9a8842095 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:21.474204 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1436/2872] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:45:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:45:21.478404 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a232a7-688b-4a1a-ba21-6ca1c4ea4daa admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:21.489103 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a232a7-688b-4a1a-ba21-6ca1c4ea4daa admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:21.493712 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d8400a-ce94-4666-bb7f-2fe4e7215471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:21.494577 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8400a-ce94-4666-bb7f-2fe4e7215471 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:21.494854 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8400a-ce94-4666-bb7f-2fe4e7215471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:21.495128 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8400a-ce94-4666-bb7f-2fe4e7215471 admin admin] PATH_INFO: `/v3/projects/d6b3947465bc40f3a8e08841f157e204/users/99c5cebe71494a419ce6f7dac494fe4f/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:21.510145 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d8400a-ce94-4666-bb7f-2fe4e7215471 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6b3947465bc40f3a8e08841f157e204, user_id=99c5cebe71494a419ce6f7dac494fe4f, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:21.512827 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d8400a-ce94-4666-bb7f-2fe4e7215471 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:21.525932 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1437/2873] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:45:21 2022] PUT /identity/v3/projects/d6b3947465bc40f3a8e08841f157e204/users/99c5cebe71494a419ce6f7dac494fe4f/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:21.537428 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f209f6-6361-40f2-b49f-0d45ea7f1212 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:21.537725 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f209f6-6361-40f2-b49f-0d45ea7f1212 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:21.538009 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f209f6-6361-40f2-b49f-0d45ea7f1212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:21.565387 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-56f209f6-6361-40f2-b49f-0d45ea7f1212 None None] MFA Rules not processed for user `99c5cebe71494a419ce6f7dac494fe4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:21.566692 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-56f209f6-6361-40f2-b49f-0d45ea7f1212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:21.635693 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1437/2874] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:45:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:21.643174 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d8400a-ce94-4666-bb7f-2fe4e7215471 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:21.644984 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-78d8400a-ce94-4666-bb7f-2fe4e7215471 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:21.667764 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:21.707117 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d8400a-ce94-4666-bb7f-2fe4e7215471 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:21.710859 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb7543-8f24-42de-b05a-048c04a0ae55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:21.711532 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb7543-8f24-42de-b05a-048c04a0ae55 service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:21.711814 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb7543-8f24-42de-b05a-048c04a0ae55 service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:21.712085 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb7543-8f24-42de-b05a-048c04a0ae55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:21.721663 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deb7543-8f24-42de-b05a-048c04a0ae55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:21.723130 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deb7543-8f24-42de-b05a-048c04a0ae55 service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:21.733127 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1438/2875] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:45:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:45:23.542559 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75fb50-ae9a-4534-8902-a2c576e685ca None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:23.543101 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75fb50-ae9a-4534-8902-a2c576e685ca None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:23.543265 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75fb50-ae9a-4534-8902-a2c576e685ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:23.562125 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-ed75fb50-ae9a-4534-8902-a2c576e685ca None None] MFA Rules not processed for user `4e4f8738cc6e4a0a841c37cee863e1e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:23.563631 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ed75fb50-ae9a-4534-8902-a2c576e685ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:23.576799 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:23.627336 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1438/2876] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:45:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:24.810177 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb7543-8f24-42de-b05a-048c04a0ae55 service cinder] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:24.881201 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb7543-8f24-42de-b05a-048c04a0ae55 service cinder] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:24.885724 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e569b5d-189f-481f-87c9-61e95c6cd1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:24.886597 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e569b5d-189f-481f-87c9-61e95c6cd1d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:24.886887 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e569b5d-189f-481f-87c9-61e95c6cd1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:24.887165 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e569b5d-189f-481f-87c9-61e95c6cd1d0 admin admin] PATH_INFO: `/v3/users/99c5cebe71494a419ce6f7dac494fe4f` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:24.888354 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e569b5d-189f-481f-87c9-61e95c6cd1d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99c5cebe71494a419ce6f7dac494fe4f)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:24.890312 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e569b5d-189f-481f-87c9-61e95c6cd1d0 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:24.937676 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-6e569b5d-189f-481f-87c9-61e95c6cd1d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99c5cebe71494a419ce6f7dac494fe4f'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:24.938324 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-6e569b5d-189f-481f-87c9-61e95c6cd1d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99c5cebe71494a419ce6f7dac494fe4f'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:24.938914 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-6e569b5d-189f-481f-87c9-61e95c6cd1d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99c5cebe71494a419ce6f7dac494fe4f'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:24.946576 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-6e569b5d-189f-481f-87c9-61e95c6cd1d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99c5cebe71494a419ce6f7dac494fe4f'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:24.960034 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-6e569b5d-189f-481f-87c9-61e95c6cd1d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99c5cebe71494a419ce6f7dac494fe4f'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:24.973342 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1439/2877] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:45:24 2022] DELETE /identity/v3/users/99c5cebe71494a419ce6f7dac494fe4f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:24.977853 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd460992-2948-4bdb-a262-635f48da602b None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:24.978349 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd460992-2948-4bdb-a262-635f48da602b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:24.978448 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd460992-2948-4bdb-a262-635f48da602b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:24.997430 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-dd460992-2948-4bdb-a262-635f48da602b None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:24.998749 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-dd460992-2948-4bdb-a262-635f48da602b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:25.063345 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1439/2878] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:45:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:25.076436 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e569b5d-189f-481f-87c9-61e95c6cd1d0 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:25.077906 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-6e569b5d-189f-481f-87c9-61e95c6cd1d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:25.141551 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:25.157158 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e569b5d-189f-481f-87c9-61e95c6cd1d0 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:25.161488 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df59649-7d33-403c-a3a4-d5ea4fb7097d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:25.162199 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df59649-7d33-403c-a3a4-d5ea4fb7097d service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:25.162485 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df59649-7d33-403c-a3a4-d5ea4fb7097d service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:25.162762 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df59649-7d33-403c-a3a4-d5ea4fb7097d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:25.175156 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df59649-7d33-403c-a3a4-d5ea4fb7097d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:25.176673 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df59649-7d33-403c-a3a4-d5ea4fb7097d service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:25.188301 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1440/2879] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:45:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:45:25.647131 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd460992-2948-4bdb-a262-635f48da602b None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:25.648877 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-dd460992-2948-4bdb-a262-635f48da602b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:25.662917 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd460992-2948-4bdb-a262-635f48da602b None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:25.670216 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d576bf1-6695-48b4-b388-8d5dd497dbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:25.671367 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d576bf1-6695-48b4-b388-8d5dd497dbc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:25.671830 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d576bf1-6695-48b4-b388-8d5dd497dbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:25.672298 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d576bf1-6695-48b4-b388-8d5dd497dbc0 admin admin] PATH_INFO: `/v3/projects/d6b3947465bc40f3a8e08841f157e204` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:25.673815 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d576bf1-6695-48b4-b388-8d5dd497dbc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6b3947465bc40f3a8e08841f157e204)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:25.675890 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d576bf1-6695-48b4-b388-8d5dd497dbc0 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:25.734076 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9d576bf1-6695-48b4-b388-8d5dd497dbc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6b3947465bc40f3a8e08841f157e204', 'request_id': 'req-9d576bf1-6695-48b4-b388-8d5dd497dbc0'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:25.741861 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9d576bf1-6695-48b4-b388-8d5dd497dbc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6b3947465bc40f3a8e08841f157e204', 'request_id': 'req-9d576bf1-6695-48b4-b388-8d5dd497dbc0'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:25.749278 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9d576bf1-6695-48b4-b388-8d5dd497dbc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6b3947465bc40f3a8e08841f157e204', 'request_id': 'req-9d576bf1-6695-48b4-b388-8d5dd497dbc0'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:25.767648 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9d576bf1-6695-48b4-b388-8d5dd497dbc0 admin admin] The token cache is being invalidate because project d6b3947465bc40f3a8e08841f157e204 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:45:25.768037 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9d576bf1-6695-48b4-b388-8d5dd497dbc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:25.768786 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9d576bf1-6695-48b4-b388-8d5dd497dbc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:25.770451 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1440/2880] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:45:25 2022] DELETE /identity/v3/projects/d6b3947465bc40f3a8e08841f157e204 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:25.781779 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e5df4-8e4d-49ea-98c9-274e5f1a1dc5 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:25.782055 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e5df4-8e4d-49ea-98c9-274e5f1a1dc5 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:25.782362 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e5df4-8e4d-49ea-98c9-274e5f1a1dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:25.801871 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-7f5e5df4-8e4d-49ea-98c9-274e5f1a1dc5 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:25.803119 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-7f5e5df4-8e4d-49ea-98c9-274e5f1a1dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:25.867296 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1441/2881] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:45:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:25.875995 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1294ea5-9745-4575-83ca-3525168d183a None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:25.876402 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1294ea5-9745-4575-83ca-3525168d183a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:25.876775 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1294ea5-9745-4575-83ca-3525168d183a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:25.895933 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c1294ea5-9745-4575-83ca-3525168d183a None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:25.897269 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c1294ea5-9745-4575-83ca-3525168d183a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:25.906010 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1441/2882] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:45:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:25.910323 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e5df4-8e4d-49ea-98c9-274e5f1a1dc5 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:25.923523 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e5df4-8e4d-49ea-98c9-274e5f1a1dc5 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:25.931325 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70e410-1670-4fc5-aa57-8b07da836cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:25.931997 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70e410-1670-4fc5-aa57-8b07da836cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:25.932281 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70e410-1670-4fc5-aa57-8b07da836cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:25.932603 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70e410-1670-4fc5-aa57-8b07da836cd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:25.933419 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a70e410-1670-4fc5-aa57-8b07da836cd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:45:25.933722 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a70e410-1670-4fc5-aa57-8b07da836cd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:25.935341 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a70e410-1670-4fc5-aa57-8b07da836cd0 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:25.951924 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1442/2883] 10.222.0.16 () {58 vars in 1152 bytes} [Thu May 26 12:45:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:45:25.953081 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1294ea5-9745-4575-83ca-3525168d183a None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:25.962453 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1294ea5-9745-4575-83ca-3525168d183a None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:25.968108 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89370869-150c-41cd-b78b-421257564d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:25.968766 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89370869-150c-41cd-b78b-421257564d8e admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:25.969076 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89370869-150c-41cd-b78b-421257564d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:25.969357 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89370869-150c-41cd-b78b-421257564d8e admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:25.970049 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89370869-150c-41cd-b78b-421257564d8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:25.971988 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89370869-150c-41cd-b78b-421257564d8e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:26.009334 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1442/2884] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:45:25 2022] POST /identity/v3/projects => generated 389 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:45:26.013584 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70e410-1670-4fc5-aa57-8b07da836cd0 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:26.023508 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70e410-1670-4fc5-aa57-8b07da836cd0 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:26.083411 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c2836-058f-4bff-8be0-54ee91bc5396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:26.084088 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c2836-058f-4bff-8be0-54ee91bc5396 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:26.084374 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c2836-058f-4bff-8be0-54ee91bc5396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:26.084707 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c2836-058f-4bff-8be0-54ee91bc5396 admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:26.085468 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018c2836-058f-4bff-8be0-54ee91bc5396 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:26.087433 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018c2836-058f-4bff-8be0-54ee91bc5396 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:26.109649 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1443/2885] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:45:26 2022] POST /identity/v3/users => generated 295 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:45:26.113809 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89370869-150c-41cd-b78b-421257564d8e admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:26.125078 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89370869-150c-41cd-b78b-421257564d8e admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:26.130246 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eecd255-f2be-4fb3-9aef-ce3a148c7b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:26.130601 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eecd255-f2be-4fb3-9aef-ce3a148c7b20 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:26.130879 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eecd255-f2be-4fb3-9aef-ce3a148c7b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:26.131152 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eecd255-f2be-4fb3-9aef-ce3a148c7b20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:26.131877 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eecd255-f2be-4fb3-9aef-ce3a148c7b20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:26.133531 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eecd255-f2be-4fb3-9aef-ce3a148c7b20 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:26.144931 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1443/2886] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:45:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:45:26.149158 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c2836-058f-4bff-8be0-54ee91bc5396 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:26.160587 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c2836-058f-4bff-8be0-54ee91bc5396 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:26.165410 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a205c-a3a1-4772-82e9-cd21ce1194bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:26.166077 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a205c-a3a1-4772-82e9-cd21ce1194bc admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:26.166365 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a205c-a3a1-4772-82e9-cd21ce1194bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:26.166642 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a205c-a3a1-4772-82e9-cd21ce1194bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:26.167950 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2a205c-a3a1-4772-82e9-cd21ce1194bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:26.170156 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2a205c-a3a1-4772-82e9-cd21ce1194bc admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:26.184025 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1444/2887] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:45:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:45:26.185148 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eecd255-f2be-4fb3-9aef-ce3a148c7b20 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:26.196504 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eecd255-f2be-4fb3-9aef-ce3a148c7b20 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:26.202361 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffcb2d3-d686-4d6f-b96a-7a19f567a39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:26.203256 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffcb2d3-d686-4d6f-b96a-7a19f567a39e admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:26.203540 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffcb2d3-d686-4d6f-b96a-7a19f567a39e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:26.203815 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffcb2d3-d686-4d6f-b96a-7a19f567a39e admin admin] PATH_INFO: `/v3/projects/40df91bc94b449128b2b19853b87d18c/users/4ddb59072790461bb99e91d67cd73e4d/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:26.206458 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:26.223581 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffcb2d3-d686-4d6f-b96a-7a19f567a39e admin admin] RBAC: Authorizing `identity:create_grant(project_id=40df91bc94b449128b2b19853b87d18c, user_id=4ddb59072790461bb99e91d67cd73e4d, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:26.226315 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffcb2d3-d686-4d6f-b96a-7a19f567a39e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:26.240071 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1444/2888] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:45:26 2022] PUT /identity/v3/projects/40df91bc94b449128b2b19853b87d18c/users/4ddb59072790461bb99e91d67cd73e4d/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:26.252166 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd198216-2206-47eb-9c32-e65d26c085cc None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:26.252458 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd198216-2206-47eb-9c32-e65d26c085cc None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:26.252738 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd198216-2206-47eb-9c32-e65d26c085cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:26.281132 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-cd198216-2206-47eb-9c32-e65d26c085cc None None] MFA Rules not processed for user `4ddb59072790461bb99e91d67cd73e4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:26.282367 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-cd198216-2206-47eb-9c32-e65d26c085cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:26.332696 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:26.360118 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1445/2889] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:45:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:26.372653 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffcb2d3-d686-4d6f-b96a-7a19f567a39e admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:26.374981 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0ffcb2d3-d686-4d6f-b96a-7a19f567a39e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:26.458169 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffcb2d3-d686-4d6f-b96a-7a19f567a39e admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:26.463117 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d2e3b-5e8b-4d42-9cb2-5e7782fecda2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:26.464875 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d2e3b-5e8b-4d42-9cb2-5e7782fecda2 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:26.465762 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d2e3b-5e8b-4d42-9cb2-5e7782fecda2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:26.466057 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d2e3b-5e8b-4d42-9cb2-5e7782fecda2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:26.479711 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d2e3b-5e8b-4d42-9cb2-5e7782fecda2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:26.481246 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d2e3b-5e8b-4d42-9cb2-5e7782fecda2 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:26.492055 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1445/2890] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:45:26 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:45:26.673990 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd198216-2206-47eb-9c32-e65d26c085cc None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:26.677712 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-cd198216-2206-47eb-9c32-e65d26c085cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:26.802821 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd198216-2206-47eb-9c32-e65d26c085cc None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:26.809522 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de6a7fc-b5d5-4bfc-b67a-c1fccb81ae9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536f68ff77794352adf41aaacdc0645c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:26.810336 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6a7fc-b5d5-4bfc-b67a-c1fccb81ae9b service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:26.810509 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6a7fc-b5d5-4bfc-b67a-c1fccb81ae9b service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:26.810963 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6a7fc-b5d5-4bfc-b67a-c1fccb81ae9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:26.814154 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-7de6a7fc-b5d5-4bfc-b67a-c1fccb81ae9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:26.836437 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de6a7fc-b5d5-4bfc-b67a-c1fccb81ae9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:26.838678 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de6a7fc-b5d5-4bfc-b67a-c1fccb81ae9b service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:26.854405 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1446/2891] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:45:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:45:36.486612 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=33,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:36.601828 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d2e3b-5e8b-4d42-9cb2-5e7782fecda2 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:36.673846 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d2e3b-5e8b-4d42-9cb2-5e7782fecda2 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:36.678614 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e9afe-8753-441d-ab34-335fe2349719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:36.679612 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e9afe-8753-441d-ab34-335fe2349719 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:36.680029 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e9afe-8753-441d-ab34-335fe2349719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:36.680470 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e9afe-8753-441d-ab34-335fe2349719 admin admin] PATH_INFO: `/v3/users/4ddb59072790461bb99e91d67cd73e4d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:36.681906 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e9afe-8753-441d-ab34-335fe2349719 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ddb59072790461bb99e91d67cd73e4d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:36.684391 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e9afe-8753-441d-ab34-335fe2349719 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:36.730717 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5b5e9afe-8753-441d-ab34-335fe2349719 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ddb59072790461bb99e91d67cd73e4d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:36.737744 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5b5e9afe-8753-441d-ab34-335fe2349719 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ddb59072790461bb99e91d67cd73e4d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:36.738368 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5b5e9afe-8753-441d-ab34-335fe2349719 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ddb59072790461bb99e91d67cd73e4d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:36.738972 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5b5e9afe-8753-441d-ab34-335fe2349719 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ddb59072790461bb99e91d67cd73e4d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:36.746312 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5b5e9afe-8753-441d-ab34-335fe2349719 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ddb59072790461bb99e91d67cd73e4d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:36.768159 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1446/2892] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:45:36 2022] DELETE /identity/v3/users/4ddb59072790461bb99e91d67cd73e4d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:45:36.772816 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8881727-83fc-4607-ad90-0e3a3db6e602 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:36.773313 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8881727-83fc-4607-ad90-0e3a3db6e602 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:36.773524 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8881727-83fc-4607-ad90-0e3a3db6e602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:36.790800 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-f8881727-83fc-4607-ad90-0e3a3db6e602 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:36.792007 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-f8881727-83fc-4607-ad90-0e3a3db6e602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:36.850711 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1447/2893] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:45:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:36.860200 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e9afe-8753-441d-ab34-335fe2349719 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:36.861811 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5b5e9afe-8753-441d-ab34-335fe2349719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:36.918625 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e9afe-8753-441d-ab34-335fe2349719 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:36.922277 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72efe50f-032f-415f-ade9-f61729f6bc2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:36.922916 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72efe50f-032f-415f-ade9-f61729f6bc2e service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:36.923200 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72efe50f-032f-415f-ade9-f61729f6bc2e service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:36.923476 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72efe50f-032f-415f-ade9-f61729f6bc2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:36.932374 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72efe50f-032f-415f-ade9-f61729f6bc2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:36.933849 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72efe50f-032f-415f-ade9-f61729f6bc2e service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:36.943302 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1447/2894] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:45:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:45:37.487348 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8881727-83fc-4607-ad90-0e3a3db6e602 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:37.488802 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-f8881727-83fc-4607-ad90-0e3a3db6e602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:37.501864 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8881727-83fc-4607-ad90-0e3a3db6e602 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:37.506683 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f696093-4708-4060-a7b2-86670afc3932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:37.507551 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f696093-4708-4060-a7b2-86670afc3932 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:37.507877 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f696093-4708-4060-a7b2-86670afc3932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:37.508243 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f696093-4708-4060-a7b2-86670afc3932 admin admin] PATH_INFO: `/v3/projects/40df91bc94b449128b2b19853b87d18c` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:37.510057 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f696093-4708-4060-a7b2-86670afc3932 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40df91bc94b449128b2b19853b87d18c)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:37.512057 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f696093-4708-4060-a7b2-86670afc3932 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:37.562248 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-8f696093-4708-4060-a7b2-86670afc3932 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40df91bc94b449128b2b19853b87d18c', 'request_id': 'req-8f696093-4708-4060-a7b2-86670afc3932'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:37.570938 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-8f696093-4708-4060-a7b2-86670afc3932 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40df91bc94b449128b2b19853b87d18c', 'request_id': 'req-8f696093-4708-4060-a7b2-86670afc3932'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:37.577983 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-8f696093-4708-4060-a7b2-86670afc3932 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40df91bc94b449128b2b19853b87d18c', 'request_id': 'req-8f696093-4708-4060-a7b2-86670afc3932'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:37.579730 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:37.591916 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-8f696093-4708-4060-a7b2-86670afc3932 admin admin] The token cache is being invalidate because project 40df91bc94b449128b2b19853b87d18c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:45:37.592193 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-8f696093-4708-4060-a7b2-86670afc3932 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:37.592941 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-8f696093-4708-4060-a7b2-86670afc3932 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:37.594976 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1448/2895] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:45:37 2022] DELETE /identity/v3/projects/40df91bc94b449128b2b19853b87d18c => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:40.430437 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92344b5-4c36-41a5-85c3-cc766c5fb3c4 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:40.430966 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92344b5-4c36-41a5-85c3-cc766c5fb3c4 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:40.431071 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92344b5-4c36-41a5-85c3-cc766c5fb3c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:40.448269 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c92344b5-4c36-41a5-85c3-cc766c5fb3c4 None None] MFA Rules not processed for user `512b4337083145f9ae57948a63444ced`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:40.449516 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c92344b5-4c36-41a5-85c3-cc766c5fb3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:40.466675 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:40.506582 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1448/2896] 10.222.0.16 () {58 vars in 1009 bytes} [Thu May 26 12:45:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:40.519085 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f696093-4708-4060-a7b2-86670afc3932 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:40.520468 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-8f696093-4708-4060-a7b2-86670afc3932 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:40.590271 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f696093-4708-4060-a7b2-86670afc3932 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:40.597771 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11494992-63c3-4acf-a4c8-8473cac484ec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02767dcbd1574e08a9e82a775ac2b289', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:40.598482 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11494992-63c3-4acf-a4c8-8473cac484ec service swift] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:40.598762 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11494992-63c3-4acf-a4c8-8473cac484ec service swift] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:40.599032 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11494992-63c3-4acf-a4c8-8473cac484ec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:40.608473 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11494992-63c3-4acf-a4c8-8473cac484ec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:40.610156 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11494992-63c3-4acf-a4c8-8473cac484ec service swift] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:40.618169 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1449/2897] 10.222.0.16 () {60 vars in 1384 bytes} [Thu May 26 12:45:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:45:50.499942 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=15 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:50.615498 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:DELETE=2,keystone:SELECT=35 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:55.070338 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96703d8c-b449-4562-bf3b-56f83a27796e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:55.070827 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96703d8c-b449-4562-bf3b-56f83a27796e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:55.070931 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96703d8c-b449-4562-bf3b-56f83a27796e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:55.089562 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-96703d8c-b449-4562-bf3b-56f83a27796e None None] MFA Rules not processed for user `512b4337083145f9ae57948a63444ced`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:55.090798 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-96703d8c-b449-4562-bf3b-56f83a27796e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:55.098252 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1449/2898] 10.222.0.16 () {58 vars in 967 bytes} [Thu May 26 12:45:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:55.120918 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11494992-63c3-4acf-a4c8-8473cac484ec service swift] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:55.132423 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11494992-63c3-4acf-a4c8-8473cac484ec service swift] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:55.137663 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dca643-e4ef-4c0b-9531-0a46fb787e52 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02767dcbd1574e08a9e82a775ac2b289', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:55.138309 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dca643-e4ef-4c0b-9531-0a46fb787e52 service swift] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:55.138614 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dca643-e4ef-4c0b-9531-0a46fb787e52 service swift] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:55.138873 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dca643-e4ef-4c0b-9531-0a46fb787e52 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:55.148303 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dca643-e4ef-4c0b-9531-0a46fb787e52 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:55.149923 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dca643-e4ef-4c0b-9531-0a46fb787e52 service swift] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:55.159178 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1450/2899] 10.222.0.16 () {60 vars in 1384 bytes} [Thu May 26 12:45:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:45:57.126043 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96703d8c-b449-4562-bf3b-56f83a27796e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:57.127603 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-96703d8c-b449-4562-bf3b-56f83a27796e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:57.195315 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96703d8c-b449-4562-bf3b-56f83a27796e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:57.200648 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c40ba35-9dfa-4360-aae4-3f81dd76da49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:57.201595 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40ba35-9dfa-4360-aae4-3f81dd76da49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:57.201822 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40ba35-9dfa-4360-aae4-3f81dd76da49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:57.202097 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40ba35-9dfa-4360-aae4-3f81dd76da49 admin admin] PATH_INFO: `/v3/users/4e4f8738cc6e4a0a841c37cee863e1e9` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:57.203305 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c40ba35-9dfa-4360-aae4-3f81dd76da49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e4f8738cc6e4a0a841c37cee863e1e9)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:57.205292 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c40ba35-9dfa-4360-aae4-3f81dd76da49 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:57.254243 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8c40ba35-9dfa-4360-aae4-3f81dd76da49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e4f8738cc6e4a0a841c37cee863e1e9'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:57.262145 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8c40ba35-9dfa-4360-aae4-3f81dd76da49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e4f8738cc6e4a0a841c37cee863e1e9'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:57.262801 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8c40ba35-9dfa-4360-aae4-3f81dd76da49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e4f8738cc6e4a0a841c37cee863e1e9'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:57.263401 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8c40ba35-9dfa-4360-aae4-3f81dd76da49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e4f8738cc6e4a0a841c37cee863e1e9'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:57.271253 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8c40ba35-9dfa-4360-aae4-3f81dd76da49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e4f8738cc6e4a0a841c37cee863e1e9'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:57.288950 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1450/2900] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:45:57 2022] DELETE /identity/v3/users/4e4f8738cc6e4a0a841c37cee863e1e9 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:57.461903 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dca643-e4ef-4c0b-9531-0a46fb787e52 service swift] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:57.472903 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dca643-e4ef-4c0b-9531-0a46fb787e52 service swift] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:57.535629 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab827090-df05-453e-9be3-8e24ac3e11f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:57.536489 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab827090-df05-453e-9be3-8e24ac3e11f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:57.536775 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab827090-df05-453e-9be3-8e24ac3e11f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:57.537084 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab827090-df05-453e-9be3-8e24ac3e11f8 admin admin] PATH_INFO: `/v3/projects/5b112898e0b14c62b0641df0b1cb61b9` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:57.538272 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab827090-df05-453e-9be3-8e24ac3e11f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b112898e0b14c62b0641df0b1cb61b9)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:57.540173 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab827090-df05-453e-9be3-8e24ac3e11f8 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:57.589162 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-ab827090-df05-453e-9be3-8e24ac3e11f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b112898e0b14c62b0641df0b1cb61b9', 'request_id': 'req-ab827090-df05-453e-9be3-8e24ac3e11f8'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:57.596931 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-ab827090-df05-453e-9be3-8e24ac3e11f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b112898e0b14c62b0641df0b1cb61b9', 'request_id': 'req-ab827090-df05-453e-9be3-8e24ac3e11f8'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:57.605213 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-ab827090-df05-453e-9be3-8e24ac3e11f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b112898e0b14c62b0641df0b1cb61b9', 'request_id': 'req-ab827090-df05-453e-9be3-8e24ac3e11f8'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:57.616093 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-ab827090-df05-453e-9be3-8e24ac3e11f8 admin admin] The token cache is being invalidate because project 5b112898e0b14c62b0641df0b1cb61b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:45:57.616376 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-ab827090-df05-453e-9be3-8e24ac3e11f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:57.617053 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-ab827090-df05-453e-9be3-8e24ac3e11f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:57.618583 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1451/2901] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:45:57 2022] DELETE /identity/v3/projects/5b112898e0b14c62b0641df0b1cb61b9 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:57.624161 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795cd0ec-05a1-495f-a1fb-d0cd591031a4 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:57.624449 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795cd0ec-05a1-495f-a1fb-d0cd591031a4 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:57.624731 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795cd0ec-05a1-495f-a1fb-d0cd591031a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:57.642619 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-795cd0ec-05a1-495f-a1fb-d0cd591031a4 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:57.643875 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-795cd0ec-05a1-495f-a1fb-d0cd591031a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:57.709722 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1451/2902] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:45:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:57.717506 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ec5ca-643f-4209-b9f7-b1b2f3a8bd95 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:57.717795 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ec5ca-643f-4209-b9f7-b1b2f3a8bd95 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:57.718069 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ec5ca-643f-4209-b9f7-b1b2f3a8bd95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:57.740384 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-732ec5ca-643f-4209-b9f7-b1b2f3a8bd95 None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:57.741648 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-732ec5ca-643f-4209-b9f7-b1b2f3a8bd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:57.750374 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1452/2903] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:45:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:57.756948 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795cd0ec-05a1-495f-a1fb-d0cd591031a4 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:57.766814 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795cd0ec-05a1-495f-a1fb-d0cd591031a4 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:57.771409 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bebe51b-23dc-4534-ab54-014fe76b7750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:57.772059 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebe51b-23dc-4534-ab54-014fe76b7750 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:57.772341 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebe51b-23dc-4534-ab54-014fe76b7750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:57.772618 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebe51b-23dc-4534-ab54-014fe76b7750 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:57.773380 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bebe51b-23dc-4534-ab54-014fe76b7750 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:45:57.773677 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bebe51b-23dc-4534-ab54-014fe76b7750 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:57.775266 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bebe51b-23dc-4534-ab54-014fe76b7750 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:57.783760 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:57.787912 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1452/2904] 10.222.0.16 () {58 vars in 1152 bytes} [Thu May 26 12:45:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:45:57.793109 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ec5ca-643f-4209-b9f7-b1b2f3a8bd95 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:57.802617 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ec5ca-643f-4209-b9f7-b1b2f3a8bd95 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:57.807882 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd443b-3f40-4878-b234-278035e2e6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:57.808541 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd443b-3f40-4878-b234-278035e2e6bd admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:57.808824 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd443b-3f40-4878-b234-278035e2e6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:57.809151 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd443b-3f40-4878-b234-278035e2e6bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:57.809847 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bd443b-3f40-4878-b234-278035e2e6bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:57.811745 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bd443b-3f40-4878-b234-278035e2e6bd admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:57.839194 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1453/2905] 10.222.0.16 () {60 vars in 1152 bytes} [Thu May 26 12:45:57 2022] POST /identity/v3/projects => generated 399 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:45:57.843547 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bebe51b-23dc-4534-ab54-014fe76b7750 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:57.853609 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bebe51b-23dc-4534-ab54-014fe76b7750 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:57.910100 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f6b64-1c01-4f55-b2b2-83ddbeb4643e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:57.910778 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f6b64-1c01-4f55-b2b2-83ddbeb4643e admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:57.911067 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f6b64-1c01-4f55-b2b2-83ddbeb4643e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:57.911361 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f6b64-1c01-4f55-b2b2-83ddbeb4643e admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:57.912052 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709f6b64-1c01-4f55-b2b2-83ddbeb4643e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:57.914064 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709f6b64-1c01-4f55-b2b2-83ddbeb4643e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:57.935984 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1453/2906] 10.222.0.16 () {60 vars in 1143 bytes} [Thu May 26 12:45:57 2022] POST /identity/v3/users => generated 300 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:45:57.940278 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd443b-3f40-4878-b234-278035e2e6bd admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:57.950780 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd443b-3f40-4878-b234-278035e2e6bd admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:57.955499 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18153fd-16bd-40ba-9582-5926100e1b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:57.956161 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18153fd-16bd-40ba-9582-5926100e1b52 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:57.956445 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18153fd-16bd-40ba-9582-5926100e1b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:57.956722 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18153fd-16bd-40ba-9582-5926100e1b52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:57.957481 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18153fd-16bd-40ba-9582-5926100e1b52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:57.959078 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18153fd-16bd-40ba-9582-5926100e1b52 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:57.970607 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1454/2907] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:45:57.974582 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f6b64-1c01-4f55-b2b2-83ddbeb4643e admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:57.985220 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f6b64-1c01-4f55-b2b2-83ddbeb4643e admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:57.989886 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e89df9b-78e1-4028-996b-09bf267caf1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:57.990545 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89df9b-78e1-4028-996b-09bf267caf1c admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:57.990828 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89df9b-78e1-4028-996b-09bf267caf1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:57.991104 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89df9b-78e1-4028-996b-09bf267caf1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:57.991824 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e89df9b-78e1-4028-996b-09bf267caf1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:57.993478 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e89df9b-78e1-4028-996b-09bf267caf1c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:58.004505 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1454/2908] 10.222.0.16 () {58 vars in 1121 bytes} [Thu May 26 12:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:45:58.008705 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18153fd-16bd-40ba-9582-5926100e1b52 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:58.019028 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18153fd-16bd-40ba-9582-5926100e1b52 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:58.023646 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d54395-82f9-4cdf-b230-1a765a3f422b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:58.027272 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d54395-82f9-4cdf-b230-1a765a3f422b admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:58.027272 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d54395-82f9-4cdf-b230-1a765a3f422b admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:58.027272 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d54395-82f9-4cdf-b230-1a765a3f422b admin admin] PATH_INFO: `/v3/projects/46457ebdb9c345fc979abd2ee0129049/users/f2f1cac1f468461d8fd75920f775bddc/roles/b0bf2a578f0a4319b93dd3b8a26a96b7` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:58.040748 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d54395-82f9-4cdf-b230-1a765a3f422b admin admin] RBAC: Authorizing `identity:create_grant(project_id=46457ebdb9c345fc979abd2ee0129049, user_id=f2f1cac1f468461d8fd75920f775bddc, role_id=b0bf2a578f0a4319b93dd3b8a26a96b7)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:58.044062 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d54395-82f9-4cdf-b230-1a765a3f422b admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:58.057722 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1455/2909] 10.222.0.16 () {60 vars in 1482 bytes} [Thu May 26 12:45:58 2022] PUT /identity/v3/projects/46457ebdb9c345fc979abd2ee0129049/users/f2f1cac1f468461d8fd75920f775bddc/roles/b0bf2a578f0a4319b93dd3b8a26a96b7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:45:58.067796 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbb358-bd92-46a4-92d1-1a2d5f1108a3 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:58.068091 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbb358-bd92-46a4-92d1-1a2d5f1108a3 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:58.068374 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbb358-bd92-46a4-92d1-1a2d5f1108a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:58.095207 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d7fbb358-bd92-46a4-92d1-1a2d5f1108a3 None None] MFA Rules not processed for user `f2f1cac1f468461d8fd75920f775bddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:58.096444 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d7fbb358-bd92-46a4-92d1-1a2d5f1108a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:58.163209 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1455/2910] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:45:58 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:58.175378 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d54395-82f9-4cdf-b230-1a765a3f422b admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:58.177612 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-84d54395-82f9-4cdf-b230-1a765a3f422b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:58.192509 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:58.239864 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d54395-82f9-4cdf-b230-1a765a3f422b admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:58.243594 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40deb81-2a9c-4b3b-8daa-dcd255652f32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736554efeba94a0b9547d18c3fc84fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:58.244313 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40deb81-2a9c-4b3b-8daa-dcd255652f32 service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:58.245212 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40deb81-2a9c-4b3b-8daa-dcd255652f32 service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:58.245519 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40deb81-2a9c-4b3b-8daa-dcd255652f32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:58.254899 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40deb81-2a9c-4b3b-8daa-dcd255652f32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:58.256336 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40deb81-2a9c-4b3b-8daa-dcd255652f32 service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:58.265622 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1456/2911] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:45:58 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:46:03.217346 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fbb358-bd92-46a4-92d1-1a2d5f1108a3 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:03.279956 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fbb358-bd92-46a4-92d1-1a2d5f1108a3 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:03.284564 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2942994e-ef56-4dce-ace5-ab551799524f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:03.285476 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942994e-ef56-4dce-ace5-ab551799524f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:03.285759 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942994e-ef56-4dce-ace5-ab551799524f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:03.286044 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942994e-ef56-4dce-ace5-ab551799524f admin admin] PATH_INFO: `/v3/users/f2f1cac1f468461d8fd75920f775bddc` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:03.287251 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2942994e-ef56-4dce-ace5-ab551799524f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2f1cac1f468461d8fd75920f775bddc)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:03.289270 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2942994e-ef56-4dce-ace5-ab551799524f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:03.300289 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:03.340407 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-2942994e-ef56-4dce-ace5-ab551799524f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2f1cac1f468461d8fd75920f775bddc'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:03.347852 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-2942994e-ef56-4dce-ace5-ab551799524f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2f1cac1f468461d8fd75920f775bddc'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:03.348504 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-2942994e-ef56-4dce-ace5-ab551799524f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2f1cac1f468461d8fd75920f775bddc'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:03.349155 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-2942994e-ef56-4dce-ace5-ab551799524f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2f1cac1f468461d8fd75920f775bddc'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:03.356209 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-2942994e-ef56-4dce-ace5-ab551799524f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2f1cac1f468461d8fd75920f775bddc'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:03.374251 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1456/2912] 10.222.0.16 () {58 vars in 1223 bytes} [Thu May 26 12:46:03 2022] DELETE /identity/v3/users/f2f1cac1f468461d8fd75920f775bddc => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:46:03.378665 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c7730c-ea69-4ab3-8dff-32e3077fd10c None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:03.379150 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c7730c-ea69-4ab3-8dff-32e3077fd10c None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:03.379248 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c7730c-ea69-4ab3-8dff-32e3077fd10c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:03.398107 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-f1c7730c-ea69-4ab3-8dff-32e3077fd10c None None] MFA Rules not processed for user `25194ab74edc4c009c8aaa9efa80932f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:03.399334 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-f1c7730c-ea69-4ab3-8dff-32e3077fd10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:03.460122 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1457/2913] 10.222.0.16 () {58 vars in 957 bytes} [Thu May 26 12:46:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:46:03.469794 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2942994e-ef56-4dce-ace5-ab551799524f admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:03.471265 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2942994e-ef56-4dce-ace5-ab551799524f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:03.534874 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2942994e-ef56-4dce-ace5-ab551799524f admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:03.539358 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69f6f55-4726-410c-8244-a06a8b0d7c93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68033ffcafbc47bbadd008abd9e56c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:03.540161 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f6f55-4726-410c-8244-a06a8b0d7c93 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:03.540577 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f6f55-4726-410c-8244-a06a8b0d7c93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:03.541053 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f6f55-4726-410c-8244-a06a8b0d7c93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:03.551222 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69f6f55-4726-410c-8244-a06a8b0d7c93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:03.552679 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69f6f55-4726-410c-8244-a06a8b0d7c93 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:03.562557 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1457/2914] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:46:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:46:03.849479 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c7730c-ea69-4ab3-8dff-32e3077fd10c None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:03.851209 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-f1c7730c-ea69-4ab3-8dff-32e3077fd10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:03.865221 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c7730c-ea69-4ab3-8dff-32e3077fd10c None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:03.871113 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871acecb-9e68-4c15-ad9f-409ae89d5a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25194ab74edc4c009c8aaa9efa80932f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c6d7f5ce344426b88b98fb2483df1ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:03.871975 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871acecb-9e68-4c15-ad9f-409ae89d5a8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:03.872879 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871acecb-9e68-4c15-ad9f-409ae89d5a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:03.873215 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871acecb-9e68-4c15-ad9f-409ae89d5a8c admin admin] PATH_INFO: `/v3/projects/46457ebdb9c345fc979abd2ee0129049` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:03.876011 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871acecb-9e68-4c15-ad9f-409ae89d5a8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=46457ebdb9c345fc979abd2ee0129049)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:03.877977 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871acecb-9e68-4c15-ad9f-409ae89d5a8c admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:03.925074 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-871acecb-9e68-4c15-ad9f-409ae89d5a8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46457ebdb9c345fc979abd2ee0129049', 'request_id': 'req-871acecb-9e68-4c15-ad9f-409ae89d5a8c'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:03.935662 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-871acecb-9e68-4c15-ad9f-409ae89d5a8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46457ebdb9c345fc979abd2ee0129049', 'request_id': 'req-871acecb-9e68-4c15-ad9f-409ae89d5a8c'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:03.944452 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-871acecb-9e68-4c15-ad9f-409ae89d5a8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46457ebdb9c345fc979abd2ee0129049', 'request_id': 'req-871acecb-9e68-4c15-ad9f-409ae89d5a8c'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:03.956846 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-871acecb-9e68-4c15-ad9f-409ae89d5a8c admin admin] The token cache is being invalidate because project 46457ebdb9c345fc979abd2ee0129049 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:46:03.957160 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-871acecb-9e68-4c15-ad9f-409ae89d5a8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:03.957814 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-871acecb-9e68-4c15-ad9f-409ae89d5a8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:03.959366 dv-cinder-815146-11-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1458/2915] 10.222.0.16 () {58 vars in 1232 bytes} [Thu May 26 12:46:03 2022] DELETE /identity/v3/projects/46457ebdb9c345fc979abd2ee0129049 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:46:13.558129 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:DELETE=10,keystone:SELECT=48,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:13.953708 dv-cinder-815146-11-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=74,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:40.062404 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69f6f55-4726-410c-8244-a06a8b0d7c93 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:40.063855 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b69f6f55-4726-410c-8244-a06a8b0d7c93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:40.215919 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69f6f55-4726-410c-8244-a06a8b0d7c93 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:40.279744 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b190125-cc1e-470e-9ce5-5f73099622b7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4327435c97834afeb7e6806ef02349a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42e6c693bd224d92b8a0fe4ad0cc586d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:40.280404 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b190125-cc1e-470e-9ce5-5f73099622b7 service placement] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:40.280691 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b190125-cc1e-470e-9ce5-5f73099622b7 service placement] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:40.281011 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b190125-cc1e-470e-9ce5-5f73099622b7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:40.283329 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0b190125-cc1e-470e-9ce5-5f73099622b7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:40.294987 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b190125-cc1e-470e-9ce5-5f73099622b7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:40.296603 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b190125-cc1e-470e-9ce5-5f73099622b7 service placement] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:40.307698 dv-cinder-815146-11-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1458/2916] 10.222.0.16 () {60 vars in 1365 bytes} [Thu May 26 12:48:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:48:50.303098 dv-cinder-815146-11-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}